2022-05-23 11:51:46,252 INFO MainThread:1049978 [internal.py:wandb_internal():90] W&B internal server running at pid: 1049978, started at: 2022-05-23 11:51:46.252721 2022-05-23 11:51:46,255 INFO WriterThread:1049978 [datastore.py:open_for_write():75] open: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/run-3dybzmyz.wandb 2022-05-23 11:51:46,258 DEBUG SenderThread:1049978 [sender.py:send():232] send: header 2022-05-23 11:51:46,258 DEBUG SenderThread:1049978 [sender.py:send():232] send: run 2022-05-23 11:51:46,532 INFO SenderThread:1049978 [dir_watcher.py:__init__():166] watching files in: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files 2022-05-23 11:51:46,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: check_version 2022-05-23 11:51:46,533 INFO SenderThread:1049978 [sender.py:_start_run_threads():811] run started: 3dybzmyz with start time 1653299505 2022-05-23 11:51:46,533 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 11:51:46,534 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 11:51:46,534 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: check_version 2022-05-23 11:51:46,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: run_start 2022-05-23 11:51:46,677 DEBUG HandlerThread:1049978 [meta.py:__init__():35] meta init 2022-05-23 11:51:46,677 DEBUG HandlerThread:1049978 [meta.py:__init__():49] meta init done 2022-05-23 11:51:46,677 DEBUG HandlerThread:1049978 [meta.py:probe():209] probe 2022-05-23 11:51:46,679 DEBUG HandlerThread:1049978 [meta.py:_setup_git():199] setup git 2022-05-23 11:51:46,699 DEBUG HandlerThread:1049978 [meta.py:_setup_git():206] setup git done 2022-05-23 11:51:46,699 DEBUG HandlerThread:1049978 [meta.py:_save_pip():53] save pip 2022-05-23 11:51:46,700 DEBUG HandlerThread:1049978 [meta.py:_save_pip():67] save pip done 2022-05-23 11:51:46,700 DEBUG HandlerThread:1049978 [meta.py:probe():247] probe done 2022-05-23 11:51:46,706 DEBUG SenderThread:1049978 [sender.py:send():232] send: files 2022-05-23 11:51:46,707 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-metadata.json with policy now 2022-05-23 11:51:46,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 11:51:46,715 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 11:51:46,953 DEBUG SenderThread:1049978 [sender.py:send():232] send: telemetry 2022-05-23 11:51:46,953 DEBUG SenderThread:1049978 [sender.py:send():232] send: config 2022-05-23 11:51:46,955 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:51:46,955 DEBUG SenderThread:1049978 [sender.py:send():232] send: telemetry 2022-05-23 11:51:46,955 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:51:46,955 WARNING SenderThread:1049978 [sender.py:send_metric():904] Seen metric with glob (shouldn't happen) 2022-05-23 11:51:46,955 DEBUG SenderThread:1049978 [sender.py:send():232] send: telemetry 2022-05-23 11:51:47,401 INFO Thread-11 :1049978 [upload_job.py:push():137] Uploaded file /tmp/tmprhho6awcwandb/28zdlary-wandb-metadata.json 2022-05-23 11:51:47,536 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_created():213] file/dir created: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 11:51:47,536 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_created():213] file/dir created: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:51:47,537 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_created():213] file/dir created: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-metadata.json 2022-05-23 11:51:47,537 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_created():213] file/dir created: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/requirements.txt 2022-05-23 11:51:49,534 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:51:59,538 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:52:02,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 11:52:02,045 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 11:52:05,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:52:09,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:52:13,544 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:52:14,763 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 11:52:17,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 11:52:17,275 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 11:52:17,545 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:52:17,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/config.yaml 2022-05-23 11:52:19,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:52:23,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:52:27,549 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:52:29,550 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:52:32,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 11:52:32,539 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 11:52:33,552 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:52:35,552 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:52:39,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:52:41,555 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:52:44,854 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 11:52:45,556 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:52:47,557 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:52:47,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 11:52:47,771 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 11:52:49,558 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:52:53,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:52:55,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:52:57,561 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:52:59,562 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:53:01,563 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:53:02,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 11:53:02,996 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 11:53:05,565 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:53:07,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:53:09,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:53:11,567 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:53:13,568 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:53:14,933 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 11:53:15,569 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:53:17,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:53:18,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 11:53:18,305 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 11:53:19,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:53:21,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:53:23,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:53:25,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:53:27,574 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:53:29,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:53:32,576 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:53:33,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 11:53:33,575 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 11:53:34,579 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:53:36,580 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:53:38,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:53:40,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:53:42,583 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:53:44,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:44,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:44,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:44,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:44,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:44,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:44,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:44,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:44,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:44,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:44,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:44,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:44,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:53:45,011 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 11:53:46,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:53:48,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:48,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:48,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:48,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:48,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:48,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:48,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:48,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:48,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:48,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:48,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:48,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:48,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:48,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:48,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:48,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:48,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 11:53:48,908 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 11:53:48,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:48,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:48,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:48,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:48,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:48,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:48,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:48,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:49,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:50,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:50,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:50,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:50,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:50,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:50,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:50,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:50,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:50,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:50,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:50,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:50,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:50,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:50,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:50,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:50,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:50,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:50,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:50,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:50,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:50,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:50,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:50,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:50,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:50,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:50,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:50,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:50,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:50,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:50,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:50,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:50,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:53,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:53,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:53,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:53,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:53,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:53,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:53,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:53,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:53,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:53,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:53,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:53,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:53,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:53,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:53,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:53,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:53,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:53,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:53,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:53,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:53,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:53,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:53,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:53,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:53,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:53,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:53,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:53,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:53,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:53,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:53,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:53,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:54,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,588 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:53:56,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:56,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:58,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:53:59,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:01,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:02,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:02,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:02,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:02,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:02,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:02,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:02,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:02,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:02,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:02,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:02,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:02,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:02,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:02,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:02,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:02,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:02,591 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:54:03,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:03,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:04,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:04,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:04,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:04,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:04,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:04,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:04,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:04,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:04,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:04,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:04,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:04,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:04,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:04,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:04,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:04,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:04,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 11:54:04,143 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 11:54:06,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:06,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:06,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:06,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:06,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:06,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:06,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:06,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:06,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:06,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:06,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:06,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:06,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:06,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:06,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:06,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:06,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:06,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:06,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:06,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:06,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:06,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:06,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:06,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:06,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:06,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:06,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:06,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:06,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:06,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:06,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:06,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:06,592 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:54:07,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:07,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:08,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:54:10,594 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:54:14,596 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:54:15,088 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 11:54:18,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:54:19,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 11:54:19,373 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 11:54:22,599 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:54:24,599 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:54:28,601 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:54:32,603 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:54:34,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:54:34,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 11:54:34,644 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 11:54:38,605 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:54:40,606 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:54:42,607 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:54:45,166 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 11:54:46,609 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:54:48,610 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:54:49,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 11:54:49,889 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 11:54:50,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:54:54,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:54:56,613 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:54:58,614 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:55:00,615 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:55:02,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:55:05,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 11:55:05,153 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 11:55:06,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:55:08,619 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:55:10,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:55:12,621 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:55:14,622 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:55:15,244 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 11:55:16,623 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:55:18,624 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:55:20,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 11:55:20,529 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 11:55:20,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:55:22,626 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:55:24,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:55:26,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:55:28,629 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:55:30,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:55:32,631 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:55:34,632 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:55:35,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 11:55:35,779 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 11:55:36,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:55:38,634 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:55:40,635 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:55:42,636 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:55:44,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:44,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:44,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:44,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:44,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:44,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:44,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:44,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:44,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:44,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:44,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:44,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:44,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:44,672 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,678 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,683 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,688 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,698 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,698 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,699 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,704 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,709 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,715 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:55:44,721 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,744 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,749 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,755 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,755 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,755 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,755 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,756 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,756 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,756 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,756 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,756 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,756 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,756 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,757 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,757 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,757 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,757 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,757 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,757 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,757 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,758 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,758 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,758 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,758 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,758 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,758 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,758 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,759 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,759 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,759 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,759 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,759 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,759 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,759 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,760 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,760 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,760 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,760 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,760 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,760 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,760 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,761 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,761 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,761 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,761 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,761 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,761 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,762 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,762 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,762 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,762 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,762 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,762 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,762 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,763 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,763 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,763 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,763 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,763 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,763 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,763 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,764 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,764 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,764 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,764 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,764 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,764 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,764 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,765 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,765 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,765 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,765 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,765 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,765 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,765 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,766 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,766 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,766 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,766 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,766 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,766 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,766 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,767 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,767 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,767 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,767 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,767 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,767 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,767 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,768 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,768 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,768 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,768 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,768 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,768 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,768 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,769 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,769 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,769 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,769 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,769 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,769 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,769 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,770 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,770 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,770 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,770 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,770 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,770 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,770 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,771 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,771 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,771 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,771 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,771 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,771 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,771 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,771 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,772 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,772 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,772 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,772 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,772 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,772 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,772 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,772 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,772 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,772 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,772 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,772 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,773 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,773 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,773 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,773 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,773 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,773 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,773 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,773 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,773 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,773 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,773 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,774 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,774 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,774 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,774 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,774 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,774 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,774 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,774 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,774 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,774 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,774 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,774 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,775 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,775 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,775 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,775 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,775 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,775 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,775 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,775 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,775 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,775 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,775 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,775 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,776 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,776 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,776 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,776 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,776 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,776 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,776 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,776 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,776 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,776 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,776 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,776 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,777 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,777 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,777 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,777 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,777 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,777 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,777 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,777 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,777 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,777 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,777 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,777 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,778 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,778 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,778 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,778 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,778 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,778 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,778 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,778 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,778 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,778 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,778 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,778 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,779 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,779 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,779 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,779 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,779 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,779 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,779 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,779 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,779 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,779 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,779 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,780 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,780 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,780 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,780 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,780 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,780 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,780 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,780 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,780 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,780 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,780 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,780 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,781 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,781 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,781 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,781 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,781 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,781 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,781 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,781 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,781 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,781 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,781 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,781 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,782 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,782 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,782 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,782 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,782 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,782 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,782 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,782 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,782 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,782 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,782 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,782 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,782 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,782 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,782 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,782 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,782 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,782 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,783 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,783 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,783 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,783 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,783 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,783 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,783 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,783 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,783 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,783 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,783 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,783 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,783 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,783 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,783 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,783 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,783 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,784 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,784 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,784 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,784 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,784 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,784 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,784 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,784 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,784 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,784 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,784 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,784 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,784 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,784 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,784 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,784 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,784 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,784 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,785 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,785 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,785 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,785 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,785 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,785 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,785 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,785 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,785 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,785 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,785 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,785 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,785 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,785 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,785 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,785 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,785 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,785 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,786 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,786 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,786 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,786 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,786 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,786 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,786 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,786 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,786 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,786 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,786 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,786 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,786 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,786 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,786 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,786 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,787 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,787 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,787 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,787 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,787 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,787 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,787 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,787 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,787 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,787 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,787 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,787 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,787 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,787 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,787 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,787 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,787 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,788 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,788 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,788 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,788 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,788 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,788 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,788 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,788 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,788 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,788 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,788 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,788 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,788 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,788 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,788 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,788 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,788 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,788 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,789 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,789 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,789 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,789 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,789 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,789 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,789 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,789 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,789 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,789 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,789 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,789 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,789 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,789 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,789 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,789 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,789 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,789 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,790 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,790 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,790 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,790 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,790 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,790 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,790 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,790 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,790 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,790 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,790 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,790 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,790 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,790 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,790 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,790 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,791 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,791 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,791 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,791 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,791 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,791 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,791 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,791 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,791 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,791 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,791 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,791 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,791 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,791 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,791 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,791 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,791 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,791 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,792 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,792 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,792 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,792 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,792 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,792 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,792 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,792 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,792 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,792 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,792 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,792 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,792 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,792 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,792 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,792 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,792 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,792 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,792 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,792 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,792 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,792 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,793 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,793 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,793 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,793 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,793 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,793 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,793 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,793 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,793 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,793 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,793 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,793 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,793 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,793 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,793 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,793 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,793 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,793 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,793 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,793 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,793 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,793 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,793 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,793 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,793 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,793 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,794 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,794 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,794 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,794 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,794 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,794 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,794 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,794 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,794 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,794 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,794 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,794 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,794 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,794 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,794 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,794 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,794 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,794 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,794 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,794 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,794 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,794 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,794 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,794 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,794 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,794 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,794 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,795 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,795 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,795 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,795 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,795 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,795 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,795 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,795 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,795 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,795 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,795 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,795 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,795 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,795 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,795 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,795 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,795 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,795 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,795 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,795 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,795 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,795 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,795 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,795 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,795 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,795 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,796 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,796 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,796 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,796 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,796 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,796 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,796 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,796 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,796 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,796 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,796 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,796 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,796 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,796 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,796 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,796 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,796 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,796 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,796 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,796 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,796 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,796 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,796 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,796 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,796 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,796 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,797 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,797 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,797 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,797 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,797 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,797 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,797 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,797 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,797 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,797 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,797 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,797 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,797 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,797 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,797 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,797 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,797 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,797 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,797 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,797 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,797 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,797 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,797 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,797 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,797 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,797 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,798 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,798 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,798 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,798 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,798 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,798 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,798 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,798 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,798 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,798 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,798 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,798 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,798 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,798 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,798 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,798 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,798 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,798 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,798 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,798 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,798 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,798 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,798 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,798 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,798 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,798 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,799 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,799 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,799 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,799 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,799 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,799 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,799 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,799 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,799 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,799 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,799 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,799 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,799 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,799 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,799 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,799 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,799 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,799 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,799 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,799 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,799 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,799 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,799 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,799 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,799 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,800 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,800 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,800 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,800 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,800 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,800 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,800 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,800 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,800 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,800 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,800 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,800 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,800 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,800 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,800 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,800 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,800 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,800 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,800 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,800 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,800 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,800 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,800 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,800 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,800 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,800 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,801 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,801 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,801 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,801 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,801 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,801 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,801 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,801 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,801 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,801 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,801 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,801 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,801 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,801 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,801 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,801 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,801 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,801 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,801 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,801 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,801 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,801 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,801 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,801 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,801 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,802 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,802 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,802 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,802 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,802 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,802 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,802 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,802 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,802 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,802 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,802 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,802 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,802 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,802 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,802 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,802 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,802 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,802 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,802 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,802 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,802 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,802 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,802 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,802 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,803 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,803 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,803 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,803 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,803 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,803 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,803 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,803 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,803 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,803 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,803 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,803 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,803 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,803 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,803 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,803 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,803 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,803 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,803 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,803 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,803 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,803 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,803 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,803 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,803 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,803 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,804 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,804 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,804 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,804 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,804 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,804 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,804 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,804 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,804 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,804 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,804 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,804 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,804 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,804 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,804 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,804 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,804 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,804 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,804 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,804 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,804 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,804 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,804 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,805 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,805 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,805 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,805 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,805 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,805 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,805 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,805 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,805 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,805 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,805 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,805 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,805 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,805 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,805 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,805 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,805 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,805 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,805 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,805 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,805 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,805 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,805 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,805 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,805 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,805 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,805 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,806 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,806 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,806 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,806 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,806 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,806 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,806 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,806 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,806 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,806 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,806 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,806 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,806 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,806 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,806 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,806 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,806 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,806 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,806 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,806 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,806 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,806 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,806 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,806 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,807 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,807 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,807 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,807 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,807 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,807 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,807 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,807 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,807 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,807 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,807 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,807 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,807 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,807 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,807 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,807 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,807 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,807 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,807 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,807 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,807 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,807 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,807 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,807 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,807 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,807 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,808 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,808 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,808 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,808 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,808 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,808 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,808 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,808 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,808 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,808 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,808 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,808 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,808 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,808 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,808 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,808 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,808 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,808 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,808 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,808 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,808 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,808 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,808 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,808 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,808 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,808 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,809 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,809 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,809 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,809 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,809 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,809 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,809 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,809 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,809 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,809 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,809 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,809 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,809 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,809 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,809 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,809 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,809 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,809 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,809 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,809 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,809 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,809 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,809 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,809 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,809 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,809 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,810 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,810 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,810 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,810 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,810 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,810 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,810 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,810 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,810 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,810 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,810 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,810 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,810 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,810 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,810 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,810 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,810 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,810 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,810 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,810 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,810 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,810 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,810 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,810 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,810 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,810 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,810 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,811 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,811 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,811 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,811 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,811 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,811 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,811 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,811 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,811 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,811 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,811 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,811 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,811 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,811 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,811 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,811 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,811 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,811 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,811 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,811 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,811 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,811 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,811 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,811 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,811 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,811 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,812 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,812 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,812 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,812 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,812 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,812 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,812 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,812 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,812 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,812 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,812 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,812 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,812 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,812 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,812 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,812 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,812 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,812 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,812 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,812 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,812 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,812 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,812 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,812 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,812 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,812 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,813 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,813 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,813 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,813 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,813 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,813 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,813 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,813 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,813 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,813 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,813 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,813 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,813 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,813 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,813 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,813 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,813 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,813 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,813 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,813 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,813 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,813 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,813 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,813 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,813 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,813 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,814 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,814 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,814 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,814 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,814 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,814 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,814 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,814 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,814 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,814 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,814 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,814 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,814 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,814 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,814 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,814 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,814 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,814 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,814 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,814 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,814 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,814 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,814 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,814 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,814 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,814 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,814 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,815 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,815 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,815 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,815 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,815 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,815 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,815 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,815 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,815 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,815 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,815 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,815 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,815 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,815 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,815 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,815 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,815 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,815 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,815 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,815 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,815 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,815 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,815 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,815 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,816 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,816 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,816 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,816 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,816 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,816 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,816 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,816 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,816 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,816 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,816 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,816 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,816 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,816 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,816 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,816 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,816 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,816 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,816 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,816 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,816 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,816 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,816 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,816 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,816 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,816 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,817 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,817 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,817 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,817 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,817 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,817 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,817 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,817 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,817 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,817 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,817 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,817 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,817 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,817 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,817 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,817 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,817 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,817 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,817 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,817 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,817 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,817 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,817 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,817 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,817 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,818 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,818 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,818 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,818 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,818 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,818 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,818 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,818 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,818 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,818 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,818 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,818 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,818 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,818 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,818 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,818 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,818 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,818 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,818 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,818 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,818 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,818 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,818 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,818 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,818 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,818 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,819 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,819 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,819 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,819 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,819 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,819 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,819 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,819 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,819 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,819 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,819 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,819 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,819 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,819 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,819 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,819 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,819 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,819 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,819 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,819 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,819 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,819 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,819 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,819 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,819 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,819 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,820 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,820 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,820 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,820 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,820 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,820 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,820 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,820 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,820 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,820 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,820 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,820 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,820 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,820 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,820 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,820 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,820 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,820 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,820 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,820 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,820 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,820 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,820 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,820 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,820 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,820 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,820 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,821 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,821 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,821 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,821 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,821 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,821 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,821 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,821 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,821 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,821 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,821 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,821 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,821 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,821 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,821 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,821 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,821 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,821 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,821 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,821 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,821 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,821 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,821 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,821 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,821 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,821 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,822 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,822 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,822 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,822 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,822 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,822 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,822 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,822 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,822 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,822 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,822 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,822 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,822 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,822 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,822 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,822 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,822 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,822 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,822 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,822 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,822 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,822 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,822 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,822 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,822 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,822 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,822 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,823 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,823 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,823 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,823 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,823 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,823 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,823 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,823 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,823 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,823 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,823 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,823 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,823 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,823 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,823 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,823 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,823 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,823 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,823 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,823 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,823 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,823 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,823 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,823 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,823 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,823 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,824 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,824 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,824 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,824 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,824 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,824 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,824 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,824 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,824 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,824 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,824 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,824 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,824 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,824 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,824 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,824 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,824 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,824 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,824 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,824 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,824 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,824 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,824 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,824 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,824 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,825 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,825 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,825 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,825 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,825 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,825 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,825 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,825 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,825 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,825 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,825 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,825 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,825 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,825 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,825 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,825 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,825 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,825 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,825 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,825 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,825 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,825 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,825 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,825 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,825 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,826 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,826 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,826 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,826 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,826 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,826 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,826 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,826 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,826 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,826 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,826 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,826 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,826 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,826 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,826 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,826 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,826 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,826 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,826 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,826 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,826 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,826 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,826 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,826 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,826 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,826 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,827 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,827 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,827 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,827 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,827 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,827 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,827 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,827 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,827 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,827 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,827 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,827 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,827 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,827 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,827 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,827 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,827 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,827 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,827 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,827 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,827 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,827 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,827 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,827 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,827 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,828 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,828 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,828 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,828 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,828 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,828 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,828 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,828 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,828 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,828 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,828 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,828 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,828 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,828 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,828 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,828 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,828 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,828 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,828 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,828 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,828 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,828 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,828 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,828 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,829 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,829 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,829 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,829 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,829 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,829 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,829 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,829 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,829 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,829 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,829 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,829 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,829 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,829 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,829 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,829 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,829 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,829 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,829 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,829 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,829 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,829 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,829 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,830 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,830 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,830 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,830 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,830 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,830 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,830 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,830 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,830 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,830 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,830 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,830 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,830 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,830 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,830 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,830 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,830 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,830 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,830 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,830 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,830 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,830 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,830 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,830 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,831 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,831 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,831 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,831 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,831 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,831 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,831 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,831 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,831 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,831 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,831 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,831 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,831 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,831 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,831 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,831 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,831 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,831 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,831 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,831 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,831 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,831 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,832 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,832 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,832 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,832 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,832 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,832 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,832 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,832 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,832 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,832 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,832 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,832 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,832 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,832 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,832 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,832 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,832 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,832 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,832 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,832 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,832 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,832 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,832 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,832 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,832 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,832 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,833 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,833 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,833 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,833 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,833 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,833 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,833 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,833 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,833 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,833 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,833 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,833 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,833 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,833 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,833 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,833 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,833 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,833 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,833 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,833 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,833 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,833 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,833 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,833 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,833 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,833 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,834 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,834 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,834 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,834 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,834 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,834 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,834 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,834 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,834 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,834 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,834 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,834 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,834 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,834 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,834 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,834 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,834 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,834 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,834 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,834 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,834 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,834 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,834 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,834 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,834 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,834 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,835 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,835 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,835 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,835 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,835 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,835 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,835 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,835 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,835 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,835 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,835 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,835 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,835 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,835 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,835 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,835 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,835 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,835 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,835 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,835 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,835 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,835 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,835 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,835 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,835 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,835 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,835 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,836 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,836 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,836 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,836 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,836 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,836 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,836 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,836 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,836 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,836 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,836 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,836 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,836 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,836 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,836 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,836 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,836 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,836 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,836 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,836 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,836 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,836 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,836 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,836 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,836 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,836 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,837 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,837 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,837 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,837 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,837 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,837 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,837 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,837 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,837 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,837 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,837 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,837 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,837 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,837 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,837 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,837 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,837 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,837 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,837 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,837 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,837 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,837 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,837 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,837 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,837 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,837 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,838 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,838 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,838 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,838 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,838 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,838 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,838 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,838 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,838 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,838 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,838 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,838 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,838 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,838 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,838 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,838 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,838 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,838 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,838 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,838 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,838 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,838 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,838 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,838 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,838 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,838 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,838 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,839 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,839 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,839 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,839 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,839 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,839 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,839 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,839 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,839 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,839 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,839 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,839 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,839 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,839 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,839 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,839 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,839 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,839 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,839 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,839 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,839 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,839 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,839 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,839 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,839 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,839 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,840 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,840 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,840 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,840 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,840 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,840 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,840 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,840 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,840 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,840 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,840 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,840 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,840 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,840 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,840 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,840 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,840 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,840 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,840 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,840 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,840 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,840 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,840 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,840 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,840 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,841 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,841 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,841 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,841 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,841 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,841 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,841 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,841 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,841 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,841 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,841 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,841 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,841 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,841 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,841 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,841 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,841 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,841 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,841 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,841 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,841 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,841 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,841 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,841 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,841 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,842 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,842 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,842 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,842 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,842 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,842 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,842 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,842 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,842 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,842 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,842 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,842 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,842 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,842 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,842 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,842 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,842 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,842 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,842 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,842 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,842 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,842 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,842 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,842 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,842 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,842 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,842 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,843 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,843 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,843 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,843 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,843 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,843 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,843 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,843 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,843 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,843 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,843 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,843 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,843 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,843 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,843 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,843 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,843 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,843 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,843 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,843 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,843 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,843 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,843 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,843 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,843 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,843 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,844 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,844 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,844 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,844 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,844 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,844 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,844 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,844 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,844 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,844 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,844 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,844 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,844 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,844 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,844 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,844 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,844 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,844 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,844 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,844 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,844 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,844 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,844 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,844 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,845 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,845 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,845 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,845 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,845 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,845 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,845 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,845 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,845 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,845 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,845 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,845 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,845 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,845 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,845 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,845 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,845 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,845 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,845 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,845 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,845 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,845 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,845 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,845 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,845 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,846 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,846 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,846 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,846 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,846 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,846 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,846 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,846 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,846 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,846 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,846 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,846 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,846 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,846 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,846 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,846 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,846 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,846 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,846 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,846 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,846 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,846 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,846 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,846 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,846 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,847 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,847 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,847 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,847 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,847 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,847 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,847 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,847 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,847 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,847 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,847 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,847 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,847 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,847 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,847 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,847 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,847 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,847 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,847 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,847 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,847 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,847 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,847 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,847 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,847 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,848 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,848 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,848 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,848 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,848 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,848 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,848 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,848 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,848 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,848 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,848 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,848 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,848 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,848 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,848 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,848 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,848 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,848 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,848 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,848 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,848 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,848 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,848 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,848 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,848 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,848 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,849 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,849 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,849 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,849 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,849 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,849 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,849 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,849 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,849 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,849 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,849 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,849 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,849 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,849 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,849 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,849 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,849 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,849 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,849 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,849 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,849 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,849 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,849 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,849 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,849 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,849 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,850 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,850 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,850 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,850 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,850 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,850 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,850 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,850 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,850 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,850 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,850 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,850 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,850 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,850 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,850 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,850 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,850 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,850 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,850 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,850 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,850 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,850 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,850 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,850 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,850 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,851 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,851 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,851 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,851 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,851 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,851 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,851 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,851 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,851 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,851 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,851 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,851 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,851 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,851 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,851 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,851 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,851 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,851 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,851 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,851 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,851 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,851 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,851 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,851 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,851 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,851 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,852 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,852 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,852 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,852 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,852 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,852 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,852 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,852 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,852 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,852 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,852 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,852 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,852 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,852 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,852 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,852 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,852 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,852 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,852 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,852 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,852 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,852 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,852 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,852 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,852 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,853 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,853 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,853 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,853 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,853 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,853 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,853 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,853 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,853 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,853 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,853 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,853 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,853 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,853 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,853 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,853 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,853 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,853 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,853 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,853 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,853 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,853 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,853 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,853 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,853 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,854 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,854 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,854 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,854 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,854 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,854 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,854 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,854 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,854 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,854 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,854 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,854 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,854 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,854 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,854 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,854 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,854 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,854 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,854 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,854 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,854 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,854 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,854 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,854 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,854 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,854 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,855 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,855 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,855 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,855 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,855 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,855 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,855 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,855 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,855 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,855 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,855 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,855 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,855 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,855 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,855 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,855 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,855 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,855 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,855 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,855 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,855 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,855 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,855 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,855 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,856 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,856 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,856 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,856 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,856 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,856 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,856 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,856 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,856 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,856 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,856 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,856 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,856 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,856 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,856 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,856 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,856 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,856 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,856 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,856 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,856 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,856 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,856 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,856 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,856 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,856 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,857 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,857 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,857 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,857 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,857 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,857 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,857 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,857 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,857 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,857 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,857 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,857 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,857 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,857 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,857 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,857 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,857 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,857 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,857 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,857 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,857 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,857 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,857 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,857 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,857 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,858 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,858 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,858 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,858 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,858 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,858 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,858 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,858 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,858 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,858 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,858 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,858 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,858 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,858 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,858 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,858 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,858 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,858 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,858 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,858 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,858 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,858 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,858 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,858 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,858 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,859 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,859 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,859 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,859 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,859 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,859 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,859 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,859 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,859 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,859 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,859 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,859 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,859 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,859 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,859 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,859 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,859 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,859 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,859 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,859 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,859 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,859 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,859 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,859 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,859 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,859 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,860 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,860 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,860 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,860 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,860 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,860 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,860 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,860 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,860 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,860 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,860 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,860 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,860 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,860 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,860 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,860 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,860 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,860 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,860 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,860 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,860 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,860 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,860 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,860 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,860 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,860 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,861 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,861 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,861 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,861 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,861 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,861 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,861 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,861 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,861 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,861 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,861 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,861 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,861 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,861 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,861 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,861 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,861 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,861 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,861 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,861 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,861 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,861 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,861 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,861 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,861 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,861 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,861 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,862 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,862 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,862 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,862 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,862 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,862 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,862 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,862 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,862 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,862 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,862 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,862 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,862 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,862 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,862 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,862 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,862 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,862 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,862 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,862 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,862 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,862 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,862 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,862 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,862 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,862 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,863 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,863 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,863 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,863 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,863 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,863 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,863 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,863 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,863 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,863 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,863 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,863 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,863 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,863 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,863 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,863 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,863 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,863 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,863 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,863 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,863 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,863 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,863 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,863 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,863 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,863 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,864 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,864 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,864 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,864 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,864 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,864 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,864 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,864 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,864 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,864 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,864 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,864 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,864 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,864 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,864 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,864 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,864 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,864 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,864 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,864 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,864 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,864 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,864 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,864 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,864 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,864 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,865 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,865 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,865 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,865 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,865 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,865 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,865 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,865 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,865 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,865 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,865 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,865 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,865 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,865 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,865 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,865 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,865 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,865 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,865 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,865 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,865 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,865 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,865 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,865 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,865 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,865 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,866 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,866 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,866 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,866 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,866 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,866 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,866 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,866 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,866 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,866 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,866 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,866 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,866 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,866 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,866 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,866 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,866 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,866 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,866 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,866 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,866 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,866 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,866 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,866 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,866 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,867 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,867 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,867 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,867 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,867 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,867 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,867 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 11:55:44,867 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 11:55:44,919 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 11:55:44,970 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 11:55:45,342 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 11:55:45,716 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 11:55:46,716 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:55:49,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:49,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:49,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:49,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:49,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:49,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:49,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:49,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:49,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:49,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:49,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:49,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:49,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:49,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:49,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:49,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:49,718 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/config.yaml 2022-05-23 11:55:51,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 11:55:51,001 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 11:55:54,720 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:55:57,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:57,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:57,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:57,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:57,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:57,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:57,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:57,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:57,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:57,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:57,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:57,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:57,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:57,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:57,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:57,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:59,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:59,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:59,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:59,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:59,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:59,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:59,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:59,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:59,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:59,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:59,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:59,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:59,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:59,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:59,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:55:59,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:00,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:00,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:00,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:00,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:00,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:00,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:00,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:00,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:00,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:00,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:00,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:00,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:00,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:00,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:00,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:00,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:00,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:00,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:00,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:00,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:00,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:00,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:00,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:00,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:00,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:00,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:00,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:00,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:00,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:00,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:00,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:00,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:00,723 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:56:01,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:01,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:01,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:01,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:01,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:01,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:01,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:01,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:01,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:01,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:01,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:01,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:01,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:01,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:01,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:01,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:02,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,725 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:56:04,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:04,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:05,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:05,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:05,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:05,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:05,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:05,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:05,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:05,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:05,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:05,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:05,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:05,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:05,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:05,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:05,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:05,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:05,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:05,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:05,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:05,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:05,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:05,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:05,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:05,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:05,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:05,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:05,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:05,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:05,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:05,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:05,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:05,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 11:56:06,230 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 11:56:06,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:06,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,726 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:56:08,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:08,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:09,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:10,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:11,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:11,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:11,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:11,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:11,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:11,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:11,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:11,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:11,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:11,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:11,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:11,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:11,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:11,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:11,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:11,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:11,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:11,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:11,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:11,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:11,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:11,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:11,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:11,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:11,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:11,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:11,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:11,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:11,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:11,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:11,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:11,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:12,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:56:12,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:12,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:12,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:12,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:12,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:12,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:12,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:12,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:12,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:12,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:12,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:12,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:12,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:12,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:12,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:12,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:13,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:13,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:13,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:13,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:13,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:13,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:13,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:13,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:13,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:13,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:13,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:13,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:13,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:13,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:13,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:13,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:14,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:15,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:15,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:15,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:15,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:15,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:15,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:15,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:15,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:15,451 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 11:56:16,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:16,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:16,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:16,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:16,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:16,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:16,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:16,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:16,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:16,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:16,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:16,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:16,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:16,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:16,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:16,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:16,730 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:56:16,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:16,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:16,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:16,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:16,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:16,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:16,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:16,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:16,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:16,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:16,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:16,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:16,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:16,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:16,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:16,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:20,732 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:56:21,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 11:56:21,453 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 11:56:23,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:23,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:23,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:23,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:23,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:23,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:23,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:23,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:23,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:23,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:23,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:23,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:23,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:23,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:23,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:23,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:56:24,733 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:56:26,734 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:56:30,736 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:56:32,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:56:36,739 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:56:36,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 11:56:36,761 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 11:56:38,739 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:56:43,741 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:56:45,529 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 11:56:45,742 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:56:49,744 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:56:51,745 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:56:52,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 11:56:52,013 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 11:56:53,746 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:56:55,747 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:56:59,749 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:57:01,750 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:57:03,751 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:57:05,751 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:57:07,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 11:57:07,431 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 11:57:07,752 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:57:09,753 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:57:11,754 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:57:13,755 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:57:15,606 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 11:57:15,756 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:57:17,757 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:57:19,758 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:57:21,759 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:57:22,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 11:57:22,745 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 11:57:23,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:57:25,761 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:57:27,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:57:29,763 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:57:31,764 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:57:33,765 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:57:35,766 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:57:37,767 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:57:38,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 11:57:38,009 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 11:57:39,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:57:41,769 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:57:43,770 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:57:44,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:57:44,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:57:44,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:57:44,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:57:44,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:57:44,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:57:44,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:57:44,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:57:44,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:57:44,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:57:44,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:57:44,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:57:45,679 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 11:57:45,770 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:57:52,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:57:52,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:57:52,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:57:52,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:57:52,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:57:52,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:57:52,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:57:52,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:57:52,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:57:52,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:57:52,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:57:52,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:57:52,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:57:52,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:57:52,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:57:52,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:57:53,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 11:57:53,388 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 11:57:53,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:57:57,775 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:58:00,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:00,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:00,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:00,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:00,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:00,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:00,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:00,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:00,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:00,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:00,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:00,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:00,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:00,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:00,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:00,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:03,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:03,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:03,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:03,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:03,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:03,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:03,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:03,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:03,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:03,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:03,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:03,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:03,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:03,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:03,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:03,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:03,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:58:05,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:05,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:05,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:05,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:05,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:05,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:05,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:05,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:05,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:05,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:05,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:05,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:05,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:05,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:05,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:05,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:07,779 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:58:08,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 11:58:08,614 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 11:58:08,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:08,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:09,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:10,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:10,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:10,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:10,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:10,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:10,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:10,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:10,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:10,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:10,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:10,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:10,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:10,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:10,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:10,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:10,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:11,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:11,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:11,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:11,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:11,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:11,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:11,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:11,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:11,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:11,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:11,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:11,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:11,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:11,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:11,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:11,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:11,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:11,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:11,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:11,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:11,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:11,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:11,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:11,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:11,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:11,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:11,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:11,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:11,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:11,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:11,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:11,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:11,781 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:58:12,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:12,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:13,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:14,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:15,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:15,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:15,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:15,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:15,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:15,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:15,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:15,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:15,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:15,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:15,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:15,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:15,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:15,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:15,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:15,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:15,759 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 11:58:16,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:58:16,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:16,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:18,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:18,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:18,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:18,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:18,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:18,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:18,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:18,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:18,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:18,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:18,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:18,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:18,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:18,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:18,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:18,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:18,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:18,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:18,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:18,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:18,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:18,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:18,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:18,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:18,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:18,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:18,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:18,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:18,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:18,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:18,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:18,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:18,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:58:19,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:19,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:19,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:19,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:19,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:19,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:19,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:19,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:19,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:19,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:19,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:19,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:19,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:19,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:19,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:19,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:20,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:21,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:21,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:21,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:21,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:21,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:21,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:21,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:21,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:21,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:21,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:21,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:21,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:21,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:21,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:21,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:21,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:22,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:22,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:22,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:22,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:22,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:22,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:22,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:22,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:22,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:22,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:22,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:22,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:22,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:22,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:22,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:22,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:22,786 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:58:23,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:23,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:23,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:23,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:23,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:23,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:23,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:23,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:23,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:23,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:23,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:23,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:23,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:23,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:23,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:23,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:23,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 11:58:23,839 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 11:58:25,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:25,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:25,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:25,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:25,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:25,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:25,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:25,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:25,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:25,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:25,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:25,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:25,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:25,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:25,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:25,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:26,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:26,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:26,788 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:58:26,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:26,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:26,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:26,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:26,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:26,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:26,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:26,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:26,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:26,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:26,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:26,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:26,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:26,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:28,789 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:58:32,791 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:58:34,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:34,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:34,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:34,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:34,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:34,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:34,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:34,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:34,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:34,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:34,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:34,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:34,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:34,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:34,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:34,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:58:34,792 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:58:38,793 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:58:39,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 11:58:39,069 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 11:58:40,794 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:58:44,796 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:58:45,836 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 11:58:46,797 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:58:48,798 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:58:50,799 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:58:54,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 11:58:54,473 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 11:58:54,801 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:58:56,802 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:58:58,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:59:00,804 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:59:02,805 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:59:04,805 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:59:06,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:59:08,807 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:59:09,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 11:59:09,808 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 11:59:10,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:59:12,813 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:59:14,814 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:59:15,912 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 11:59:16,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:59:18,816 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:59:20,817 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:59:22,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:59:24,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:59:25,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 11:59:25,180 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 11:59:26,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:59:28,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:59:30,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:59:32,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:59:34,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:59:36,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:59:38,826 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:59:40,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 11:59:40,503 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 11:59:40,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:59:41,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:59:41,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:59:41,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:59:41,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:59:41,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:59:41,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:59:41,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:59:41,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:59:41,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:59:41,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:59:41,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:59:41,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:59:41,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 11:59:41,983 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 11:59:42,200 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 11:59:42,269 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 11:59:42,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 11:59:42,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:59:46,282 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 11:59:52,831 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 11:59:55,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 11:59:55,727 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 11:59:58,834 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:00:02,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:00:06,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:00:10,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:10,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:10,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:10,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:10,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:10,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:10,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:10,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:10,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:10,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:10,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:10,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:10,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:10,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:10,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:10,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:10,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:10,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:10,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:10,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:10,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:10,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:10,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:10,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:10,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:10,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:10,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:10,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:10,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:10,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:10,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:10,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:10,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:00:10,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:00:10,952 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:00:12,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:12,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:14,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:00:16,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,372 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:00:16,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:16,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:17,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:17,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:17,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:17,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:17,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:17,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:17,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:17,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:17,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:17,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:17,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:17,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:17,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:17,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:17,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:17,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:17,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:17,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:17,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:17,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:17,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:17,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:17,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:17,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:17,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:17,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:17,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:17,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:17,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:17,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:17,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:17,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:18,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:00:19,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:19,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:19,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:19,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:19,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:19,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:19,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:19,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:19,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:19,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:19,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:19,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:19,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:19,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:19,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:19,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:20,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:00:21,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:21,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:22,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:22,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:22,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:22,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:22,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:22,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:22,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:22,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:22,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:22,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:22,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:22,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:22,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:22,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:22,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:22,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:23,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:24,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:00:26,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:00:26,318 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:00:26,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:26,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:26,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:26,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:26,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:26,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:26,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:26,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:26,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:26,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:26,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:26,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:26,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:26,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:26,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:26,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:28,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:28,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:28,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:28,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:28,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:28,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:28,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:28,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:28,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:28,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:28,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:28,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:28,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:28,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:28,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:28,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:28,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:28,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:28,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:28,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:28,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:28,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:28,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:28,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:28,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:28,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:28,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:28,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:28,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:28,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:28,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:28,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:28,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:00:29,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:29,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:30,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:00:30,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:30,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:30,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:30,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:30,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:30,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:30,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:30,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:30,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:30,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:30,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:30,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:30,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:30,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:30,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:30,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:32,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:32,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:32,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:32,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:32,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:32,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:32,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:32,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:32,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:32,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:32,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:32,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:32,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:32,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:32,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:32,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:34,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:34,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:34,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:34,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:34,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:34,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:34,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:34,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:34,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:34,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:34,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:34,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:34,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:34,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:34,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:34,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:35,849 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:00:37,850 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:00:38,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:38,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:38,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:38,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:38,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:38,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:38,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:38,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:38,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:38,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:38,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:38,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:38,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:38,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:38,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:38,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:00:41,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:00:41,552 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:00:41,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:00:43,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:00:46,448 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:00:47,854 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:00:49,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:00:51,856 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:00:53,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:00:56,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:00:56,787 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:00:57,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:00:59,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:01:01,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:01:03,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:01:05,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:01:07,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:01:09,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:01:11,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:01:12,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:01:12,121 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:01:13,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:01:15,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:01:16,525 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:01:17,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:01:19,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:01:21,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:01:23,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:01:25,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:01:27,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:01:27,348 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:01:27,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:01:29,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:01:31,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:01:33,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:01:35,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:01:37,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:01:39,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:01:41,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:01:42,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:01:42,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:01:42,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:01:42,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:01:43,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:01:43,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:01:43,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:01:43,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:01:43,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:01:43,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:01:43,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:01:43,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:01:43,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:01:43,256 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:01:43,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:01:46,603 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:01:51,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:01:55,883 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:01:58,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:01:58,867 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:02:01,885 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:02:06,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:02:08,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:02:10,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:10,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:10,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:10,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:10,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:10,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:10,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:10,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:10,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:10,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:10,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:10,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:10,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:10,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:10,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:10,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:12,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:02:14,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:02:14,090 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:02:14,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:14,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:14,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:14,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:14,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:14,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:14,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:14,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:14,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:14,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:14,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:14,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:14,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:14,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:14,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:14,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:14,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:14,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:14,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:14,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:14,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:14,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:14,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:14,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:14,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:14,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:14,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:14,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:14,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:14,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:14,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:14,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:15,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:15,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:15,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:15,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:15,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:15,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:15,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:15,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:15,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:15,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:15,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:15,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:15,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:15,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:15,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:15,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:16,679 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:02:16,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:02:17,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:17,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:17,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:17,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:17,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:17,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:17,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:17,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:17,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:17,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:17,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:17,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:17,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:17,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:17,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:17,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:19,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:19,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:19,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:19,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:19,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:19,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:19,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:19,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:19,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:19,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:19,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:19,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:19,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:19,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:19,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:19,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:20,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:02:20,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:20,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:20,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:20,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:20,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:20,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:20,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:20,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:20,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:20,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:20,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:20,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:20,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:20,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:20,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:20,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:21,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:02:22,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:22,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:23,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:23,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:23,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:23,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:23,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:23,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:23,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:23,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:23,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:23,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:23,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:23,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:23,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:23,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:23,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:23,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:24,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:26,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:02:27,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:27,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:28,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:28,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:28,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:28,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:02:29,367 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:02:29,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:29,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:30,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:30,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:30,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:30,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:30,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:30,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:30,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:30,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:30,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:30,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:30,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:30,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:30,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:30,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:30,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:30,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:30,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:30,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:30,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:30,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:30,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:30,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:30,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:30,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:30,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:02:30,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:30,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:30,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:30,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:30,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:30,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:30,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:30,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:32,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:32,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:32,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:32,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:32,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:32,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:32,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:32,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:32,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:32,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:32,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:32,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:32,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:32,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:32,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:32,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:32,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:32,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:32,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:32,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:32,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:32,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:32,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:32,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:32,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:32,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:32,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:32,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:32,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:32,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:32,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:32,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:32,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:02:35,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:35,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,901 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:02:36,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:36,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:38,902 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:02:40,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:02:41,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:41,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:41,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:41,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:41,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:41,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:41,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:41,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:41,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:41,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:41,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:41,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:41,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:41,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:41,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:41,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:42,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:42,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:42,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:42,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:42,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:42,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:42,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:42,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:42,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:42,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:42,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:42,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:42,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:42,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:42,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:42,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:02:44,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:02:44,616 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:02:44,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:02:46,757 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:02:46,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:02:48,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:02:52,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:02:54,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:02:56,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:02:58,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:02:59,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:02:59,843 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:03:00,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:03:02,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:03:06,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:03:08,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:03:10,916 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:03:12,916 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:03:14,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:03:15,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:03:15,122 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:03:16,833 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:03:16,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:03:18,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:03:20,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:03:22,921 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:03:24,922 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:03:26,922 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:03:28,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:03:30,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:03:30,412 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:03:30,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:03:32,925 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:03:34,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:03:36,927 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:03:38,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:03:40,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:03:40,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:03:40,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:03:40,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:03:40,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:03:40,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:03:40,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:03:40,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:03:40,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:03:40,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:03:40,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:03:40,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:03:40,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:03:41,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:03:41,235 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 12:03:41,448 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 12:03:41,513 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 12:03:41,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 12:03:41,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:03:42,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:03:45,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:03:45,771 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:03:46,926 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:03:54,960 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:03:58,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:04:01,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:04:01,004 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:04:02,964 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:04:07,967 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:04:11,968 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:04:15,970 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:04:16,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:04:16,226 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:04:17,003 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:04:19,972 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:04:21,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:21,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:21,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:21,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:21,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:21,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:21,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:21,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:21,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:21,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:21,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:21,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:21,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:21,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:21,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:21,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:21,973 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:04:23,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:23,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:23,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:23,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:23,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:23,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:23,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:23,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:23,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:23,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:23,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:23,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:23,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:23,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:23,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:23,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:24,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:24,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:24,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:24,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:24,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:24,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:24,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:24,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:24,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:24,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:24,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:24,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:24,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:24,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:24,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:24,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:25,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:25,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:25,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:25,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:25,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:25,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:25,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:25,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:25,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:25,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:25,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:25,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:25,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:25,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:25,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:25,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:25,975 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:04:26,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:26,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:27,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:28,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:28,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:28,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:28,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:28,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:28,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:28,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:28,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:28,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:28,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:28,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:28,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:28,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:28,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:28,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:28,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:29,976 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:04:31,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:31,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:04:31,462 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:04:31,977 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:04:32,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:32,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:32,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:32,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:32,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:32,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:32,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:32,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:32,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:32,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:32,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:32,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:32,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:32,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:32,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:32,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:33,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:33,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:33,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:33,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:33,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:33,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:33,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:33,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:33,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:33,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:33,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:33,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:33,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:33,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:33,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:33,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:34,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:34,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:34,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:34,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:34,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:34,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:34,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:34,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:34,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:34,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:34,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:34,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:34,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:34,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:34,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:34,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:35,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:35,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:35,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:35,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:35,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:35,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:35,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:35,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:35,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:35,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:35,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:35,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:35,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:35,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:35,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:35,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:35,979 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:04:37,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:37,980 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:04:38,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:38,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:38,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:38,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:38,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:38,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:38,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:38,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:38,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:38,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:38,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:38,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:38,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:38,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:38,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:38,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:38,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:38,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:38,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:38,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:38,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:38,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:38,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:38,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:38,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:38,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:38,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:38,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:38,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:38,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:38,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:38,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:39,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:39,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:39,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:39,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:39,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:39,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:39,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:39,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:39,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:39,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:39,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:39,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:39,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:39,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:39,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:39,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:39,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:39,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:39,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:39,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:39,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:39,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:39,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:39,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:39,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:39,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:39,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:39,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:39,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:39,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:39,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:39,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:40,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:41,982 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:04:43,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:43,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:43,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:43,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:43,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:43,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:43,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:43,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:43,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:43,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:43,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:43,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:43,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:43,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:43,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:43,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:43,983 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:04:44,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:44,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:44,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:44,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:44,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:44,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:44,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:44,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:44,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:44,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:44,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:44,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:44,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:44,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:44,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:44,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:45,984 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:04:46,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:46,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:46,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:46,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:46,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:46,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:46,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:46,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:46,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:46,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:46,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:46,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:46,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:46,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:46,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:46,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:46,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:04:46,844 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:04:47,079 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:04:48,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:48,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:48,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:48,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:48,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:48,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:48,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:48,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:48,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:48,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:48,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:48,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:48,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:48,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:48,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:48,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:49,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:49,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:49,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:49,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:49,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:49,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:49,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:49,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:49,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:49,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:49,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:49,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:49,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:49,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:49,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:49,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:04:49,986 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:04:51,986 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:04:53,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:04:55,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:04:57,989 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:05:01,991 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:05:02,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:05:02,064 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:05:03,992 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:05:05,993 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:05:07,994 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:05:09,995 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:05:11,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:05:13,997 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:05:15,998 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:05:17,156 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:05:17,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:05:17,288 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:05:17,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:05:20,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:05:22,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:05:24,001 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:05:26,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:05:28,003 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:05:30,004 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:05:32,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:05:32,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:05:32,575 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:05:34,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:05:36,007 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:05:38,008 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:05:40,009 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:05:41,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:05:41,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:05:41,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:05:41,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:05:41,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:05:41,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:05:41,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:05:41,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:05:41,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:05:41,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:05:41,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:05:41,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:05:42,009 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:05:44,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:05:47,232 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:05:47,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:05:47,874 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:05:54,014 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:06:00,017 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:06:03,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:06:03,100 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:06:04,019 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:06:08,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:06:12,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:06:16,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:06:17,309 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:06:18,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:06:18,383 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:06:20,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:06:24,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:06:26,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:06:27,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:27,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:27,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:27,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:27,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:27,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:27,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:27,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:27,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:27,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:27,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:27,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:27,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:27,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:27,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:27,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:30,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:06:30,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:30,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:30,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:30,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:30,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:30,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:30,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:30,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:30,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:30,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:30,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:30,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:30,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:30,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:30,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:30,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:31,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:31,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:31,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:31,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:31,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:31,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:31,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:31,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:31,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:31,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:31,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:31,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:31,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:31,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:31,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:31,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:31,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:31,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:31,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:31,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:31,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:31,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:31,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:31,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:31,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:31,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:31,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:31,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:31,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:31,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:31,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:31,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:32,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:06:32,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:32,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:32,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:32,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:32,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:32,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:32,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:32,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:32,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:32,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:32,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:32,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:32,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:32,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:32,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:32,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:06:33,680 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:06:33,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:33,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:35,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,032 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:06:36,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:36,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:38,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:06:39,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:39,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:39,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:39,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:39,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:39,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:39,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:39,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:39,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:39,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:39,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:39,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:39,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:39,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:39,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:39,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:40,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:40,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:40,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:40,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:40,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:40,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:40,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:40,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:40,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:40,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:40,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:40,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:40,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:40,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:40,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:40,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:41,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:42,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:06:42,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:42,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:42,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:42,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:42,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:42,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:42,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:42,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:42,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:42,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:42,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:42,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:42,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:42,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:42,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:42,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:43,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:43,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:43,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:43,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:43,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:43,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:43,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:43,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:43,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:43,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:43,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:43,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:43,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:43,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:43,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:43,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:06:44,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:44,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:45,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:45,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:45,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:45,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:45,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:45,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:45,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:45,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:45,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:45,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:45,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:45,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:45,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:45,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:45,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:45,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:46,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:47,387 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:06:48,038 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:06:48,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:48,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:48,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:48,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:48,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:48,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:48,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:48,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:48,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:48,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:48,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:48,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:48,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:48,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:48,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:48,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:48,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:48,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:48,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:48,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:48,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:48,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:48,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:48,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:48,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:48,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:48,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:48,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:48,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:48,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:48,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:48,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:49,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:06:49,019 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:06:50,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:50,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:50,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:50,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:50,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:50,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:50,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:50,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:50,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:50,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:50,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:50,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:50,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:50,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:50,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:50,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:51,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:06:52,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:52,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:52,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:52,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:52,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:52,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:52,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:52,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:52,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:52,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:52,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:52,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:52,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:52,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:52,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:52,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:52,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:52,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:52,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:52,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:52,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:52,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:52,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:52,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:52,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:52,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:52,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:52,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:52,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:52,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:52,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:52,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:06:53,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:53,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:54,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:54,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:54,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:54,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:54,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:54,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:54,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:54,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:54,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:54,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:54,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:54,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:54,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:54,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:54,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:54,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:06:57,042 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:06:59,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:07:00,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:07:00,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:07:00,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:07:00,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:07:00,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:07:00,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:07:00,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:07:00,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:07:00,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:07:00,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:07:00,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:07:00,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:07:00,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:07:00,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:07:00,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:07:00,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:07:01,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:07:03,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:07:04,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:07:04,249 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:07:05,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:07:07,047 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:07:09,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:07:11,049 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:07:15,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:07:17,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:07:17,462 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:07:19,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:07:19,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:07:19,590 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:07:21,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:07:23,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:07:25,056 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:07:27,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:07:29,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:07:31,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:07:33,059 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:07:34,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:07:34,815 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:07:35,060 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:07:37,061 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:07:39,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:07:41,063 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:07:43,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:07:44,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:07:44,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:07:44,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:07:44,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:07:44,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:07:44,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:07:44,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:07:44,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:07:44,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:07:44,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:07:44,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:07:44,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:07:44,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:07:44,715 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 12:07:44,955 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 12:07:45,030 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 12:07:45,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 12:07:45,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:07:46,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:07:47,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:07:47,551 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:07:50,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:07:50,084 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:07:57,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:08:01,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:08:05,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:08:05,671 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:08:07,074 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:08:11,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:08:15,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:08:17,628 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:08:19,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:08:20,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:08:20,969 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:08:21,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:08:25,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:08:29,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:08:33,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:08:35,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:08:36,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:08:36,211 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:08:38,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:38,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:38,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:38,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:38,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:38,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:38,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:38,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:38,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:38,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:38,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:38,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:38,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:38,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:38,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:38,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:08:39,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:39,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:40,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:40,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:40,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:40,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:40,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:40,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:40,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:40,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:40,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:40,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:40,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:40,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:40,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:40,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:40,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:40,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:42,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:08:42,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:42,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:42,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:42,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:42,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:42,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:42,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:42,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:42,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:42,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:42,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:42,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:42,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:42,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:42,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:42,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:44,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:44,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:44,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:44,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:44,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:44,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:44,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:44,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:44,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:44,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:44,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:44,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:44,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:44,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:44,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:44,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:44,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:44,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:44,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:44,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:44,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:44,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:44,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:44,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:44,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:44,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:44,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:44,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:44,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:44,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:44,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:44,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:45,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:46,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:08:46,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:46,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:46,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:46,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:46,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:46,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:46,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:46,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:46,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:46,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:46,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:46,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:46,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:46,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:46,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:46,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:47,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:47,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:47,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:47,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:47,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:47,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:47,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:47,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:47,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:47,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:47,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:47,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:47,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:47,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:47,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:47,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:47,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:47,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:47,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:47,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:47,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:47,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:47,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:47,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:47,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:47,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:47,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:47,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:47,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:47,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:47,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:47,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:47,704 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:08:48,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:08:48,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:48,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:49,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:49,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:49,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:49,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:49,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:49,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:49,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:49,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:49,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:49,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:49,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:49,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:49,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:49,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:49,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:49,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:49,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:49,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:50,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:50,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:50,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:50,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:50,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:50,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:50,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:50,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:50,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:50,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:50,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:50,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:50,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:50,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:51,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:51,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:51,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:51,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:51,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:51,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:51,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:51,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:51,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:51,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:51,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:51,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:51,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:51,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:51,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:51,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:51,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:51,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:51,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:51,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:51,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:51,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:51,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:51,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:51,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:51,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:51,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:51,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:51,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:51,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:51,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:51,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:51,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:08:51,484 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:08:52,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:08:52,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:52,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:53,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:53,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:53,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:53,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:53,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:53,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:53,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:53,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:53,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:53,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:53,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:53,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:53,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:53,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:53,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:53,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:08:54,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:54,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:55,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:56,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:08:56,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:56,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:56,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:56,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:56,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:56,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:56,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:56,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:56,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:56,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:56,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:56,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:56,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:56,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:56,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:56,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:56,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:56,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:56,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:56,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:56,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:56,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:56,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:56,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:56,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:56,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:56,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:56,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:56,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:56,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:56,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:56,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:08:58,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:00,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:09:00,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:00,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:00,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:00,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:00,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:00,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:00,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:00,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:00,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:00,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:00,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:00,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:00,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:00,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:00,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:00,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:00,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:00,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:00,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:00,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:00,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:00,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:00,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:00,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:00,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:00,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:00,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:00,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:01,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:01,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:01,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:01,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:02,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:09:02,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:02,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:02,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:02,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:02,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:02,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:02,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:02,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:02,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:02,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:02,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:02,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:02,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:02,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:02,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:02,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:04,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:09:04,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:04,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:04,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:04,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:04,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:04,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:04,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:04,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:04,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:04,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:04,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:04,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:04,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:04,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:04,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:04,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:05,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:05,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:05,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:05,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:05,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:05,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:05,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:05,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:05,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:05,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:05,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:05,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:05,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:05,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:05,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:05,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:06,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:09:06,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:09:06,728 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:09:08,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:08,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:08,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:08,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:08,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:08,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:08,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:08,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:08,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:08,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:08,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:08,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:08,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:08,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:08,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:08,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:10,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:09:12,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:09:14,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:09:16,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:09:17,781 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:09:18,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:09:20,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:09:21,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:09:21,952 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:09:22,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:09:24,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:09:26,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:09:28,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:09:30,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:09:32,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:09:34,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:09:36,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:09:37,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:09:37,195 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:09:38,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:09:40,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:09:42,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:09:44,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:09:46,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:09:47,858 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:09:48,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:09:49,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:49,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:49,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:49,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:49,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:49,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:49,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:49,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:49,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:49,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:49,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:49,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:09:50,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:09:52,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:09:52,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:09:52,663 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:10:00,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:10:07,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:10:08,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:10:08,201 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:10:11,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:10:15,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:10:17,935 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:10:19,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:10:23,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:10:23,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:10:23,426 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:10:27,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:10:31,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:10:33,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:10:37,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:10:38,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:10:38,948 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:10:41,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:10:43,140 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:10:45,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:45,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:45,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:45,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:45,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:45,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:45,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:45,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:45,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:45,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:45,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:45,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:45,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:45,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:45,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:45,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:45,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:45,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:45,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:45,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:45,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:45,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:45,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:45,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:45,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:45,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:45,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:46,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:46,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:46,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:46,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:46,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:47,142 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:10:48,011 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:10:48,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:48,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:48,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:48,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:48,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:48,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:48,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:48,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:48,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:48,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:48,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:48,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:48,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:48,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:48,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:48,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:48,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:48,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:48,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:48,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:48,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:48,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:48,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:48,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:48,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:48,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:48,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:48,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:48,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:48,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:48,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:48,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:49,142 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:10:51,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:10:51,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:51,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:51,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:51,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:51,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:51,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:51,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:51,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:51,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:51,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:51,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:51,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:51,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:51,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:51,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:51,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:52,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:52,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:52,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:52,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:52,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:52,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:52,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:52,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:52,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:52,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:52,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:52,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:52,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:52,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:52,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:52,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:52,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:52,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:52,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:52,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:52,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:52,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:52,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:52,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:52,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:52,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:52,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:52,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:52,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:52,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:52,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:52,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:53,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:53,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:53,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:53,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:53,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:53,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:53,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:53,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:53,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:53,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:53,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:53,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:53,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:53,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:53,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:53,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:10:54,280 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:10:54,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:54,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:10:55,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:55,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:56,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:57,145 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:10:57,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:57,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:57,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:57,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:57,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:57,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:57,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:57,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:57,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:57,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:57,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:57,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:57,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:57,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:57,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:57,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,146 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:10:59,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:10:59,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:00,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:01,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:01,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:01,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:01,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:01,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:01,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:01,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:01,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:01,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:01,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:01,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:01,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:01,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:01,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:01,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:01,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:02,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:02,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:02,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:02,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:02,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:02,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:02,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:02,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:02,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:02,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:02,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:02,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:02,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:02,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:02,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:02,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:02,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:02,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:02,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:02,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:02,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:02,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:02,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:02,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:02,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:02,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:02,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:02,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:02,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:02,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:02,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:02,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:03,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:03,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:03,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:03,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:03,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:03,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:03,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:03,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:03,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:03,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:03,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:03,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:03,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:03,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:03,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:03,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:03,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:03,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:03,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:03,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:03,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:03,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:03,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:03,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:03,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:03,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:03,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:03,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:03,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:03,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:03,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:03,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:03,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:11:04,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:04,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:04,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:04,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:04,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:04,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:04,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:04,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:04,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:04,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:04,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:04,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:04,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:04,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:04,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:04,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:11:05,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:05,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:07,150 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:11:07,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:07,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:07,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:07,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:07,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:07,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:07,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:07,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:07,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:07,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:07,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:07,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:07,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:07,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:07,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:07,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:07,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:07,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:07,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:07,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:07,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:07,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:07,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:07,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:07,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:07,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:07,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:07,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:07,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:07,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:07,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:07,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:08,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:09,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:09,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:09,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:09,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:09,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:09,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:09,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:09,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:09,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:09,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:09,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:09,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:09,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:09,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:09,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:09,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:09,150 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:11:09,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:09,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:09,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:09,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:09,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:09,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:09,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:09,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:09,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:09,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:09,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:09,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:09,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:09,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:09,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:09,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:09,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:11:09,818 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:11:10,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:10,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:10,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:10,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:10,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:10,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:10,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:10,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:10,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:10,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:10,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:10,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:10,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:10,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:10,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:10,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:10,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:10,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:10,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:10,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:10,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:10,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:10,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:10,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:10,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:10,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:10,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:10,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:10,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:10,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:10,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:10,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:11,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:11:12,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:12,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:12,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:12,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:12,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:12,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:12,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:12,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:12,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:12,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:12,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:12,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:12,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:12,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:12,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:12,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:15,153 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:11:16,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:16,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:16,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:16,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:16,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:16,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:16,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:16,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:16,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:16,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:16,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:16,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:16,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:16,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:16,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:16,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:17,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:17,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:17,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:17,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:17,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:17,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:17,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:17,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:17,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:17,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:17,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:17,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:17,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:17,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:17,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:17,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:17,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:11:18,093 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:11:19,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:11:21,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:11:23,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:11:25,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:11:25,047 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:11:25,157 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:11:27,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:11:29,159 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:11:32,160 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:11:34,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:11:36,162 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:11:38,163 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:11:40,164 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:11:40,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:11:40,280 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:11:42,165 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:11:44,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:11:46,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:11:48,168 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:11:48,170 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:11:50,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:11:51,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:51,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:51,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:51,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:51,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:51,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:51,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:51,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:51,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:51,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:51,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:51,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:51,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:11:51,973 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 12:11:52,202 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:11:52,223 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 12:11:52,293 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 12:11:53,192 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 12:11:53,192 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:11:54,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:11:55,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:11:55,583 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:11:56,194 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:11:58,195 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:12:00,195 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:12:02,197 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:12:04,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:12:06,199 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:12:08,199 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:12:10,200 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:12:10,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:12:10,808 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:12:12,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:12:14,202 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:12:16,203 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:12:18,204 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:12:18,362 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:12:20,205 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:12:22,206 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:12:24,207 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:12:26,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:12:26,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:12:26,292 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:12:28,209 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:12:30,210 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:12:32,211 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:12:34,212 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:12:36,212 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:12:38,213 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:12:40,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:12:41,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:12:41,517 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:12:42,215 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:12:44,216 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:12:46,216 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:12:48,217 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:12:48,436 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:12:50,218 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:12:52,219 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:12:54,220 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:12:56,221 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:12:56,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:12:56,786 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:12:58,222 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:13:00,222 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:13:02,224 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:13:04,224 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:13:06,225 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:13:09,226 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:13:11,227 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:13:12,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:13:12,021 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:13:13,228 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:13:15,229 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:13:17,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:13:18,511 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:13:19,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:13:21,231 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:13:23,232 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:13:25,233 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:13:27,234 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:13:27,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:13:27,325 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:13:29,235 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:13:31,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:13:33,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:13:35,237 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:13:37,238 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:13:39,239 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:13:41,239 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:13:42,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:13:42,639 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:13:43,240 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:13:45,241 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:13:47,244 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:13:48,585 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:13:49,245 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:13:51,246 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:13:53,247 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:13:55,248 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:13:57,249 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:13:58,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:13:58,090 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:13:59,250 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:14:01,251 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:14:03,252 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:14:05,253 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:14:07,254 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:14:09,255 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:14:11,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:14:13,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:14:13,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:14:13,410 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:14:15,258 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:14:18,259 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:14:18,659 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:14:20,260 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:14:22,261 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:14:24,262 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:14:26,263 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:14:28,263 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:14:28,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:14:28,640 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:14:30,264 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:14:32,265 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:14:34,265 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:14:36,266 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:14:38,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:14:40,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:14:42,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:14:43,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:14:43,976 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:14:44,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:14:46,270 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:14:48,271 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:14:48,733 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:14:50,271 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:14:52,272 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:14:54,273 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:14:56,274 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:14:58,275 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:14:59,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:14:59,213 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:15:00,276 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:15:02,277 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:15:04,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:15:06,279 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:15:08,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:15:10,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:15:12,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:15:14,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:15:14,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:15:14,595 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:15:16,283 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:15:18,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:15:18,809 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:15:20,285 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:15:22,286 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:15:24,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:15:26,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:15:28,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:15:29,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:15:29,816 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:15:30,290 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:15:32,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:15:34,292 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:15:36,293 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:15:38,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:15:40,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:15:42,296 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:15:44,297 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:15:45,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:15:45,157 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:15:46,298 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:15:48,299 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:15:48,887 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:15:50,299 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:15:52,300 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:15:54,301 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:15:56,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:15:58,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:16:00,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:16:00,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:16:00,434 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:16:03,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:16:05,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:16:07,306 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:16:09,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:16:11,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:16:13,308 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:16:15,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:16:15,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:16:15,741 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:16:17,310 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:16:18,941 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:16:19,311 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:16:21,311 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:16:23,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:16:25,313 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:16:27,314 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:16:29,314 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:16:31,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:16:31,071 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:16:31,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:16:33,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:16:35,316 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:16:37,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:16:39,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:16:41,318 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:16:43,319 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:16:45,319 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:16:46,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:16:46,312 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:16:47,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:16:49,011 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:16:49,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:16:51,321 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:16:53,321 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:16:55,322 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:16:57,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:16:59,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:17:01,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:17:01,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:17:01,584 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:17:03,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:17:05,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:17:07,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:17:09,326 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:17:11,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:17:13,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:17:15,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:17:16,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:17:16,810 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:17:17,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:17:19,087 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:17:19,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:17:21,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:17:23,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:17:25,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:17:28,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:17:30,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:17:32,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:17:32,083 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:17:32,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:17:34,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:17:36,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:17:38,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:17:40,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:17:42,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:17:44,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:17:46,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:17:47,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:17:47,348 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:17:48,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:17:49,163 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:17:50,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:17:52,342 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:17:54,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:17:56,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:17:58,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:18:00,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:18:02,346 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:18:02,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:18:02,728 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:18:04,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:18:06,348 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:18:08,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:18:10,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:18:12,350 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:18:14,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:18:16,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:18:17,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:18:17,991 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:18:18,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:18:19,237 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:18:20,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:18:22,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:18:24,354 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:18:26,354 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:18:28,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:18:31,356 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:18:33,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:18:33,217 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:18:33,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:18:35,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:18:37,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:18:39,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:18:41,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:18:43,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:18:45,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:18:47,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:18:48,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:18:48,438 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:18:49,313 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:18:49,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:18:51,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:18:53,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:18:55,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:18:57,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:18:59,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:19:01,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:19:03,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:19:03,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:19:03,738 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:19:05,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:19:07,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:19:09,371 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:19:11,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:19:13,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:19:15,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:19:17,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:19:18,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:19:18,991 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:19:19,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:19:19,387 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:19:21,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:19:23,376 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:19:25,377 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:19:27,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:19:29,379 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:19:31,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:19:33,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:19:34,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:19:34,313 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:19:35,381 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:19:37,382 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:19:39,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:19:41,384 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:19:43,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:19:45,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:19:47,386 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:19:49,387 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:19:49,461 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:19:49,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:19:49,620 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:19:51,388 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:19:53,389 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:19:56,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:19:58,391 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:20:00,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:20:02,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:20:04,393 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:20:05,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:20:05,123 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:20:06,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:20:08,395 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:20:10,396 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:20:12,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:20:14,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:20:16,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:20:18,399 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:20:19,537 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:20:20,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:20:20,378 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:20:20,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:20:22,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:20:24,402 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:20:26,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:20:28,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:20:30,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:20:32,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:20:34,406 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:20:35,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:20:35,604 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:20:36,407 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:20:38,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:20:40,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:20:42,409 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:20:44,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:20:46,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:20:48,411 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:20:49,612 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:20:50,412 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:20:50,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:20:50,890 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:20:52,413 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:20:54,414 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:20:56,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:20:58,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:21:00,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:21:02,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:21:04,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:21:06,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:21:06,171 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:21:06,419 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:21:08,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:21:10,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:21:12,421 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:21:15,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:21:17,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:21:19,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:21:19,686 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:21:21,425 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:21:21,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:21:21,643 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:21:23,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:21:25,427 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:21:27,428 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:21:29,429 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:21:31,430 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:21:33,431 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:21:35,432 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:21:36,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:21:36,880 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:21:37,432 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:21:39,433 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:21:41,434 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:21:43,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:21:45,436 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:21:47,437 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:21:49,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:21:49,758 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:21:51,439 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:21:52,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:21:52,164 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:21:53,440 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:21:55,441 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:21:57,442 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:21:59,443 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:22:01,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:22:03,445 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:22:05,446 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:22:07,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:22:07,379 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:22:07,447 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:22:09,448 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:22:11,448 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:22:13,449 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:22:15,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:22:17,451 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:22:19,452 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:22:19,834 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:22:21,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:22:22,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:22:22,693 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:22:23,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:22:25,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:22:27,455 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:22:30,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:22:32,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:22:34,458 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:22:36,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:22:38,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:22:38,077 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:22:38,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:22:40,460 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:22:42,461 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:22:44,462 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:22:46,463 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:22:48,463 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:22:49,909 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:22:50,464 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:22:52,465 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:22:53,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:22:53,390 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:22:54,466 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:22:56,467 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:22:58,468 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:23:00,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:23:02,470 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:23:04,470 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:23:06,471 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:23:08,472 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:23:08,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:23:08,684 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:23:10,473 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:23:12,474 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:23:14,475 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:23:16,476 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:23:18,477 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:23:19,984 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:23:20,478 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:23:22,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:23:23,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:23:23,907 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:23:24,480 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:23:26,481 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:23:28,482 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:23:30,483 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:23:32,483 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:23:34,484 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:23:36,485 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:23:38,486 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:23:39,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:23:39,352 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:23:40,487 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:23:42,488 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:23:44,489 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:23:46,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:23:48,491 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:23:50,061 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:23:50,491 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:23:52,492 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:23:54,493 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:23:54,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:23:54,576 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:23:56,494 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:23:58,495 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:24:00,496 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:24:02,497 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:24:04,498 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:24:07,499 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:24:09,500 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:24:09,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:24:09,931 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:24:11,501 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:24:13,501 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:24:15,502 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:24:17,503 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:24:19,503 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:24:20,136 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:24:21,504 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:24:23,505 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:24:25,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:24:25,207 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:24:25,506 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:24:27,507 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:24:29,508 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:24:31,509 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:24:33,510 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:24:35,511 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:24:37,512 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:24:39,513 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:24:40,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:24:40,445 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:24:41,514 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:24:43,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:24:45,516 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:24:47,516 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:24:49,517 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:24:50,210 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:24:51,518 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:24:53,519 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:24:55,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:24:55,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:24:55,670 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:24:57,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:24:59,521 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:25:01,522 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:25:03,523 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:25:05,524 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:25:07,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:25:09,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:25:10,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:25:10,986 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:25:11,526 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:25:14,527 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:25:16,528 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:25:18,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:25:20,289 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:25:20,530 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:25:22,530 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:25:24,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:25:26,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:25:26,256 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:25:26,532 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:25:28,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:25:30,534 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:25:32,535 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:25:34,536 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:25:36,536 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:25:38,537 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:25:40,538 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:25:41,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:25:41,543 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:25:42,539 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:25:44,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:25:46,541 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:25:48,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:25:50,363 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:25:50,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:25:52,543 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:25:54,544 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:25:56,545 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:25:56,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:25:56,827 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:25:58,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:26:00,547 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:26:02,547 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:26:04,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:26:06,549 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:26:08,550 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:26:10,551 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:26:12,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:26:12,131 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:26:12,552 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:26:14,552 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:26:16,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:26:18,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:26:20,438 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:26:20,555 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:26:22,556 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:26:24,557 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:26:26,558 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:26:27,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:26:27,456 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:26:28,559 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:26:30,559 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:26:32,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:26:34,561 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:26:37,562 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:26:39,563 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:26:41,564 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:26:42,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:26:42,746 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:26:43,565 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:26:45,565 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:26:47,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:26:49,567 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:26:50,513 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:26:51,568 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:26:53,568 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:26:55,569 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:26:57,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:26:57,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:26:57,983 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:26:59,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:27:01,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:27:03,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:27:05,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:27:07,574 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:27:09,574 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:27:11,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:27:13,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:27:13,266 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:27:13,576 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:27:15,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:27:17,578 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:27:19,578 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:27:20,589 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:27:21,579 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:27:23,580 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:27:25,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:27:27,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:27:28,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:27:28,488 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:27:29,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:27:32,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:27:34,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:27:36,585 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:27:38,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:27:40,587 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:27:42,588 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:27:43,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:27:43,959 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:27:44,589 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:27:46,589 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:27:48,590 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:27:50,591 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:27:50,662 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:27:52,592 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:27:54,592 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:27:56,593 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:27:58,594 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:27:59,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:27:59,368 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:28:00,595 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:28:02,595 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:28:04,596 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:28:06,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:28:08,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:28:10,598 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:28:12,599 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:28:14,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:28:14,591 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:28:14,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:28:16,601 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:28:18,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:28:20,603 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:28:20,736 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:28:22,603 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:28:25,605 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:28:27,606 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:28:29,606 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:28:29,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:28:29,977 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:28:31,607 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:28:33,608 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:28:35,609 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:28:37,610 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:28:39,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:28:41,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:28:43,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:28:45,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:28:45,342 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:28:45,613 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:28:47,614 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:28:49,615 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:28:50,806 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:28:51,615 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:28:53,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:28:55,617 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:28:57,617 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:28:59,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:29:00,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:29:00,568 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:29:01,619 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:29:03,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:29:05,621 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:29:07,622 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:29:09,622 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:29:11,623 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:29:13,624 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:29:15,624 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:29:15,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:29:15,861 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:29:17,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:29:19,626 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:29:20,878 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:29:21,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:29:23,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:29:25,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:29:27,629 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:29:29,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:29:31,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:29:31,092 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:29:31,631 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:29:33,631 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:29:36,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:29:38,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:29:40,634 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:29:42,635 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:29:44,636 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:29:46,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:29:46,308 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:29:46,636 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:29:48,637 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:29:50,638 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:29:50,955 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:29:52,639 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:29:54,639 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:29:56,640 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:29:58,641 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:30:00,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:30:01,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:30:01,663 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:30:02,643 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:30:04,644 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:30:06,645 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:30:08,645 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:30:10,646 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:30:12,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:30:14,648 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:30:16,649 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:30:16,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:30:16,936 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:30:18,649 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:30:20,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:30:21,031 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:30:22,651 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:30:24,652 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:30:26,653 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:30:28,654 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:30:30,654 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:30:32,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:30:32,202 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:30:32,655 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:30:34,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:30:36,657 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:30:38,657 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:30:40,658 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:30:42,659 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:30:44,660 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:30:46,660 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:30:47,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:30:47,425 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:30:48,661 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:30:50,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:30:51,107 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:30:53,663 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:30:55,664 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:30:57,665 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:30:59,666 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:31:01,667 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:31:02,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:31:02,788 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:31:03,668 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:31:05,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:31:07,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:31:09,670 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:31:11,671 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:31:13,672 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:31:15,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:31:17,674 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:31:18,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:31:18,096 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:31:19,675 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:31:21,182 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:31:21,675 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:31:23,676 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:31:25,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:31:27,678 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:31:29,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:31:31,680 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:31:33,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:31:33,446 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:31:33,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:31:35,682 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:31:37,683 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:31:39,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:31:41,685 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:31:43,685 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:31:45,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:31:47,687 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:31:48,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:31:48,676 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:31:49,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:31:51,258 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:31:51,689 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:31:53,689 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:31:55,690 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:31:57,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:31:59,692 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:32:01,693 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:32:03,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:32:04,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:32:04,004 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:32:05,695 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:32:07,696 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:32:09,696 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:32:12,698 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:32:14,698 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:32:16,699 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:32:18,700 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:32:19,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:32:19,380 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:32:20,701 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:32:21,333 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:32:22,702 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:32:24,702 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:32:26,703 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:32:28,704 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:32:30,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:32:32,706 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:32:34,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:32:34,601 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:32:34,706 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:32:36,707 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:32:38,708 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:32:40,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:32:42,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:32:44,710 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:32:46,711 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:32:48,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:32:49,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:32:49,993 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:32:50,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:32:51,405 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:32:52,713 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:32:54,714 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:32:56,715 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:32:58,716 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:33:00,716 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:33:02,717 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:33:04,718 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:33:05,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:33:05,250 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:33:07,719 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:33:09,720 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:33:11,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:33:13,722 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:33:15,723 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:33:17,724 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:33:19,725 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:33:20,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:33:20,478 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:33:21,480 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:33:21,726 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:33:23,727 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:33:25,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:33:27,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:33:29,729 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:33:31,730 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:33:33,731 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:33:35,732 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:33:35,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:33:35,761 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:33:37,733 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:33:39,734 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:33:41,735 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:33:43,736 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:33:45,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:33:47,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:33:49,738 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:33:51,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:33:51,084 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:33:51,553 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:33:51,739 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:33:53,740 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:33:55,741 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:33:57,742 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:33:59,742 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:34:01,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:34:03,744 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:34:05,745 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:34:06,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:34:06,312 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:34:07,745 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:34:09,746 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:34:11,747 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:34:14,748 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:34:16,748 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:34:18,749 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:34:20,750 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:34:21,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:34:21,545 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:34:21,766 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:34:22,751 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:34:24,752 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:34:26,753 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:34:28,753 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:34:30,754 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:34:32,755 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:34:34,756 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:34:36,757 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:34:36,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:34:36,831 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:34:38,757 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:34:40,758 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:34:42,758 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:34:44,759 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:34:46,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:34:48,761 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:34:50,761 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:34:51,699 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:34:52,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:34:52,134 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:34:52,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:34:54,763 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:34:56,764 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:34:59,765 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:35:01,766 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:35:03,767 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:35:05,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:35:07,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:35:07,362 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:35:07,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:35:09,769 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:35:11,770 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:35:13,771 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:35:15,772 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:35:17,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:35:19,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:35:21,773 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:35:21,775 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:35:22,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:35:22,584 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:35:23,776 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:35:25,777 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:35:27,777 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:35:29,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:35:31,779 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:35:33,780 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:35:35,781 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:35:37,782 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:35:37,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:35:37,871 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:35:39,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:35:41,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:35:43,785 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:35:45,786 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:35:47,787 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:35:49,788 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:35:51,788 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:35:51,849 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:35:53,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:35:53,200 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:35:54,790 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:35:56,791 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:35:58,792 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:36:00,793 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:36:02,794 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:36:04,795 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:36:06,796 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:36:08,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:36:08,590 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:36:08,797 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:36:10,798 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:36:12,799 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:36:14,800 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:36:16,800 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:36:18,801 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:36:20,802 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:36:21,929 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:36:22,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:36:23,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:36:23,812 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:36:24,804 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:36:26,805 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:36:28,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:36:30,807 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:36:32,808 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:36:34,809 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:36:36,810 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:36:38,811 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:36:39,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:36:39,120 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:36:40,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:36:42,813 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:36:44,814 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:36:46,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:36:48,816 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:36:50,817 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:36:52,006 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:36:53,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:36:54,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:36:54,412 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:36:55,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:36:57,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:36:59,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:37:01,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:37:03,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:37:05,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:37:07,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:37:09,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:37:09,784 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:37:09,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:37:11,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:37:13,826 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:37:15,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:37:17,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:37:19,829 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:37:21,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:37:22,082 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:37:23,831 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:37:25,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:37:25,040 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:37:25,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:37:27,833 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:37:29,834 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:37:31,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:37:33,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:37:35,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:37:37,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:37:39,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:37:40,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:37:40,255 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:37:41,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:37:43,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:37:45,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:37:47,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:37:49,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:37:51,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:37:52,162 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:37:53,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:37:55,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:37:55,634 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:37:55,846 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:37:57,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:37:59,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:38:01,849 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:38:03,850 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:38:05,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:38:07,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:38:09,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:38:10,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:38:10,860 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:38:11,854 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:38:13,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:38:15,856 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:38:17,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:38:19,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:38:21,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:38:22,238 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:38:23,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:38:25,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:38:26,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:38:26,227 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:38:27,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:38:29,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:38:31,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:38:33,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:38:36,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:38:38,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:38:40,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:38:41,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:38:41,547 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:38:42,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:38:44,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:38:46,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:38:48,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:38:50,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:38:52,311 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:38:52,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:38:54,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:38:56,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:38:56,846 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:38:56,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:38:58,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:39:00,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:39:02,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:39:04,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:39:06,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:39:08,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:39:10,882 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:39:12,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:39:12,086 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:39:12,883 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:39:14,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:39:16,885 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:39:18,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:39:20,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:39:22,388 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:39:22,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:39:24,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:39:26,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:39:27,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:39:27,390 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:39:28,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:39:30,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:39:32,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:39:34,894 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:39:36,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:39:38,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:39:40,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:39:42,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:39:42,691 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:39:42,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:39:44,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:39:46,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:39:48,900 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:39:50,901 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:39:52,461 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:39:52,902 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:39:54,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:39:56,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:39:58,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:39:58,006 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:39:58,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:40:00,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:40:03,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:40:05,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:40:07,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:40:09,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:40:11,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:40:13,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:40:13,224 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:40:13,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:40:15,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:40:17,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:40:19,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:40:21,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:40:22,534 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:40:23,916 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:40:25,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:40:27,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:40:28,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:40:28,539 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:40:29,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:40:31,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:40:33,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:40:35,921 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:40:37,922 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:40:39,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:40:41,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:40:43,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:40:43,849 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:40:43,925 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:40:45,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:40:47,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:40:49,927 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:40:51,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:40:52,606 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:40:53,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:40:55,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:40:57,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:40:59,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:40:59,149 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:41:00,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:41:02,932 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:41:04,932 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:41:06,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:41:08,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:41:10,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:41:12,935 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:41:14,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:41:14,430 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:41:14,935 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:41:16,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:41:18,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:41:20,937 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:41:22,682 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:41:22,938 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:41:24,938 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:41:26,939 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:41:28,940 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:41:29,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:41:29,710 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:41:30,941 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:41:32,941 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:41:34,942 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:41:36,943 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:41:38,944 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:41:40,945 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:41:42,946 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:41:44,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:41:44,932 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:41:44,947 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:41:46,948 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:41:48,949 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:41:50,949 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:41:52,757 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:41:52,950 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:41:54,951 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:41:56,952 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:41:58,953 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:42:00,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:42:00,236 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:42:00,954 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:42:02,954 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:42:04,955 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:42:06,956 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:42:08,957 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:42:10,957 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:42:12,958 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:42:14,959 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:42:15,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:42:15,448 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:42:16,960 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:42:18,961 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:42:21,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:42:22,828 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:42:23,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:42:25,963 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:42:27,965 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:42:29,966 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:42:30,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:42:30,899 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:42:31,967 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:42:33,968 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:42:35,969 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:42:37,970 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:42:39,970 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:42:41,971 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:42:43,972 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:42:45,973 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:42:46,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:42:46,310 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:42:47,974 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:42:49,975 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:42:51,976 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:42:52,901 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:42:53,976 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:42:55,977 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:42:57,978 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:42:59,979 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:43:01,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:43:01,652 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:43:01,980 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:43:03,980 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:43:05,981 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:43:07,982 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:43:09,983 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:43:11,984 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:43:13,984 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:43:15,985 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:43:16,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:43:16,968 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:43:17,986 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:43:19,987 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:43:21,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:43:22,972 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:43:23,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:43:25,989 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:43:27,990 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:43:29,991 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:43:31,991 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:43:32,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:43:32,256 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:43:33,992 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:43:35,993 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:43:38,994 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:43:40,995 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:43:42,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:43:44,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:43:46,997 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:43:47,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:43:47,640 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:43:48,998 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:43:50,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:43:53,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:43:53,044 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:43:55,001 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:43:57,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:43:59,003 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:44:01,004 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:44:02,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:44:02,947 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:44:03,004 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:44:05,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:44:07,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:44:09,007 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:44:11,008 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:44:13,009 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:44:15,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:44:17,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:44:18,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:44:18,255 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:44:19,012 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:44:21,013 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:44:23,014 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:44:23,119 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:44:25,015 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:44:27,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:44:29,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:44:31,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:44:33,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:44:33,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:44:33,646 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:44:35,019 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:44:37,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:44:39,021 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:44:41,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:44:43,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:44:45,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:44:47,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:44:48,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:44:48,997 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:44:49,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:44:51,025 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:44:53,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:44:53,193 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:44:56,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:44:58,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:45:00,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:45:02,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:45:04,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:45:04,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:45:04,248 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:45:06,031 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:45:08,032 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:45:10,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:45:12,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:45:14,034 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:45:16,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:45:18,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:45:19,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:45:19,519 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:45:20,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:45:22,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:45:23,267 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:45:24,038 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:45:26,039 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:45:28,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:45:30,041 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:45:32,042 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:45:34,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:45:34,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:45:34,862 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:45:36,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:45:38,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:45:40,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:45:42,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:45:44,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:45:46,047 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:45:48,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:45:50,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:45:50,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:45:50,095 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:45:52,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:45:53,342 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:45:54,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:45:56,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:45:58,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:46:00,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:46:02,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:46:04,056 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:46:05,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:46:05,323 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:46:06,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:46:08,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:46:10,059 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:46:12,060 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:46:14,061 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:46:16,061 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:46:18,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:46:20,063 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:46:21,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:46:21,748 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:46:22,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:46:23,417 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:46:24,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:46:26,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:46:28,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:46:30,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:46:33,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:46:35,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:46:36,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:46:36,970 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:46:37,071 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:46:39,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:46:41,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:46:43,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:46:45,074 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:46:47,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:46:49,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:46:51,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:46:52,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:46:52,191 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:46:53,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:46:53,495 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:46:55,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:46:57,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:46:59,081 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:47:01,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:47:03,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:47:05,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:47:07,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:47:07,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:47:07,555 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:47:09,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:47:11,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:47:13,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:47:15,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:47:17,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:47:19,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:47:21,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:47:22,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:47:22,839 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:47:23,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:47:23,570 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:47:25,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:47:27,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:47:29,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:47:31,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:47:33,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:47:35,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:47:37,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:47:38,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:47:38,062 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:47:39,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:47:41,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:47:43,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:47:45,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:47:47,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:47:49,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:47:51,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:47:53,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:47:53,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:47:53,411 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:47:53,666 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:47:55,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:47:57,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:47:59,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:48:01,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:48:03,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:48:05,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:48:07,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:48:08,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:48:08,723 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:48:10,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:48:12,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:48:14,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:48:16,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:48:18,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:48:20,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:48:22,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:48:23,719 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:48:23,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:48:23,951 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:48:24,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:48:26,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:48:28,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:48:30,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:48:32,121 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:48:34,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:48:36,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:48:38,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:48:39,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:48:39,322 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:48:40,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:48:42,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:48:44,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:48:46,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:48:48,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:48:50,128 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:48:52,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:48:53,794 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:48:54,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:48:54,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:48:54,606 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:48:56,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:48:58,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:49:00,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:49:02,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:49:04,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:49:06,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:49:08,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:49:09,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:49:09,948 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:49:10,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:49:12,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:49:14,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:49:16,140 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:49:18,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:49:20,142 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:49:22,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:49:23,878 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:49:24,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:49:25,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:49:25,215 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:49:26,145 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:49:28,145 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:49:31,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:49:33,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:49:35,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:49:37,150 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:49:39,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:49:40,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:49:40,503 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:49:41,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:49:43,152 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:49:45,153 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:49:47,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:49:49,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:49:51,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:49:53,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:49:53,954 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:49:55,157 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:49:55,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:49:55,817 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:49:57,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:49:59,159 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:50:01,160 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:50:03,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:50:05,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:50:07,162 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:50:09,163 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:50:11,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:50:11,041 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:50:11,164 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:50:13,165 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:50:15,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:50:17,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:50:19,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:50:21,168 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:50:23,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:50:24,028 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:50:25,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:50:26,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:50:26,328 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:50:27,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:50:29,172 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:50:31,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:50:33,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:50:36,175 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:50:38,176 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:50:40,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:50:41,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:50:41,675 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:50:42,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:50:44,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:50:46,179 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:50:48,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:50:50,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:50:52,182 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:50:54,103 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:50:54,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:50:56,184 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:50:57,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:50:57,054 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:50:58,185 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:51:00,186 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:51:02,187 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:51:04,188 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:51:06,189 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:51:08,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:51:10,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:51:12,191 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:51:12,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:51:12,277 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:51:14,192 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:51:16,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:51:18,194 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:51:20,195 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:51:22,196 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:51:24,180 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:51:24,197 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:51:26,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:51:27,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:51:27,545 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:51:28,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:51:30,199 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:51:32,200 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:51:34,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:51:36,202 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:51:38,202 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:51:40,203 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:51:42,204 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:51:42,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:51:42,863 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:51:44,205 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:51:46,205 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:51:48,206 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:51:50,207 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:51:53,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:51:54,254 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:51:55,209 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:51:57,210 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:51:58,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:51:58,091 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:51:59,211 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:52:01,212 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:52:03,213 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:52:05,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:52:07,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:52:09,215 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:52:11,216 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:52:13,217 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:52:13,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:52:13,316 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:52:15,218 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:52:17,219 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:52:19,220 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:52:21,221 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:52:23,222 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:52:24,328 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:52:25,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:52:27,224 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:52:28,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:52:28,702 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:52:29,224 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:52:31,226 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:52:33,227 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:52:35,228 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:52:37,228 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:52:39,229 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:52:41,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:52:43,231 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:52:43,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:52:43,925 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:52:45,232 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:52:47,232 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:52:49,233 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:52:51,234 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:52:53,235 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:52:54,404 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:52:55,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:52:57,237 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:52:59,238 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:52:59,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:52:59,314 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:53:02,239 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:53:04,240 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:53:06,241 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:53:08,242 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:53:10,243 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:53:12,244 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:53:14,245 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:53:14,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:53:14,686 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:53:16,246 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:53:18,246 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:53:20,247 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:53:22,248 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:53:24,249 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:53:24,482 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:53:26,250 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:53:28,251 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:53:29,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:53:29,912 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:53:30,252 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:53:32,253 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:53:34,254 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:53:36,255 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:53:38,255 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:53:40,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:53:42,257 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:53:44,258 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:53:45,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:53:45,204 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:53:46,259 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:53:48,260 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:53:50,261 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:53:52,262 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:53:54,263 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:53:54,557 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:53:56,264 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:53:58,264 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:54:00,265 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:54:00,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:54:00,467 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:54:02,266 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:54:05,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:54:07,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:54:09,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:54:11,270 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:54:13,271 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:54:15,272 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:54:15,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:54:15,703 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:54:17,273 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:54:19,274 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:54:21,275 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:54:23,276 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:54:24,626 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:54:25,277 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:54:27,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:54:29,279 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:54:30,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:54:30,983 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:54:31,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:54:33,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:54:35,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:54:37,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:54:39,283 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:54:41,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:54:43,285 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:54:45,286 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:54:46,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:54:46,273 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:54:47,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:54:49,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:54:51,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:54:53,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:54:54,699 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:54:55,290 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:54:57,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:55:00,292 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:55:01,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:55:01,569 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:55:02,293 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:55:04,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:55:06,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:55:08,296 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:55:10,297 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:55:12,298 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:55:14,299 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:55:16,300 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:55:17,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:55:17,001 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:55:18,300 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:55:20,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:55:22,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:55:24,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:55:24,773 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:55:26,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:55:28,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:55:30,306 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:55:32,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:55:32,286 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:55:32,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:55:34,308 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:55:36,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:55:38,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:55:40,310 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:55:42,311 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:55:44,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:55:46,313 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:55:47,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:55:47,638 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:55:48,314 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:55:50,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:55:52,316 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:55:54,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:55:54,848 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:55:56,318 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:55:58,319 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:56:00,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:56:02,321 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:56:02,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:56:02,892 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:56:04,322 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:56:06,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:56:08,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:56:10,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:56:12,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:56:14,326 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:56:16,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:56:18,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:56:18,119 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:56:18,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:56:20,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:56:23,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:56:24,922 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:56:25,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:56:27,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:56:29,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:56:31,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:56:33,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:56:33,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:56:33,356 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:56:35,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:56:37,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:56:39,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:56:41,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:56:43,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:56:45,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:56:47,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:56:48,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:56:48,772 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:56:49,342 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:56:51,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:56:53,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:56:54,995 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:56:55,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:56:57,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:56:59,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:57:01,346 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:57:03,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:57:04,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:57:04,004 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:57:05,348 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:57:07,348 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:57:09,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:57:11,350 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:57:13,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:57:15,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:57:17,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:57:19,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:57:19,267 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:57:19,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:57:25,071 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:57:34,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:57:34,491 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:57:49,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:57:49,736 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:57:55,146 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:58:05,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:58:05,006 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:58:14,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 12:58:14,426 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 12:58:14,431 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 12:58:14,436 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 12:58:14,442 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 12:58:14,447 DEBUG SenderThread:1049978 [sender.py:send():232] send: metric 2022-05-23 12:58:14,453 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 12:58:14,500 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 12:58:14,578 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 12:58:15,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 12:58:15,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:58:16,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:58:20,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:58:20,320 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:58:24,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:58:25,229 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:58:26,379 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/config.yaml 2022-05-23 12:58:35,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:58:35,568 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:58:40,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:58:50,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:58:50,792 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:58:55,340 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:59:06,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:59:06,032 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:59:21,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:59:21,267 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:59:25,416 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:59:36,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:59:36,492 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:59:51,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 12:59:51,721 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 12:59:52,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 12:59:55,493 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 12:59:56,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:00:00,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:00:04,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:00:07,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:00:07,054 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:00:08,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:00:12,425 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:00:16,427 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:00:20,428 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:00:22,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:00:22,355 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:00:22,431 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:00:25,564 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:00:26,432 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:00:30,434 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:00:32,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:00:34,436 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:00:37,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:00:37,661 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:00:38,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:00:39,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:39,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:39,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:39,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:39,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:39,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:39,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:39,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:39,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:39,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:39,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:39,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:39,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:39,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:39,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:39,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:39,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:39,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:39,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:39,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:39,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:39,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:39,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:39,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:39,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:39,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:39,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:39,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:39,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:39,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:39,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:39,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:40,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:00:42,439 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:00:42,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:42,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:42,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:42,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:42,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:42,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:42,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:42,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:42,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:42,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:42,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:42,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:42,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:42,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:42,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:42,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:43,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:43,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:43,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:43,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:43,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:43,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:43,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:43,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:43,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:43,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:43,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:43,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:43,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:43,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:43,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:43,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:44,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:44,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:44,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:44,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:44,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:44,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:44,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:44,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:44,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:44,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:44,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:44,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:44,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:44,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:44,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:44,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:45,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:46,441 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:00:46,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:46,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:46,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:46,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:46,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:46,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:46,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:46,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:46,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:46,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:46,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:46,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:46,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:46,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:46,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:46,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:46,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:46,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:46,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:46,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:46,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:46,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:46,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:46,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:46,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:46,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:46,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:46,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:46,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:46,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:46,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:46,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:47,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:47,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:47,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:47,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:47,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:47,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:47,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:47,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:47,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:47,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:47,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:47,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:47,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:47,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:47,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:47,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:48,441 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:00:48,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:48,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:48,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:48,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:48,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:48,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:48,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:48,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:48,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:48,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:48,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:48,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:48,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:48,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:48,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:48,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:48,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:48,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:48,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:48,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:48,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:48,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:48,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:48,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:48,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:48,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:48,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:48,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:48,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:48,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:48,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:48,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:49,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:49,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:49,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:49,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:49,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:49,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:49,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:49,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:49,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:49,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:49,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:49,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:49,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:49,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:49,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:49,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:49,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:49,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:49,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:49,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:49,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:49,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:49,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:49,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:49,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:49,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:49,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:49,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:49,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:49,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:49,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:49,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:50,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:50,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:50,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:50,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:50,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:50,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:50,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:50,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:50,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:50,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:50,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:50,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:50,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:50,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:50,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:50,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:50,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:50,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:50,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:50,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:50,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:50,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:50,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:50,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:50,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:50,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:50,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:50,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:50,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:50,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:50,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:50,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:50,442 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:00:51,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:51,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:52,443 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:00:52,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:52,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:52,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:52,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:52,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:52,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:52,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:52,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:52,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:52,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:52,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:52,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:52,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:52,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:52,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:52,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:53,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:00:53,017 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:00:53,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:53,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:53,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:53,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:53,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:53,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:53,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:53,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:53,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:53,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:53,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:53,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:53,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:53,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:53,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:53,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:54,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:54,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:54,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:54,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:54,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:54,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:54,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:54,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:54,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:54,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:54,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:54,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:54,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:54,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:54,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:54,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:55,640 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:00:56,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:56,445 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:00:57,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:57,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,446 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:00:58,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:58,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:59,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:59,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:59,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:59,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:59,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:59,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:59,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:59,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:59,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:59,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:59,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:59,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:59,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:59,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:59,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:00:59,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,447 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:01:00,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:00,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:01,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:01,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:01,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:01,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:01,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:01,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:01,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:01,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:01,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:01,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:01,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:01,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:01,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:01,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:01,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:01,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,448 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:01:02,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:02,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:03,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:04,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:04,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:04,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:04,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:04,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:04,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:04,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:04,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:04,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:04,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:04,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:04,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:04,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:04,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:04,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:04,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:04,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:04,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:04,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:04,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:04,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:04,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:04,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:04,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:04,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:04,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:05,449 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:01:06,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:06,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:06,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:06,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:06,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:06,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:06,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:06,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:06,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:06,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:06,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:06,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:06,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:06,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:06,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:06,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:07,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:07,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:07,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:07,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:07,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:07,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:07,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:07,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:07,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:07,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:07,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:07,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:07,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:07,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:07,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:07,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:07,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:01:08,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:01:08,249 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:01:09,451 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:01:11,452 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:01:13,452 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:01:15,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:01:17,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:01:19,455 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:01:21,456 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:01:23,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:01:23,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:01:23,596 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:01:25,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:01:25,713 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:01:27,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:01:29,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:01:31,460 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:01:33,461 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:01:35,462 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:01:37,463 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:01:38,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:01:38,881 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:01:39,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:39,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:39,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:39,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:39,464 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:01:39,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:39,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:39,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:39,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:39,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:39,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:39,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:39,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:01:41,465 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:01:49,468 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:01:53,470 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:01:54,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:01:54,110 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:01:55,785 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:01:57,471 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:02:01,473 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:02:05,474 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:02:09,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:02:09,452 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:02:09,476 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:02:13,478 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:02:17,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:02:21,481 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:02:23,482 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:02:24,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:02:24,681 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:02:25,860 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:02:27,484 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:02:29,485 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:02:33,486 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:02:35,487 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:02:39,488 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:02:39,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:02:39,905 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:02:41,489 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:02:43,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:02:43,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:43,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:43,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:43,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:43,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:43,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:43,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:43,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:43,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:43,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:43,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:43,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:43,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:43,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:43,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:43,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:46,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:46,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:46,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:46,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:46,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:46,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:46,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:46,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:46,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:46,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:46,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:46,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:46,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:46,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:46,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:46,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,491 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:02:47,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:47,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:48,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:48,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:48,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:48,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:48,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:48,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:48,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:48,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:48,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:48,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:48,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:48,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:48,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:48,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:48,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:48,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:49,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:49,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:49,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:49,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:49,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:49,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:49,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:49,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:49,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:49,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:49,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:49,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:49,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:49,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:49,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:49,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:49,492 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:02:50,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:50,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:50,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:50,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:50,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:50,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:50,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:50,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:50,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:50,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:50,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:50,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:50,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:50,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:50,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:50,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:50,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:50,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:50,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:50,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:50,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:50,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:50,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:50,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:50,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:50,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:50,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:50,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:50,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:50,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:50,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:50,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:51,494 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:02:51,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:51,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:51,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:51,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:51,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:51,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:51,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:51,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:51,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:51,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:51,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:51,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:51,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:51,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:51,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:51,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:51,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:51,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:51,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:51,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:51,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:51,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:51,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:51,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:51,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:51,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:51,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:51,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:51,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:51,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:51,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:51,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:52,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:53,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:53,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:53,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:53,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:53,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:53,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:53,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:53,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:53,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:53,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:53,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:53,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:53,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:53,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:53,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:53,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:54,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:54,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:54,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:54,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:54,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:54,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:54,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:54,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:54,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:54,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:54,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:54,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:54,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:54,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:54,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:54,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:54,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:54,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:54,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:54,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:54,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:54,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:54,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:54,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:54,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:54,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:54,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:54,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:54,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:54,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:54,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:54,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:02:55,234 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:02:55,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,495 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:02:55,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:55,961 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:02:56,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:56,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:56,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:56,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:56,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:56,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:56,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:56,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:56,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:56,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:56,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:56,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:56,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:56,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:56,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:56,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:56,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:56,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:56,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:56,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:56,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:56,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:56,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:56,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:56,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:56,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:56,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:56,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:56,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:56,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:56,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:56,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:57,496 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:02:57,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:57,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:57,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:57,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:57,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:57,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:57,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:57,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:57,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:57,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:57,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:57,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:57,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:57,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:57,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:57,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:57,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:57,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:57,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:57,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:57,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:57,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:57,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:57,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:57,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:57,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:57,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:57,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:57,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:57,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:57,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:57,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:59,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:59,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:59,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:59,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:59,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:59,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:59,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:59,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:59,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:59,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:59,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:59,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:59,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:59,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:59,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:59,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:02:59,497 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:03:00,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:00,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:01,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:01,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:01,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:01,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:01,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:01,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:01,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:01,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:01,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:01,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:01,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:01,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:01,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:01,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:01,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:01,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:01,498 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:03:02,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:02,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:02,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:02,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:02,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:02,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:02,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:02,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:02,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:02,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:02,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:02,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:02,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:02,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:02,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:02,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:02,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:02,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:02,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:02,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:02,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:02,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:02,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:02,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:02,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:02,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:02,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:02,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:02,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:02,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:02,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:02,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:03,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:03,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:03,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:03,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:03,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:03,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:03,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:03,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:03,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:03,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:03,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:03,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:03,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:03,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:03,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:03,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:04,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:04,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:04,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:04,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:04,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:04,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:04,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:04,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:04,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:04,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:04,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:04,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:04,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:04,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:04,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:04,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:04,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:04,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:04,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:04,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:04,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:04,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:04,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:04,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:04,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:04,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:04,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:04,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:04,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:04,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:04,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:04,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:05,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:05,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:05,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:05,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:05,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:05,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:05,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:05,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:05,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:05,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:05,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:05,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:05,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:05,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:05,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:05,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:05,499 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:03:05,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:05,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:05,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:05,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:05,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:05,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:05,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:05,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:05,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:05,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:05,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:05,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:05,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:05,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:05,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:05,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:06,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:06,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:06,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:06,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:06,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:06,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:06,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:06,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:06,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:06,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:06,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:06,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:06,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:06,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:06,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:06,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,501 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:03:08,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:08,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:10,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:03:10,460 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:03:10,502 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:03:11,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:11,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:11,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:11,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:11,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:11,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:11,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:11,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:11,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:11,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:11,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:11,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:11,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:11,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:11,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:11,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:12,503 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:03:13,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:13,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:13,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:13,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:13,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:13,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:13,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:13,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:13,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:13,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:13,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:13,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:13,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:13,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:13,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:13,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:14,503 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:03:16,504 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:03:18,505 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:03:20,506 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:03:22,507 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:03:24,508 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:03:25,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:03:25,792 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:03:26,012 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:03:26,509 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:03:28,510 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:03:30,511 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:03:32,512 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:03:34,513 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:03:36,514 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:03:38,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:03:40,516 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:03:41,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:03:41,076 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:03:41,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:41,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:41,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:41,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:41,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:41,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:41,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:41,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:41,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:41,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:41,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:41,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:41,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:03:41,547 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 13:03:41,784 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 13:03:41,861 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 13:03:42,599 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 13:03:42,599 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:03:43,599 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:03:44,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:03:52,603 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:03:56,097 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:03:56,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:03:56,295 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:03:56,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:04:00,606 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:04:04,608 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:04:08,609 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:04:11,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:04:11,516 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:04:12,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:04:16,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:04:18,613 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:04:22,615 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:04:26,167 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:04:26,617 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:04:26,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:04:26,740 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:04:28,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:04:32,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:04:34,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:04:38,622 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:04:40,623 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:04:42,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:04:42,071 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:04:42,624 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:04:45,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:45,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:45,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:45,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:45,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:45,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:45,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:45,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:45,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:45,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:45,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:45,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:45,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:45,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:45,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:45,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:46,626 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:04:48,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:04:50,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:50,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:50,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:50,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:50,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:50,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:50,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:50,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:50,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:50,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:50,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:50,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:50,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:50,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:50,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:50,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:50,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:04:52,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:04:52,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:52,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:52,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:52,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:52,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:52,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:52,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:52,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:52,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:52,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:52,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:52,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:52,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:52,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:52,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:52,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:54,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:54,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:54,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:54,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:54,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:54,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:54,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:54,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:54,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:54,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:54,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:54,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:54,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:54,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:54,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:54,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:54,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:54,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:54,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:54,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:54,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:54,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:54,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:54,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:54,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:54,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:54,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:54,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:54,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:54,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:54,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:54,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:55,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,240 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:04:56,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:56,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:04:57,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:04:57,294 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:04:57,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:57,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:57,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:57,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:57,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:57,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:57,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:57,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:57,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:57,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:57,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:57,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:57,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:57,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:57,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:57,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,631 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:04:58,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:58,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:04:59,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,632 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:05:00,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:00,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:01,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:01,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:01,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:01,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:01,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:01,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:01,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:01,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:01,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:01,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:01,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:01,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:01,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:01,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:01,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:01,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:01,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:01,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:01,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:01,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:01,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:01,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:01,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:01,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:01,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:01,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:01,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:01,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:01,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:01,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:01,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:01,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:02,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:05:03,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:03,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:04,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:05:05,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:05,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:06,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:06,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:06,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:06,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:06,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:06,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:06,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:06,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:06,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:06,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:06,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:06,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:06,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:06,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:06,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:06,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:06,634 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:05:07,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:07,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:07,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:07,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:07,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:07,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:07,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:07,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:07,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:07,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:07,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:07,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:07,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:07,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:07,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:07,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:07,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:07,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:07,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:07,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:07,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:07,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:07,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:07,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:07,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:07,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:07,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:07,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:07,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:07,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:07,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:07,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:08,635 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:05:08,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:08,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:08,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:08,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:08,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:08,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:08,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:08,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:08,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:08,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:08,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:08,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:08,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:08,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:08,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:08,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:09,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:09,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:09,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:09,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:09,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:09,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:09,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:09,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:09,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:09,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:09,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:09,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:09,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:09,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:09,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:09,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:10,636 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:05:11,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:11,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:12,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:05:12,518 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:05:12,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:12,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:12,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:12,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:12,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:12,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:12,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:12,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:12,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:12,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:12,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:12,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:12,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:12,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:12,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:12,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:12,638 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:05:12,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:12,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:12,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:12,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:12,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:12,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:12,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:12,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:12,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:12,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:12,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:12,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:12,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:12,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:12,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:12,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:13,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:14,639 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:05:14,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:14,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:14,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:14,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:14,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:14,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:14,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:14,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:14,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:14,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:14,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:14,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:14,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:14,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:14,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:14,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:16,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:16,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:16,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:16,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:16,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:16,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:16,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:16,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:16,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:16,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:16,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:16,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:16,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:16,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:16,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:16,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:16,640 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:05:18,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:18,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:18,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:18,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:18,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:18,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:18,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:18,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:18,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:18,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:18,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:18,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:18,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:18,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:18,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:18,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:18,641 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:05:20,641 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:05:22,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:05:24,643 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:05:26,314 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:05:26,644 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:05:27,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:05:27,843 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:05:28,645 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:05:30,646 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:05:32,646 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:05:34,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:05:36,648 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:05:38,649 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:05:40,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:40,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:40,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:40,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:40,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:05:40,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:40,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:40,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:40,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:40,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:40,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:40,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:40,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:05:42,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:05:43,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:05:43,071 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:05:50,653 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:05:55,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:05:56,390 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:06:01,658 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:06:02,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:06:02,205 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:06:05,659 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:06:09,661 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:06:13,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:06:17,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:06:17,432 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:06:17,664 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:06:19,665 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:06:23,667 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:06:26,464 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:06:27,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:06:29,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:06:32,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:06:32,685 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:06:33,671 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:06:35,672 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:06:39,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:06:41,674 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:06:43,675 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:06:47,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:06:48,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:06:48,035 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:06:49,678 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:06:51,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:06:52,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:52,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:52,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:52,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:52,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:52,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:52,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:52,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:52,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:52,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:52,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:52,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:52,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:52,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:52,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:52,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:53,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:06:56,534 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:06:56,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:56,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:56,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:56,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:56,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:56,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:56,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:56,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:56,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:56,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:56,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:56,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:56,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:56,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:56,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:56,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:57,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:57,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:57,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:57,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:57,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:57,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:57,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:57,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:57,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:57,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:57,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:57,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:57,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:57,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:57,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:57,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:57,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:06:58,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:58,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:58,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:58,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:58,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:58,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:58,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:58,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:58,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:58,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:58,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:58,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:58,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:58,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:58,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:58,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:06:59,682 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:07:00,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:00,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:00,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:00,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:00,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:00,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:00,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:00,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:00,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:00,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:00,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:00,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:00,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:00,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:00,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:00,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:00,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:00,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:00,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:00,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:00,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:00,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:00,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:00,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:00,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:00,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:00,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:00,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:00,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:00,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:00,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:00,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,683 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:07:01,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:01,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:02,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:02,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:02,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:02,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:02,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:02,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:02,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:02,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:02,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:02,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:02,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:02,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:02,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:02,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:02,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:02,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:03,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:03,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:03,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:03,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:03,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:03,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:03,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:03,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:03,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:03,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:03,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:03,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:03,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:03,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:03,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:03,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:03,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:03,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:03,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:03,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:03,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:03,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:03,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:03,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:03,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:03,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:03,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:03,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:03,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:03,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:03,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:03,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:03,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:07:03,370 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:07:03,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:07:04,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:04,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:04,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:04,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:04,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:04,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:04,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:04,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:04,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:04,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:04,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:04,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:04,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:04,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:04,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:04,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:05,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:05,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:05,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:05,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:05,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:05,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:05,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:05,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:05,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:05,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:05,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:05,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:05,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:05,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:05,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:05,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:05,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:05,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:05,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:05,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:05,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:05,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:05,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:05,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:05,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:05,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:05,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:05,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:05,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:05,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:05,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:05,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:05,685 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:07:07,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:07,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:07:08,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:08,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:09,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:09,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:09,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:09,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:09,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:09,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:09,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:09,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:09,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:09,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:09,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:09,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:09,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:09,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:09,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:09,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:09,687 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:07:10,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:10,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:11,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:11,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:11,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:11,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:11,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:11,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:11,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:11,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:11,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:11,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:11,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:11,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:11,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:11,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:11,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:11,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:11,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:11,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:11,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:11,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:11,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:11,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:11,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:11,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:11,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:11,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:11,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:11,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:11,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:11,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:11,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:11,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:11,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:07:12,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:12,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:12,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:12,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:12,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:12,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:12,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:12,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:12,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:12,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:12,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:12,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:12,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:12,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:12,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:12,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:12,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:12,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:12,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:12,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:12,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:12,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:12,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:12,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:12,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:12,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:12,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:12,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:12,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:12,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:12,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:12,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:13,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:07:15,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:15,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:15,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:15,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:15,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:15,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:15,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:15,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:15,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:15,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:15,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:15,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:15,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:15,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:15,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:15,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:15,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:15,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:15,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:15,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:15,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:15,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:15,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:15,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:15,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:15,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:15,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:15,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:15,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:15,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:15,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:15,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:15,689 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:07:17,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,690 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:07:17,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:17,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:18,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:18,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:18,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:18,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:18,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:07:18,697 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:07:18,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:18,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:18,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:18,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:18,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:18,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:18,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:18,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:18,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:18,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:18,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:18,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:18,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:18,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:18,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:18,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:19,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:19,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:19,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:19,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:19,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:19,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:19,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:19,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:19,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:19,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:19,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:19,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:19,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:19,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:19,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:19,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:19,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:19,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:19,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:19,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:19,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:19,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:19,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:19,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:19,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:19,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:19,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:19,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:19,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:19,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:19,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:19,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:19,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:07:20,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:20,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:20,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:20,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:20,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:20,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:20,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:20,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:20,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:20,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:20,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:20,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:20,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:20,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:20,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:20,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:20,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:20,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:20,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:20,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:20,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:20,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:20,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:20,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:20,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:20,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:20,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:20,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:20,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:20,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:20,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:20,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:21,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:21,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:21,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:21,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:21,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:21,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:21,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:21,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:21,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:21,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:21,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:21,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:21,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:21,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:21,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:21,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:21,692 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:07:23,692 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:07:25,693 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:07:26,607 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:07:27,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:07:29,695 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:07:31,696 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:07:33,697 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:07:33,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:07:33,982 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:07:35,698 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:07:37,698 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:07:39,699 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:07:41,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:41,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:41,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:41,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:41,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:41,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:41,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:41,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:41,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:41,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:41,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:41,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:41,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:07:41,662 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 13:07:41,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:07:41,910 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 13:07:41,989 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 13:07:42,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 13:07:42,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:07:43,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:07:49,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:07:49,224 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:07:51,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:07:55,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:07:56,725 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:08:02,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:08:04,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:08:04,546 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:08:06,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:08:10,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:08:14,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:08:16,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:08:19,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:08:19,769 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:08:20,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:08:24,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:08:26,793 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:08:26,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:08:30,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:08:34,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:08:35,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:08:35,152 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:08:36,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:08:38,882 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:08:42,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:08:44,885 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:08:46,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:08:50,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:08:50,434 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:08:50,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:08:52,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:08:54,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:54,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:54,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:54,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:54,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:54,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:54,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:54,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:54,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:54,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:54,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:54,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:54,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:54,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:54,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:54,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:54,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:08:56,870 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:08:56,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:08:57,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:57,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:57,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:57,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:57,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:57,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:57,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:57,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:57,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:57,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:57,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:57,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:57,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:57,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:57,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:57,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:59,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:59,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:59,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:59,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:59,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:59,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:59,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:59,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:59,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:59,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:59,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:59,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:59,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:59,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:59,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:08:59,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:00,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:09:02,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:09:02,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:02,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:02,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:02,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:02,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:02,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:02,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:02,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:02,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:02,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:02,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:02,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:02,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:02,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:02,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:02,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:04,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:04,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:04,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:04,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:04,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:04,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:04,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:04,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:04,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:04,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:04,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:04,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:04,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:04,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:04,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:04,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:04,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:09:05,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:05,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:05,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:05,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:05,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:05,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:05,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:05,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:05,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:05,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:05,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:05,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:05,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:05,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:05,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:05,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:05,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:09:05,694 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:09:06,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:06,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:06,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:06,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:06,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:06,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:06,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:06,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:06,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:06,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:06,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:06,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:06,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:06,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:06,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:06,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:06,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:06,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:06,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:06,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:06,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:06,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:06,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:06,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:06,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:06,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:06,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:06,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:06,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:06,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:06,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:06,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:06,894 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:09:07,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:07,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:08,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:08,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:08,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:08,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:08,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:08,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:08,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:08,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:08,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:08,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:08,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:08,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:08,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:08,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:08,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:08,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:08,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:08,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:08,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:08,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:08,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:08,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:08,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:08,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:08,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:08,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:08,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:08,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:08,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:08,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:08,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:08,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:08,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:09:09,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:09,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:09,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:09,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:09,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:09,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:09,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:09,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:09,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:09,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:09,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:09,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:09,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:09,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:09,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:09,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:10,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:10,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:10,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:10,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:10,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:10,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:10,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:10,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:10,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:10,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:10,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:10,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:10,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:10,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:10,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:10,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:10,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:10,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:10,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:10,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:10,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:10,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:10,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:10,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:10,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:10,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:10,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:10,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:10,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:10,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:10,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:10,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:10,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:09:11,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:11,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:11,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:11,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:11,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:11,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:11,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:11,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:11,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:11,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:11,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:11,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:11,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:11,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:11,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:11,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:11,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:11,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:11,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:11,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:11,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:11,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:11,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:11,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:11,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:11,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:11,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:11,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:11,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:11,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:11,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:11,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:12,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:12,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:12,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:12,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:12,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:12,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:12,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:12,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:12,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:12,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:12,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:12,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:12,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:12,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:12,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:12,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:13,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:09:14,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:14,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:15,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:15,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:15,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:15,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:15,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:15,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:15,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:15,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:15,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:15,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:15,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:15,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:15,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:15,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:15,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:15,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:15,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:15,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:15,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:15,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:15,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:15,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:15,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:15,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:15,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:15,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:15,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:15,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:15,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:15,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:15,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:15,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:15,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:09:16,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:16,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:16,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:16,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:16,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:16,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:16,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:16,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:16,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:16,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:16,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:16,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:16,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:16,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:16,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:16,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:17,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:17,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:17,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:17,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:17,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:17,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:17,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:17,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:17,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:17,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:17,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:17,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:17,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:17,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:17,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:17,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:17,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:09:18,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:18,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:18,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:18,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:18,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:18,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:18,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:18,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:18,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:18,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:18,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:18,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:18,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:18,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:18,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:18,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:18,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:18,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:18,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:18,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:18,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:18,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:18,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:18,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:18,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:18,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:18,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:18,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:18,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:18,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:18,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:18,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:19,900 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:09:20,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:20,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:20,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:20,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:20,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:20,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:20,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:20,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:20,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:20,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:20,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:20,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:20,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:20,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:20,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:20,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:20,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:09:20,934 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:09:21,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:21,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:21,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:21,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:21,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:21,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:21,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:21,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:21,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:21,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:21,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:21,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:21,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:21,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:21,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:21,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:21,901 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:09:22,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:22,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:22,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:22,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:22,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:22,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:22,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:22,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:22,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:22,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:22,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:22,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:22,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:22,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:22,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:22,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:23,902 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:09:24,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:24,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:25,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:25,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:25,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:25,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:25,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:25,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:25,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:25,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:25,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:25,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:25,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:25,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:25,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:25,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:25,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:25,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:25,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:09:26,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:26,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:26,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:26,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:26,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:26,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:26,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:26,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:26,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:26,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:26,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:26,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:26,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:26,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:26,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:26,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:26,935 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:09:27,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:27,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:09:29,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:09:30,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:30,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:30,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:30,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:30,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:30,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:30,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:30,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:30,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:30,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:30,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:30,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:30,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:30,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:30,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:30,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:31,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:09:33,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:09:35,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:09:36,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:09:36,194 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:09:37,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:09:39,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:09:41,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:09:42,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:42,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:42,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:42,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:43,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:43,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:43,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:43,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:43,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:43,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:43,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:43,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:09:43,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:09:45,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:09:51,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:09:51,477 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:09:55,916 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:09:57,005 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:09:59,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:10:03,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:10:06,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:10:06,720 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:10:07,921 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:10:11,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:10:15,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:10:19,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:10:21,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:10:21,945 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:10:23,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:10:26,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:10:27,079 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:10:30,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:10:34,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:10:36,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:10:37,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:10:37,314 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:10:40,935 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:10:42,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:10:44,937 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:10:46,938 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:10:50,940 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:10:52,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:10:52,556 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:10:52,941 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:10:54,942 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:10:57,157 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:10:58,943 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:11:00,944 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:11:01,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:01,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:01,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:01,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:01,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:01,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:01,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:01,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:01,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:01,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:01,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:01,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:01,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:01,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:01,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:01,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:02,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:02,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:02,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:02,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:02,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:02,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:02,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:02,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:02,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:02,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:02,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:02,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:02,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:02,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:02,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:02,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:02,945 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:11:04,946 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:11:05,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:05,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:05,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:05,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:05,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:05,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:05,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:05,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:05,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:05,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:05,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:05,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:05,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:05,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:05,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:05,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:06,947 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:11:07,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:11:07,781 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:11:08,948 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:11:09,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:09,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:09,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:09,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:09,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:09,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:09,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:09,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:09,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:09,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:09,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:09,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:09,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:09,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:09,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:09,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:09,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:09,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:09,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:09,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:09,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:09,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:09,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:09,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:09,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:09,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:09,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:09,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:09,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:09,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:09,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:09,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:10,949 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:11:12,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:12,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:12,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:12,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:12,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:12,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:12,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:12,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:12,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:12,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:12,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:12,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:12,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:12,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:12,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:12,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:12,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:12,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:12,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:12,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:12,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:12,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:12,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:12,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:12,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:12,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:12,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:12,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:12,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:12,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:12,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:12,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:12,950 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:11:13,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:13,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:13,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:13,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:13,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:13,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:13,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:13,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:13,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:13,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:13,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:13,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:13,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:13,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:13,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:13,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:13,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:13,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:13,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:13,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:13,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:13,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:13,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:13,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:13,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:13,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:13,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:13,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:13,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:13,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:13,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:13,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,950 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:11:14,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:14,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:15,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:15,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:15,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:15,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:15,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:15,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:15,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:15,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:15,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:15,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:15,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:15,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:15,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:15,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:15,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:15,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:15,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:15,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:15,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:15,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:15,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:15,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:15,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:15,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:15,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:15,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:15,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:15,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:15,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:15,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:15,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:15,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,951 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:11:16,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:16,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:17,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:17,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:17,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:17,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:17,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:17,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:17,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:17,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:17,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:17,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:17,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:17,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:17,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:17,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:17,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:17,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:17,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:17,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:18,953 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:11:19,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:19,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:20,953 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:11:21,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:21,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:21,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:21,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:21,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:21,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:21,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:21,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:21,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:21,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:21,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:21,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:21,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:21,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:21,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:21,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:21,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:21,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:21,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:21,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:21,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:21,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:21,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:21,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:21,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:21,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:21,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:21,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:21,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:21,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:21,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:21,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:22,954 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:11:23,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:11:23,065 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:11:23,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:23,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:23,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:23,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:23,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:23,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:23,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:23,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:23,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:23,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:23,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:23,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:23,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:23,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:23,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:23,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:24,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:24,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:24,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:24,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:24,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:24,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:24,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:24,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:24,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:24,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:24,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:24,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:24,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:24,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:24,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:24,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:24,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:24,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:24,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:24,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:24,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:24,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:24,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:24,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:24,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:24,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:24,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:24,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:24,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:24,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:24,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:24,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:24,955 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:11:25,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:25,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:25,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:25,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:25,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:25,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:25,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:25,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:25,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:25,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:25,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:25,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:25,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:25,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:25,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:25,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:25,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:25,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:25,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:25,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:25,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:25,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:25,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:25,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:25,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:25,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:25,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:25,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:25,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:25,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:25,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:25,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:26,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:26,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:26,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:26,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:26,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:26,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:26,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:26,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:26,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:26,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:26,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:26,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:26,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:26,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:26,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:26,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:26,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:26,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:26,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:26,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:26,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:26,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:26,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:26,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:26,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:26,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:26,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:26,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:26,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:26,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:26,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:26,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:26,956 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:11:27,234 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:11:27,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:27,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:27,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:27,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:27,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:27,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:27,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:27,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:27,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:27,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:27,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:27,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:27,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:27,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:27,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:27,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:28,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:28,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:28,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:28,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:28,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:28,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:28,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:28,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:28,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:28,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:28,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:28,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:28,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:28,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:28,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:28,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:28,956 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:11:29,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:29,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:29,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:29,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:29,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:29,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:29,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:29,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:29,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:29,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:29,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:29,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:29,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:29,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:29,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:29,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:29,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:29,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:29,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:29,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:29,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:29,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:29,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:29,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:29,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:29,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:29,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:29,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:29,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:29,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:29,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:29,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:30,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:30,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:30,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:30,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:30,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:30,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:30,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:30,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:30,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:30,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:30,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:30,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:30,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:30,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:30,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:30,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:30,957 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:11:31,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:31,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:31,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:31,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:31,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:31,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:31,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:31,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:31,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:31,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:31,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:31,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:31,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:31,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:31,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:31,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:32,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:32,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:32,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:32,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:32,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:32,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:32,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:32,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:32,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:32,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:32,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:32,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:32,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:32,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:32,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:32,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:32,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:32,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:32,958 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:11:32,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:32,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:32,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:32,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:32,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:32,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:32,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:32,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:32,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:32,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:32,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:32,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:32,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:32,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:34,959 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:11:36,959 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:11:38,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:11:38,292 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:11:38,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:38,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:38,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:38,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:38,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:38,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:38,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:38,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:38,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:38,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:38,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:38,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:38,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:38,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:38,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:38,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:38,960 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:11:40,961 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:11:42,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:11:43,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:43,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:43,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:43,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:43,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:43,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:43,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:43,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:43,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:43,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:43,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:43,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:43,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:11:44,008 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 13:11:44,242 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 13:11:44,313 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 13:11:45,039 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 13:11:45,039 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:11:46,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:11:53,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:11:53,521 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:11:56,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:11:57,340 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:12:02,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:12:06,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:12:08,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:12:08,749 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:12:10,049 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:12:14,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:12:18,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:12:20,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:12:23,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:12:23,975 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:12:24,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:12:27,416 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:12:28,056 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:12:30,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:12:34,059 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:12:36,060 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:12:39,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:12:39,374 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:12:40,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:12:42,063 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:12:46,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:12:48,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:12:52,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:12:54,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:12:54,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:12:54,680 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:12:56,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:12:57,493 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:12:58,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:13:00,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:13:04,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:13:06,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:13:08,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:13:09,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:09,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:09,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:09,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:09,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:09,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:09,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:09,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:09,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:09,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:09,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:09,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:09,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:09,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:09,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:09,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:09,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:13:09,906 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:13:10,074 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:13:11,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:11,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:11,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:11,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:11,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:11,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:11,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:11,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:11,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:11,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:11,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:11,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:11,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:11,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:11,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:11,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:11,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:11,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:11,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:11,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:11,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:11,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:11,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:11,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:11,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:11,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:11,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:11,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:11,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:11,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:11,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:11,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:12,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:13:13,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:13,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:13,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:13,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:13,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:13,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:13,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:13,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:13,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:13,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:13,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:13,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:13,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:13,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:13,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:13,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:13,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:13,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:13,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:13,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:13,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:13,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:13,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:13,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:13,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:13,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:13,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:13,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:13,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:13,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:13,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:13,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:14,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:13:15,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:15,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:15,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:15,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:15,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:15,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:15,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:15,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:15,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:15,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:15,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:15,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:15,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:15,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:15,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:15,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:16,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:13:17,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:17,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:18,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:18,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:18,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:18,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:18,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:18,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:18,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:18,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:18,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:18,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:18,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:18,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:18,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:18,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:18,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:18,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:18,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:13:18,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:18,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:18,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:18,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:18,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:18,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:18,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:18,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:18,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:18,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:18,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:18,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:18,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:18,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:18,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:18,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:19,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:13:20,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:20,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:21,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:21,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:21,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:21,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:21,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:21,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:21,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:21,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:21,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:21,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:21,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:21,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:21,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:21,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:21,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:21,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:22,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:13:22,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:22,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:22,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:22,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:22,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:22,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:22,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:22,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:22,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:22,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:22,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:22,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:22,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:22,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:22,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:22,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:23,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:24,081 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:13:24,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:24,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:24,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:24,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:24,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:24,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:24,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:24,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:24,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:24,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:24,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:24,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:24,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:24,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:24,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:24,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:24,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:24,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:24,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:24,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:24,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:24,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:24,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:24,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:24,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:24,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:24,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:24,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:24,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:24,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:24,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:24,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:25,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:13:25,246 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:13:25,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:25,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:25,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:25,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:25,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:25,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:25,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:25,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:25,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:25,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:25,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:25,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:25,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:25,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:25,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:25,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:26,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:13:26,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:26,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:26,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:26,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:26,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:26,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:26,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:26,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:26,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:26,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:26,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:26,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:26,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:26,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:26,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:26,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:26,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:26,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:26,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:26,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:26,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:26,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:26,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:26,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:26,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:26,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:26,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:26,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:26,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:26,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:26,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:26,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,575 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:13:27,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:27,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:28,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:13:29,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:29,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:29,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:29,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:29,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:29,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:29,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:29,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:29,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:29,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:29,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:29,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:29,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:29,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:29,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:29,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:13:30,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:30,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:31,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:31,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:31,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:31,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:31,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:31,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:31,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:31,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:31,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:31,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:31,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:31,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:31,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:31,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:31,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:31,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:31,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:31,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:31,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:31,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:31,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:31,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:31,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:31,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:31,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:31,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:31,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:31,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:31,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:31,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:31,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:31,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:32,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:13:32,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:32,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:32,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:32,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:32,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:32,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:32,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:32,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:32,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:32,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:32,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:32,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:32,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:32,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:32,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:32,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:33,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:33,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:33,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:33,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:33,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:33,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:33,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:33,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:33,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:33,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:33,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:33,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:33,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:33,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:33,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:33,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:13:34,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:34,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:35,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:35,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:35,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:35,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:35,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:35,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:35,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:35,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:35,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:35,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:35,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:35,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:35,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:35,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:35,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:35,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:36,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:13:38,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:13:40,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:13:40,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:13:40,517 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:13:41,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:41,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:41,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:41,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:41,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:41,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:41,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:41,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:41,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:41,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:41,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:41,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:41,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:41,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:41,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:41,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:42,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:13:44,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:13:44,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:44,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:44,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:44,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:44,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:44,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:44,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:44,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:44,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:44,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:44,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:44,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:13:46,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:13:55,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:13:55,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:13:55,745 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:13:57,653 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:14:01,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:14:05,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:14:09,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:14:10,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:14:10,969 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:14:13,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:14:17,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:14:21,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:14:25,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:14:26,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:14:26,264 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:14:27,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:14:27,727 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:14:31,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:14:35,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:14:37,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:14:41,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:14:41,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:14:41,632 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:14:43,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:14:45,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:14:49,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:14:51,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:14:53,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:14:56,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:14:56,857 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:14:57,121 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:14:57,809 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:14:59,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:15:01,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:15:03,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:15:05,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:15:07,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:15:09,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:15:11,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:15:12,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:15:12,184 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:15:13,128 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:15:13,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:13,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:13,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:13,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:13,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:13,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:13,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:13,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:13,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:13,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:13,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:13,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:13,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:13,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:13,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:13,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:14,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:14,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:14,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:14,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:14,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:14,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:14,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:14,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:14,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:14,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:14,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:14,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:14,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:14,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:14,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:14,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:15,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:15:16,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:16,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:16,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:16,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:16,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:16,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:16,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:16,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:16,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:16,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:16,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:16,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:16,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:16,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:16,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:16,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:16,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:16,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:16,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:16,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:16,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:16,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:16,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:16,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:16,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:16,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:16,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:16,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:16,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:16,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:16,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:16,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:17,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:15:18,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:18,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:18,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:18,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:18,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:18,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:18,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:18,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:18,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:18,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:18,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:18,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:18,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:18,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:18,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:18,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:19,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:15:19,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:19,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:19,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:19,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:19,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:19,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:19,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:19,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:19,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:19,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:19,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:19,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:19,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:19,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:19,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:19,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:20,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:20,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:20,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:20,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:20,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:20,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:20,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:20,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:20,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:20,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:20,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:20,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:20,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:20,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:20,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:20,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:15:21,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:21,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:22,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:23,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:15:23,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:23,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:23,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:23,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:23,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:23,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:23,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:23,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:23,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:23,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:23,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:23,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:23,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:23,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:23,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:23,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:24,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:24,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:24,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:24,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:24,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:24,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:24,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:24,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:24,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:24,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:24,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:24,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:24,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:24,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:24,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:24,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:24,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:24,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:24,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:24,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:24,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:24,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:24,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:24,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:24,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:24,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:24,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:24,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:24,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:24,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:24,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:24,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:15:25,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:25,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:26,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:26,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:26,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:26,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:26,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:26,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:26,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:26,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:26,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:26,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:26,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:26,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:26,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:26,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:26,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:26,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:26,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:26,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:26,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:26,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:26,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:26,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:26,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:26,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:26,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:26,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:26,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:26,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:26,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:26,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:26,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:26,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:27,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:27,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:27,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:27,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:27,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:27,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:27,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:27,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:27,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:27,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:27,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:27,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:27,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:27,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:27,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:27,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:27,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:15:27,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:15:27,469 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:15:27,894 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:15:27,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:27,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:27,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:27,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:27,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:27,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:27,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:27,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:27,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:27,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:27,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:27,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:27,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:27,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:27,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:27,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:28,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:29,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:15:29,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:29,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:29,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:29,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:29,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:29,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:29,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:29,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:29,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:29,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:29,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:29,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:29,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:29,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:29,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:29,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:29,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:29,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:29,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:29,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:29,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:29,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:29,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:29,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:29,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:29,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:29,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:29,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:29,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:29,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:29,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:29,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:15:31,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:31,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:33,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:15:33,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:33,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:33,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:33,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:33,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:33,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:33,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:33,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:33,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:33,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:33,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:33,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:33,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:33,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:33,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:33,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:33,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:33,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:33,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:33,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:33,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:33,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:33,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:33,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:33,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:33,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:33,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:33,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:33,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:33,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:33,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:33,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:34,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:35,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:15:35,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:35,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:35,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:35,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:35,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:35,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:35,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:35,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:35,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:35,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:35,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:35,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:35,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:35,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:35,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:35,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:36,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:36,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:36,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:36,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:36,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:36,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:36,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:36,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:36,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:36,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:36,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:36,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:36,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:36,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:36,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:36,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:37,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:37,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:37,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:37,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:37,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:37,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:37,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:37,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:37,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:37,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:37,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:37,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:37,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:37,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:37,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:37,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:37,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:15:37,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:37,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:37,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:37,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:37,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:37,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:37,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:37,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:37,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:37,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:37,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:37,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:37,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:37,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:37,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:37,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:38,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:38,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:38,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:38,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:38,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:38,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:38,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:38,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:38,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:38,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:38,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:38,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:38,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:38,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:38,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:38,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:38,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:38,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:38,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:38,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:38,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:38,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:38,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:38,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:38,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:38,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:38,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:38,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:38,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:38,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:38,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:38,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:39,140 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:15:39,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:39,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:39,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:39,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:39,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:39,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:39,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:39,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:39,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:39,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:39,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:39,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:39,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:39,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:39,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:39,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:39,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:39,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:39,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:39,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:39,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:39,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:39,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:39,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:39,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:39,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:39,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:39,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:39,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:39,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:39,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:39,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:41,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:15:42,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:15:42,896 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:15:43,142 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:15:45,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:15:45,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:45,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:45,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:45,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:45,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:45,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:45,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:45,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:45,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:45,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:45,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:45,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:45,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:45,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:45,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:45,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:45,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:45,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:45,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:45,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:45,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:45,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:45,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:45,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:45,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:45,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:45,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:45,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:46,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:15:46,107 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 13:15:46,317 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 13:15:46,396 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 13:15:47,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 13:15:47,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:15:57,992 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:15:58,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:15:58,137 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:16:00,298 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:16:04,300 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:16:08,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:16:12,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:16:13,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:16:13,369 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:16:16,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:16:20,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:16:24,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:16:26,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:16:28,068 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:16:28,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:16:28,811 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:16:30,311 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:16:34,313 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:16:36,314 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:16:40,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:16:42,316 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:16:44,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:16:44,080 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:16:44,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:16:48,319 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:16:50,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:16:54,321 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:16:56,322 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:16:58,144 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:16:58,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:16:59,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:16:59,436 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:17:00,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:17:02,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:17:06,326 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:17:08,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:17:10,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:17:12,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:17:14,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:17:14,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:17:14,694 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:17:16,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:17:18,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:17:19,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:19,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:19,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:19,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:19,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:19,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:19,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:19,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:19,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:19,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:19,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:19,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:19,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:19,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:19,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:19,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:20,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:17:20,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:20,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:20,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:20,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:20,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:20,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:20,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:20,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:20,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:20,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:20,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:20,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:20,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:20,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:20,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:20,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:22,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:17:22,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:22,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:22,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:22,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:22,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:22,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:22,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:22,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:22,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:22,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:22,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:22,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:22,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:22,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:22,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:22,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:24,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:24,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:24,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:24,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:24,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:24,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:24,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:24,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:24,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:24,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:24,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:24,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:24,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:24,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:24,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:24,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:24,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:24,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:24,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:24,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:24,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:24,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:24,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:24,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:24,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:24,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:24,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:24,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:24,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:24,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:24,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:24,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:25,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:17:25,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:25,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:25,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:25,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:25,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:25,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:25,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:25,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:25,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:25,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:25,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:25,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:25,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:25,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:25,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:25,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:26,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:26,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:26,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:26,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:26,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:26,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:26,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:26,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:26,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:26,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:26,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:26,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:26,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:26,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:26,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:26,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:27,335 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:17:27,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:27,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:27,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:27,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:27,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:27,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:27,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:27,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:27,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:27,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:27,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:27,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:27,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:27,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:27,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:27,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:27,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:27,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:27,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:27,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:27,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:27,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:27,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:27,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:27,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:27,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:27,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:27,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:27,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:27,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:27,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:27,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,220 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:17:28,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:28,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:29,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:29,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:29,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:29,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:29,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:29,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:29,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:29,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:29,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:29,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:29,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:29,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:29,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:29,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:29,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:29,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:29,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:17:29,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:29,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:29,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:29,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:29,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:29,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:29,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:29,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:29,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:29,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:29,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:29,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:29,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:29,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:29,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:29,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:29,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:17:29,915 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:17:30,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:30,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:31,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:17:31,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:31,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:31,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:31,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:31,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:31,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:31,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:31,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:31,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:31,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:31,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:31,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:31,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:31,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:31,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:31,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:31,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:31,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:31,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:31,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:31,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:31,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:31,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:31,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:31,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:31,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:31,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:31,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:31,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:31,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:31,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:31,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:32,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:32,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:32,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:32,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:32,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:32,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:32,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:32,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:32,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:32,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:32,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:32,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:32,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:32,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:32,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:32,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:32,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:32,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:32,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:32,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:32,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:32,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:32,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:32,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:32,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:32,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:32,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:32,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:32,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:32,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:32,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:32,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:32,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:32,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:32,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:32,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:33,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:33,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:33,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:33,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:33,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:33,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:33,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:33,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:33,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:33,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:33,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:33,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:33,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:17:33,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:33,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:33,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:33,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:33,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:33,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:33,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:33,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:33,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:33,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:33,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:33,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:33,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:33,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:33,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:33,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:34,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:35,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:35,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:35,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:35,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:35,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:35,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:35,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:35,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:35,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:35,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:35,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:35,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:35,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:35,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:35,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:35,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:35,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:17:36,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:36,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:36,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:36,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:36,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:36,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:36,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:36,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:36,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:36,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:36,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:36,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:36,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:36,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:36,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:36,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:36,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:36,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:36,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:36,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:36,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:36,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:36,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:36,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:36,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:36,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:36,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:36,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:36,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:36,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:36,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:36,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:37,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:37,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:37,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:37,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:37,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:37,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:37,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:37,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:37,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:37,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:37,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:37,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:37,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:37,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:37,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:37,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:37,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:17:38,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:38,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:39,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:17:39,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:39,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:39,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:39,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:39,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:39,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:39,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:39,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:39,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:39,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:39,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:39,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:39,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:39,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:39,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:39,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:39,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:39,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:39,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:39,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:39,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:39,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:39,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:39,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:39,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:39,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:39,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:39,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:39,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:39,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:39,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:39,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:39,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:39,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:39,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:40,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:40,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:40,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:40,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:40,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:40,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:40,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:40,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:40,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:40,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:40,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:40,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:40,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:40,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:40,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:40,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:40,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:40,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:40,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:40,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:40,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:40,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:40,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:40,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:40,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:40,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:40,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:40,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:40,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:41,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:41,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:41,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:41,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:41,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:41,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:41,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:41,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:41,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:41,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:41,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:41,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:41,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:41,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:41,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:41,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:41,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:41,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:41,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:41,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:41,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:41,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:41,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:41,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:41,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:41,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:41,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:41,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:41,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:41,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:41,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:41,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:41,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:17:42,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:42,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:42,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:42,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:42,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:42,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:42,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:42,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:42,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:42,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:42,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:42,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:42,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:42,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:42,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:42,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:42,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:42,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,342 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:17:43,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:43,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:44,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:44,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:44,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:44,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:44,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:44,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:44,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:44,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:44,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:44,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:44,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:44,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:44,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:44,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:44,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:44,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:44,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:44,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:44,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:44,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:44,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:44,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:44,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:44,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:44,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:44,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:44,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:44,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:44,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:44,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:44,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:44,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:45,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:17:45,140 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:17:45,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:17:47,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:17:48,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:48,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:48,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:48,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:48,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:48,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:48,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:48,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:48,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:48,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:48,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:48,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:49,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:17:51,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:17:56,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:56,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:56,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:56,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:56,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:56,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:56,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:56,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:56,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:56,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:56,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:56,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:56,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:56,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:56,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:56,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:17:58,296 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:17:59,348 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:18:00,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:18:00,746 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:18:05,350 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:18:09,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:18:13,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:18:16,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:18:16,009 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:18:17,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:18:21,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:18:25,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:18:27,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:18:28,373 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:18:31,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:18:31,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:18:31,399 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:18:35,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:18:37,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:18:41,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:18:43,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:18:45,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:18:46,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:18:46,670 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:18:49,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:18:51,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:18:53,371 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:18:57,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:18:58,450 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:18:59,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:19:01,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:19:01,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:19:01,937 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:19:05,376 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:19:07,377 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:19:09,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:19:11,379 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:19:13,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:19:15,381 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:19:17,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:19:17,160 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:19:17,382 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:19:19,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:19:21,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:21,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:21,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:21,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:21,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:21,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:21,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:21,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:21,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:21,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:21,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:21,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:21,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:21,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:21,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:21,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:21,384 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:19:23,384 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:19:25,386 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:19:27,387 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:19:27,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:27,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:27,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:27,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:27,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:27,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:27,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:27,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:27,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:27,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:27,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:27,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:27,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:27,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:27,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:27,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:27,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:27,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:27,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:27,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:27,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:27,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:27,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:27,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:27,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:27,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:27,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:28,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:28,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:28,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:28,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:28,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:28,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:28,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:28,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:28,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:28,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:28,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:28,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:28,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:28,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:28,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:28,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:28,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:28,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:28,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:28,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:28,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:28,527 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:19:29,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:29,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:29,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:29,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:29,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:29,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:29,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:29,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:29,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:29,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:29,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:29,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:29,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:29,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:29,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:29,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:29,387 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:19:29,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:29,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:29,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:29,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:29,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:29,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:29,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:29,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:29,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:29,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:30,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:31,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:31,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:31,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:31,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:31,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:31,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:31,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:31,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:31,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:31,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:31,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:31,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:31,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:31,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:31,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:31,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:32,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:19:32,387 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:19:32,391 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:19:32,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:32,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:32,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:32,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:32,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:32,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:32,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:32,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:32,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:32,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:32,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:32,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:32,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:32,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:32,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:32,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:33,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:33,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:33,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:33,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:33,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:33,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:33,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:33,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:33,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:33,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:33,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:33,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:33,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:33,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:33,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:33,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:19:34,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:34,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:35,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:35,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:35,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:35,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:35,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:35,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:35,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:35,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:35,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:35,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:35,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:35,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:35,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:35,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:35,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:35,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:35,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:35,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:35,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:35,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:35,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:35,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:35,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:35,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:35,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:35,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:35,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:35,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:35,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:35,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:35,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:35,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:36,393 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:19:37,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:37,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:38,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:19:39,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:39,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:40,395 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:19:41,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:41,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:41,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:41,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:41,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:41,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:41,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:41,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:41,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:41,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:41,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:41,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:41,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:41,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:41,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:41,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:41,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:41,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:41,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:41,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:41,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:41,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:41,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:41,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:41,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:41,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:41,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:41,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:41,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:41,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:41,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:41,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:42,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:42,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:42,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:42,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:42,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:42,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:42,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:42,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:42,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:42,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:42,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:42,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:42,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:42,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:42,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:42,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:42,396 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:19:42,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:42,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:42,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:42,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:42,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:42,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:42,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:42,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:42,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:42,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:42,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:42,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:42,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:42,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:42,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:42,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:43,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:19:44,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:44,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:45,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:45,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:45,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:45,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:45,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:45,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:45,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:45,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:45,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:45,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:45,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:45,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:45,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:45,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:45,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:45,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:45,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:45,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:45,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:45,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:45,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:45,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:45,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:45,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:45,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:45,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:45,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:45,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:45,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:45,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:45,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:45,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:46,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:46,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:46,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:46,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:46,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:46,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:46,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:46,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:46,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:46,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:46,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:46,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:46,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:46,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:46,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:46,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:46,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:19:46,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:46,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:46,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:46,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:46,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:46,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:46,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:46,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:46,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:46,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:46,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:46,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:46,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:46,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:46,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:46,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:47,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:47,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:47,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:47,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:47,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:47,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:47,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:47,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:47,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:47,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:47,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:47,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:47,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:47,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:47,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:47,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:47,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:19:47,614 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:19:48,399 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:19:48,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:48,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:48,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:48,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:48,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:48,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:49,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:49,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:49,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:49,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:49,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:49,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:49,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:49,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:49,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:49,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:49,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:49,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:49,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:49,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:49,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:49,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:49,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:49,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:49,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:49,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:49,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:49,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:49,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:49,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:49,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:49,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:50,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:50,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:50,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:50,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:50,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:50,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:50,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:50,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:50,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:50,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:50,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:50,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:50,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:19:50,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 13:19:50,579 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 13:19:50,808 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 13:19:50,875 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 13:19:51,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 13:19:52,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:19:54,402 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:19:56,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:19:58,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:19:58,898 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:20:00,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:20:02,406 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:20:02,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:20:02,839 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:20:04,407 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:20:06,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:20:08,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:20:10,409 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:20:12,412 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:20:14,413 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:20:16,414 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:20:18,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:20:18,214 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:20:18,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:20:20,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:20:22,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:20:24,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:20:26,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:20:28,419 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:20:28,971 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:20:30,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:20:32,421 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:20:33,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:20:33,566 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:20:34,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:20:36,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:20:38,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:20:40,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:20:42,425 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:20:44,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:20:46,427 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:20:48,428 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:20:49,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:20:49,001 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:20:50,429 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:20:52,430 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:20:55,431 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:20:57,432 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:20:59,045 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:20:59,433 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:21:01,434 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:21:03,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:21:04,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:21:04,277 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:21:05,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:21:07,436 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:21:09,437 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:21:11,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:21:13,439 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:21:15,440 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:21:17,440 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:21:19,441 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:21:19,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:21:19,584 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:21:21,442 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:21:23,443 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:21:25,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:21:27,445 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:21:29,120 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:21:29,445 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:21:31,446 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:21:33,447 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:21:34,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:21:34,858 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:21:35,448 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:21:37,449 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:21:39,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:21:41,451 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:21:43,452 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:21:45,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:21:48,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:21:50,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:21:50,083 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:21:50,455 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:21:52,456 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:21:54,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:21:56,458 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:21:58,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:21:59,193 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:22:00,460 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:22:02,461 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:22:04,462 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:22:05,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:22:05,424 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:22:06,463 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:22:08,464 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:22:10,464 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:22:12,465 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:22:14,466 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:22:16,467 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:22:18,467 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:22:20,468 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:22:20,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:22:20,735 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:22:22,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:22:24,470 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:22:26,471 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:22:28,472 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:22:29,265 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:22:30,472 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:22:32,473 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:22:34,474 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:22:36,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:22:36,296 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:22:36,475 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:22:38,476 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:22:40,477 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:22:42,477 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:22:44,478 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:22:46,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:22:48,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:22:50,480 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:22:51,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:22:51,523 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:22:52,481 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:22:55,482 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:22:57,483 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:22:59,335 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:22:59,484 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:23:01,485 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:23:03,486 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:23:05,487 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:23:06,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:23:06,821 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:23:07,488 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:23:09,489 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:23:11,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:23:13,491 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:23:15,492 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:23:17,493 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:23:19,494 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:23:21,495 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:23:22,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:23:22,044 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:23:23,496 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:23:25,497 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:23:27,498 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:23:29,410 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:23:29,499 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:23:31,500 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:23:33,501 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:23:35,502 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:23:37,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:23:37,437 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:23:37,503 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:23:39,504 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:23:41,505 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:23:43,506 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:23:46,507 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:23:48,508 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:23:50,509 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:23:52,510 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:23:52,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:23:52,755 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:23:54,511 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:23:56,512 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:23:58,513 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:23:59,488 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:24:00,514 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:24:02,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:24:04,516 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:24:06,517 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:24:07,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:24:07,980 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:24:08,518 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:24:10,519 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:24:12,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:24:14,521 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:24:16,522 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:24:18,523 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:24:20,524 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:24:22,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:24:23,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:24:23,332 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:24:24,526 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:24:26,527 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:24:28,528 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:24:29,562 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:24:30,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:24:32,530 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:24:34,530 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:24:36,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:24:38,532 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:24:38,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:24:38,672 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:24:40,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:24:42,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:24:44,534 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:24:46,535 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:24:48,536 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:24:50,536 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:24:52,537 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:24:53,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:24:53,917 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:24:54,538 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:24:56,539 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:24:58,539 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:24:59,638 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:25:00,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:25:02,541 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:25:04,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:25:06,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:25:08,543 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:25:09,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:25:09,140 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:25:10,544 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:25:12,545 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:25:15,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:25:17,547 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:25:19,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:25:21,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:25:23,549 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:25:24,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:25:24,363 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:25:25,550 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:25:27,551 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:25:29,552 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:25:29,711 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:25:31,552 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:25:33,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:25:35,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:25:37,555 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:25:39,556 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:25:39,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:25:39,660 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:25:41,556 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:25:43,557 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:25:45,558 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:25:47,559 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:25:49,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:25:51,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:25:53,561 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:25:54,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:25:54,885 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:25:55,562 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:25:57,563 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:25:59,564 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:25:59,784 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:26:01,565 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:26:03,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:26:05,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:26:07,567 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:26:09,568 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:26:10,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:26:10,197 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:26:11,569 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:26:13,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:26:15,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:26:17,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:26:19,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:26:21,574 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:26:23,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:26:25,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:26:25,476 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:26:25,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:26:27,576 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:26:29,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:26:29,859 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:26:32,578 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:26:34,579 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:26:36,579 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:26:38,580 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:26:40,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:26:40,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:26:40,701 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:26:42,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:26:44,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:26:46,583 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:26:48,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:26:50,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:26:52,585 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:26:54,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:26:56,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:26:56,011 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:26:56,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:26:58,587 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:26:59,935 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:27:00,588 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:27:02,588 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:27:04,589 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:27:06,590 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:27:08,590 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:27:10,591 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:27:11,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:27:11,280 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:27:12,592 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:27:14,592 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:27:16,593 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:27:18,594 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:27:20,594 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:27:23,595 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:27:25,596 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:27:26,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:27:26,719 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:27:27,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:27:29,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:27:30,010 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:27:31,598 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:27:33,599 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:27:35,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:27:37,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:27:39,601 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:27:41,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:27:41,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:27:41,955 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:27:43,603 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:27:45,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:27:47,605 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:27:49,605 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:27:51,606 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:27:53,607 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:27:55,608 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:27:57,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:27:57,364 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:27:57,609 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:27:59,610 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:28:00,085 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:28:01,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:28:03,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:28:05,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:28:07,613 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:28:09,613 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:28:11,614 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:28:12,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:28:12,646 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:28:13,615 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:28:15,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:28:17,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:28:19,617 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:28:21,617 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:28:23,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:28:25,619 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:28:27,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:28:27,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:28:27,931 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:28:29,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:28:30,160 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:28:31,621 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:28:33,622 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:28:35,623 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:28:37,624 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:28:39,624 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:28:41,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:28:43,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:28:43,193 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:28:43,626 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:28:45,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:28:47,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:28:49,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:28:51,629 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:28:53,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:28:55,631 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:28:57,631 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:28:58,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:28:58,589 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:28:59,632 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:29:00,232 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:29:02,634 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:29:04,635 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:29:06,636 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:29:08,637 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:29:10,638 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:29:12,639 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:29:13,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:29:13,816 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:29:14,640 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:29:16,641 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:29:18,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:29:20,643 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:29:22,643 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:29:24,644 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:29:26,645 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:29:28,646 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:29:29,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:29:29,067 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:29:30,308 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:29:30,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:29:32,648 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:29:34,649 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:29:36,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:29:38,651 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:29:40,652 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:29:42,653 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:29:44,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:29:44,308 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:29:44,654 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:29:46,654 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:29:48,655 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:29:50,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:29:52,657 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:29:54,658 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:29:56,659 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:29:58,660 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:29:59,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:29:59,621 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:30:00,383 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:30:00,661 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:30:02,661 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:30:04,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:30:06,663 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:30:08,664 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:30:10,665 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:30:12,666 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:30:14,667 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:30:14,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:30:14,846 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:30:17,668 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:30:19,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:30:21,670 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:30:23,671 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:30:25,672 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:30:27,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:30:29,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:30:30,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:30:30,169 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:30:30,458 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:30:31,674 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:30:33,675 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:30:35,675 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:30:37,676 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:30:39,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:30:41,678 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:30:43,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:30:45,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:30:45,402 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:30:45,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:30:47,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:30:49,682 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:30:51,683 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:30:53,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:30:55,685 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:30:57,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:30:59,687 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:31:00,536 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:31:00,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:31:00,733 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:31:01,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:31:03,689 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:31:05,690 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:31:07,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:31:09,692 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:31:11,693 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:31:13,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:31:15,696 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:31:16,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:31:16,098 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:31:17,696 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:31:19,697 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:31:21,698 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:31:23,699 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:31:25,700 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:31:27,701 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:31:29,702 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:31:30,612 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:31:31,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:31:31,446 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:31:31,703 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:31:33,704 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:31:35,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:31:37,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:31:39,706 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:31:41,707 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:31:43,708 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:31:46,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:31:46,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:31:46,782 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:31:48,710 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:31:50,711 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:31:52,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:31:54,713 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:31:56,714 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:31:58,715 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:32:00,685 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:32:00,716 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:32:02,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:32:02,006 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:32:02,717 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:32:04,718 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:32:06,719 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:32:08,720 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:32:10,720 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:32:12,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:32:14,722 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:32:16,723 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:32:17,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:32:17,326 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:32:18,724 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:32:20,725 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:32:22,726 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:32:24,727 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:32:26,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:32:28,729 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:32:30,729 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:32:30,757 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:32:32,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:32:32,621 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:32:32,730 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:32:34,731 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:32:36,732 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:32:38,733 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:32:40,734 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:32:42,735 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:32:44,736 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:32:46,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:32:47,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:32:47,905 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:32:48,738 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:32:50,739 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:32:52,739 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:32:54,740 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:32:56,741 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:32:58,742 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:33:00,742 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:33:00,824 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:33:02,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:33:03,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:33:03,393 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:33:04,744 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:33:06,745 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:33:08,746 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:33:10,746 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:33:12,747 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:33:14,748 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:33:16,749 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:33:18,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:33:18,673 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:33:18,750 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:33:20,750 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:33:23,752 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:33:25,752 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:33:27,753 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:33:29,754 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:33:30,887 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:33:31,755 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:33:33,756 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:33:33,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:33:33,977 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:33:35,757 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:33:37,758 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:33:39,759 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:33:41,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:33:43,761 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:33:45,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:33:47,763 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:33:49,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:33:49,238 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:33:49,763 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:33:51,764 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:33:53,765 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:33:55,766 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:33:57,767 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:33:59,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:34:00,947 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:34:01,769 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:34:03,770 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:34:04,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:34:04,548 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:34:05,771 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:34:07,771 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:34:09,772 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:34:11,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:34:13,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:34:16,775 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:34:18,776 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:34:19,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:34:19,884 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:34:20,777 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:34:22,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:34:24,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:34:26,779 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:34:28,780 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:34:30,781 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:34:31,016 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:34:32,781 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:34:34,782 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:34:35,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:34:35,137 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:34:36,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:34:38,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:34:40,785 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:34:42,786 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:34:44,787 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:34:46,788 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:34:48,789 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:34:50,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:34:50,372 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:34:50,790 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:34:52,791 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:34:54,792 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:34:56,793 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:34:58,794 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:35:00,795 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:35:01,086 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:35:02,796 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:35:04,797 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:35:05,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:35:05,694 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:35:06,798 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:35:08,799 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:35:10,800 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:35:12,801 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:35:14,802 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:35:16,802 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:35:18,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:35:20,804 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:35:20,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:35:20,995 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:35:22,805 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:35:24,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:35:26,807 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:35:28,808 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:35:30,809 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:35:31,160 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:35:32,810 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:35:34,811 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:35:36,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:35:36,317 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:35:36,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:35:38,813 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:35:40,814 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:35:42,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:35:44,816 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:35:47,817 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:35:49,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:35:51,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:35:51,556 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:35:51,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:35:53,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:35:55,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:35:57,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:35:59,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:36:01,236 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:36:01,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:36:03,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:36:05,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:36:06,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:36:06,780 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:36:07,826 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:36:09,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:36:11,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:36:13,829 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:36:15,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:36:17,831 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:36:19,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:36:21,833 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:36:22,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:36:22,094 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:36:23,834 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:36:25,834 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:36:27,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:36:29,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:36:31,316 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:36:31,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:36:33,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:36:35,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:36:37,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:36:37,389 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:36:38,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:36:40,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:36:42,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:36:44,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:36:46,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:36:48,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:36:50,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:36:52,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:36:52,630 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:36:52,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:36:54,846 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:36:56,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:36:58,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:37:00,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:37:01,393 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:37:02,849 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:37:04,850 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:37:06,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:37:07,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:37:07,919 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:37:08,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:37:10,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:37:12,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:37:14,854 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:37:16,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:37:18,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:37:20,856 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:37:22,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:37:23,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:37:23,183 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:37:24,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:37:26,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:37:28,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:37:30,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:37:31,472 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:37:32,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:37:34,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:37:36,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:37:38,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:37:38,413 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:37:38,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:37:40,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:37:42,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:37:44,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:37:46,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:37:48,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:37:51,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:37:53,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:37:53,635 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:37:53,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:37:55,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:37:57,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:37:59,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:38:01,547 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:38:01,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:38:03,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:38:05,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:38:07,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:38:08,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:38:08,857 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:38:09,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:38:11,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:38:13,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:38:15,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:38:17,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:38:19,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:38:21,882 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:38:23,883 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:38:24,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:38:24,082 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:38:25,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:38:27,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:38:29,885 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:38:31,622 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:38:31,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:38:33,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:38:35,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:38:37,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:38:39,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:38:39,304 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:38:39,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:38:41,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:38:43,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:38:45,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:38:47,894 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:38:49,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:38:51,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:38:53,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:38:54,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:38:54,624 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:38:55,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:38:57,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:38:59,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:39:01,701 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:39:01,900 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:39:03,901 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:39:05,902 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:39:07,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:39:09,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:39:10,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:39:10,994 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:39:11,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:39:13,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:39:15,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:39:17,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:39:19,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:39:22,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:39:24,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:39:26,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:39:26,348 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:39:26,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:39:28,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:39:30,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:39:31,794 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:39:32,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:39:34,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:39:36,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:39:38,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:39:40,916 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:39:41,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:39:41,584 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:39:42,916 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:39:44,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:39:46,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:39:48,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:39:50,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:39:52,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:39:54,921 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:39:56,922 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:39:57,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:39:57,062 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:39:58,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:40:00,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:40:01,864 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:40:02,925 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:40:04,925 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:40:06,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:40:08,927 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:40:10,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:40:12,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:40:12,291 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:40:12,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:40:14,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:40:16,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:40:18,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:40:20,932 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:40:22,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:40:24,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:40:26,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:40:27,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:40:27,514 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:40:28,935 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:40:30,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:40:31,938 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:40:32,937 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:40:34,937 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:40:36,938 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:40:38,939 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:40:41,940 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:40:42,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:40:42,958 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:40:43,941 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:40:45,942 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:40:47,943 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:40:49,944 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:40:51,944 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:40:53,945 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:40:55,946 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:40:57,947 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:40:58,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:40:58,266 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:40:59,948 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:41:01,949 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:41:02,014 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:41:03,950 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:41:05,952 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:41:07,952 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:41:09,953 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:41:11,954 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:41:13,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:41:13,593 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:41:13,955 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:41:15,956 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:41:17,957 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:41:19,958 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:41:21,959 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:41:23,960 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:41:25,961 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:41:27,961 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:41:28,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:41:28,934 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:41:29,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:41:31,963 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:41:32,089 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:41:33,964 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:41:35,965 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:41:37,966 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:41:39,967 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:41:41,968 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:41:43,969 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:41:44,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:41:44,346 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:41:45,969 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:41:47,970 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:41:49,971 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:41:51,972 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:41:53,972 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:41:55,973 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:41:57,974 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:41:59,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:41:59,633 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:41:59,975 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:42:02,155 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:42:02,976 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:42:04,977 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:42:06,978 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:42:08,979 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:42:10,980 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:42:12,981 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:42:14,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:42:14,856 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:42:14,982 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:42:16,983 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:42:18,984 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:42:20,985 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:42:22,986 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:42:24,987 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:42:26,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:42:28,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:42:30,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:42:30,215 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:42:30,989 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:42:32,228 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:42:32,990 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:42:34,991 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:42:36,992 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:42:38,993 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:42:40,994 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:42:42,995 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:42:44,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:42:45,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:42:45,440 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:42:46,997 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:42:48,998 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:42:50,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:42:53,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:42:55,001 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:42:57,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:42:59,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:43:00,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:43:00,774 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:43:01,003 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:43:02,304 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:43:03,004 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:43:05,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:43:07,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:43:09,007 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:43:11,008 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:43:13,009 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:43:15,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:43:15,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:43:15,996 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:43:17,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:43:19,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:43:21,012 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:43:23,013 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:43:25,014 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:43:27,015 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:43:29,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:43:31,017 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:43:31,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:43:31,405 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:43:32,378 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:43:33,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:43:35,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:43:37,019 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:43:39,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:43:41,021 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:43:43,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:43:45,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:43:46,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:43:46,718 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:43:47,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:43:49,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:43:52,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:43:54,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:43:56,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:43:58,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:44:00,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:44:01,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:44:01,940 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:44:02,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:44:02,453 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:44:04,031 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:44:06,032 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:44:08,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:44:10,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:44:12,034 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:44:14,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:44:16,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:44:17,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:44:17,229 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:44:18,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:44:20,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:44:22,038 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:44:24,039 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:44:26,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:44:28,041 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:44:30,042 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:44:32,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:44:32,527 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:44:32,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:44:32,859 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:44:34,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:44:36,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:44:38,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:44:40,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:44:42,047 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:44:44,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:44:46,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:44:48,049 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:44:48,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:44:48,082 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:44:50,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:44:52,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:44:54,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:44:56,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:44:58,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:45:00,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:45:02,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:45:02,604 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:45:03,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:45:03,477 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:45:04,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:45:06,056 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:45:08,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:45:10,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:45:12,059 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:45:14,060 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:45:16,061 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:45:18,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:45:18,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:45:18,770 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:45:21,063 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:45:23,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:45:25,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:45:27,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:45:29,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:45:31,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:45:32,679 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:45:33,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:45:33,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:45:33,993 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:45:35,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:45:37,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:45:39,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:45:41,071 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:45:43,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:45:45,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:45:47,074 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:45:49,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:45:49,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:45:49,242 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:45:51,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:45:53,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:45:55,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:45:57,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:45:59,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:46:01,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:46:02,756 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:46:03,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:46:04,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:46:04,482 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:46:05,081 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:46:07,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:46:09,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:46:11,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:46:13,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:46:16,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:46:18,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:46:19,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:46:19,914 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:46:20,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:46:22,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:46:24,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:46:26,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:46:28,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:46:30,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:46:32,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:46:32,832 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:46:34,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:46:35,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:46:35,142 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:46:36,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:46:38,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:46:40,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:46:42,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:46:44,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:46:46,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:46:48,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:46:50,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:46:50,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:46:50,438 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:46:52,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:46:54,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:46:56,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:46:58,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:47:00,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:47:02,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:47:02,907 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:47:04,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:47:05,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:47:05,665 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:47:06,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:47:08,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:47:10,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:47:12,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:47:14,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:47:16,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:47:19,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:47:20,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:47:20,970 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:47:21,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:47:23,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:47:25,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:47:27,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:47:29,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:47:31,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:47:32,982 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:47:33,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:47:35,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:47:36,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:47:36,284 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:47:37,121 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:47:39,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:47:41,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:47:43,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:47:45,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:47:47,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:47:49,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:47:51,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:47:51,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:47:51,521 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:47:53,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:47:55,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:47:57,128 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:47:59,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:48:01,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:48:03,058 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:48:03,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:48:05,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:48:06,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:48:06,757 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:48:07,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:48:09,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:48:11,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:48:13,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:48:15,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:48:17,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:48:19,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:48:21,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:48:21,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:48:21,978 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:48:23,140 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:48:26,142 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:48:28,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:48:30,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:48:32,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:48:33,130 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:48:34,145 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:48:36,146 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:48:37,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:48:37,345 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:48:38,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:48:40,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:48:42,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:48:44,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:48:46,150 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:48:48,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:48:50,152 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:48:52,153 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:48:52,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:48:52,572 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:48:54,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:48:56,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:48:58,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:49:00,157 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:49:02,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:49:03,204 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:49:04,159 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:49:06,160 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:49:07,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:49:07,906 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:49:08,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:49:10,162 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:49:12,162 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:49:14,163 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:49:16,164 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:49:18,165 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:49:20,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:49:22,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:49:23,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:49:23,204 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:49:24,168 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:49:27,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:49:29,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:49:31,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:49:33,172 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:49:33,277 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:49:35,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:49:37,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:49:38,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:49:38,425 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:49:39,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:49:41,175 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:49:43,176 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:49:45,176 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:49:47,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:49:49,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:49:51,179 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:49:53,179 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:49:53,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:49:53,688 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:49:55,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:49:57,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:49:59,182 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:50:01,182 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:50:03,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:50:03,351 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:50:05,184 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:50:07,185 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:50:08,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:50:08,902 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:50:09,186 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:50:11,186 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:50:13,187 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:50:15,188 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:50:17,189 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:50:19,189 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:50:21,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:50:23,191 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:50:24,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:50:24,138 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:50:25,192 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:50:27,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:50:29,194 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:50:31,195 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:50:33,196 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:50:33,427 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:50:35,197 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:50:37,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:50:39,199 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:50:39,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:50:39,498 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:50:41,200 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:50:43,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:50:45,202 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:50:47,202 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:50:49,203 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:50:51,204 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:50:53,205 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:50:54,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:50:54,726 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:50:55,206 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:50:57,206 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:50:59,207 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:51:02,209 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:51:03,504 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:51:04,210 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:51:06,211 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:51:08,212 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:51:09,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:51:09,948 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:51:10,213 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:51:12,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:51:14,215 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:51:16,216 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:51:18,217 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:51:20,218 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:51:22,219 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:51:24,220 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:51:25,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:51:25,420 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:51:26,221 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:51:28,222 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:51:30,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:51:32,224 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:51:33,580 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:51:34,225 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:51:36,226 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:51:38,227 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:51:40,228 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:51:40,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:51:40,642 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:51:42,229 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:51:44,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:51:46,231 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:51:48,232 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:51:50,232 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:51:52,233 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:51:54,234 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:51:56,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:51:56,048 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:51:56,235 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:51:58,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:52:01,237 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:52:03,238 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:52:03,656 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:52:05,239 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:52:07,240 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:52:09,240 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:52:11,241 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:52:11,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:52:11,349 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:52:13,242 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:52:15,243 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:52:17,243 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:52:19,244 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:52:21,245 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:52:23,246 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:52:25,246 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:52:26,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:52:26,573 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:52:27,247 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:52:29,248 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:52:31,249 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:52:33,249 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:52:33,733 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:52:35,250 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:52:37,251 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:52:39,252 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:52:41,252 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:52:41,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:52:41,797 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:52:43,253 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:52:45,254 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:52:47,255 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:52:49,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:52:51,257 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:52:53,257 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:52:56,258 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:52:57,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:52:57,023 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:52:58,259 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:53:00,260 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:53:02,261 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:53:03,804 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:53:04,262 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:53:06,263 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:53:08,264 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:53:10,265 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:53:12,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:53:12,249 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:53:12,266 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:53:14,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:53:16,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:53:18,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:53:20,271 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:53:22,272 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:53:24,273 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:53:26,274 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:53:27,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:53:27,650 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:53:28,275 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:53:30,276 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:53:32,276 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:53:33,877 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:53:34,277 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:53:36,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:53:38,279 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:53:40,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:53:42,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:53:42,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:53:42,882 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:53:44,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:53:46,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:53:48,283 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:53:50,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:53:52,285 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:53:54,285 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:53:57,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:53:58,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:53:58,263 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:53:59,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:54:01,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:54:03,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:54:03,949 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:54:05,290 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:54:07,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:54:09,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:54:11,292 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:54:13,293 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:54:13,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:54:13,489 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:54:15,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:54:17,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:54:19,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:54:21,296 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:54:23,297 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:54:25,297 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:54:27,298 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:54:28,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:54:28,808 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:54:29,299 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:54:31,300 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:54:33,300 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:54:34,028 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:54:35,301 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:54:37,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:54:39,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:54:41,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:54:43,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:54:44,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:54:44,116 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:54:45,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:54:47,306 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:54:49,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:54:51,308 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:54:53,308 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:54:55,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:54:57,310 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:54:59,311 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:54:59,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:54:59,341 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:55:01,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:55:03,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:55:04,116 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:55:05,313 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:55:07,313 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:55:10,314 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:55:12,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:55:14,316 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:55:14,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:55:14,766 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:55:16,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:55:18,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:55:20,318 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:55:22,319 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:55:24,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:55:26,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:55:28,321 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:55:30,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:55:30,081 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:55:30,322 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:55:32,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:55:34,188 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:55:34,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:55:36,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:55:38,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:55:40,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:55:42,326 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:55:44,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:55:45,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:55:45,372 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:55:46,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:55:48,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:55:50,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:55:52,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:55:54,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:55:56,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:55:58,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:56:00,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:56:00,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:56:00,589 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:56:02,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:56:04,263 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:56:04,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:56:06,335 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:56:08,335 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:56:10,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:56:12,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:56:14,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:56:15,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:56:15,816 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:56:16,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:56:18,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:56:21,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:56:23,342 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:56:25,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:56:27,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:56:29,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:56:31,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:56:31,078 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:56:31,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:56:33,346 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:56:34,338 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:56:35,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:56:37,348 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:56:39,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:56:41,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:56:43,350 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:56:45,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:56:46,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:56:46,300 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:56:47,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:56:49,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:56:51,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:56:53,354 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:56:55,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:56:57,356 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:56:59,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:57:01,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:57:01,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:57:01,664 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:57:03,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:57:04,414 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:57:05,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:57:07,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:57:09,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:57:11,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:57:14,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:57:16,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:57:16,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:57:16,930 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:57:18,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:57:20,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:57:22,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:57:24,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:57:26,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:57:28,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:57:30,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:57:32,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:57:32,294 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:57:32,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:57:34,371 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:57:34,488 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:57:36,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:57:38,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:57:40,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:57:42,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:57:44,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:57:46,376 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:57:47,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:57:47,996 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:57:48,377 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:57:50,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:57:52,379 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:57:54,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:57:56,381 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:57:58,382 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:58:00,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:58:02,384 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:58:03,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:58:03,334 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:58:04,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:58:04,562 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:58:06,386 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:58:08,387 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:58:10,388 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:58:12,389 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:58:14,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:58:16,391 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:58:18,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:58:18,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:58:18,552 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:58:21,393 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:58:23,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:58:25,395 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:58:27,396 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:58:29,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:58:31,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:58:33,399 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:58:33,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:58:33,868 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:58:34,635 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:58:35,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:58:37,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:58:39,402 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:58:41,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:58:43,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:58:45,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:58:47,406 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:58:49,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:58:49,097 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:58:49,407 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:58:51,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:58:53,409 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:58:55,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:58:57,411 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:58:59,412 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:59:01,413 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:59:03,414 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:59:04,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:59:04,389 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:59:04,710 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:59:05,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:59:07,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:59:09,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:59:11,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:59:13,419 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:59:15,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:59:17,421 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:59:19,421 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:59:19,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:59:19,720 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:59:21,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:59:23,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:59:25,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:59:27,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:59:29,425 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:59:31,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:59:33,427 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:59:34,783 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 13:59:34,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:59:34,968 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:59:35,428 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:59:37,429 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:59:40,430 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:59:42,431 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:59:44,432 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:59:46,433 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:59:48,434 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:59:50,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 13:59:50,243 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 13:59:50,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:59:52,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:59:54,436 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:59:56,437 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 13:59:58,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:00:00,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:00:02,439 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:00:04,440 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:00:04,857 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:00:05,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:00:05,563 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:00:06,441 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:00:08,442 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:00:10,443 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:00:12,443 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:00:14,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:00:16,445 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:00:18,446 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:00:20,447 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:00:20,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:00:20,881 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:00:22,448 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:00:24,449 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:00:26,449 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:00:28,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:00:30,451 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:00:32,452 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:00:34,452 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:00:34,930 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:00:36,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:00:36,114 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:00:36,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:00:38,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:00:40,455 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:00:42,455 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:00:44,456 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:00:46,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:00:48,458 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:00:50,458 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:00:51,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:00:51,506 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:00:52,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:00:55,460 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:00:57,461 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:00:59,461 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:01:01,462 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:01:03,463 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:01:05,004 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:01:05,464 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:01:06,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:01:06,733 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:01:07,465 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:01:09,465 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:01:11,466 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:01:13,467 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:01:15,468 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:01:17,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:01:19,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:01:21,470 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:01:21,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:01:21,967 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:01:23,471 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:01:25,472 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:01:27,472 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:01:29,473 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:01:31,474 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:01:33,474 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:01:35,081 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:01:35,475 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:01:37,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:01:37,200 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:01:37,476 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:01:39,477 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:01:41,478 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:01:43,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:01:45,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:01:47,480 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:01:49,481 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:01:51,481 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:01:52,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:01:52,490 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:01:54,483 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:01:56,483 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:01:58,484 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:02:00,485 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:02:02,486 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:02:04,487 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:02:05,156 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:02:06,488 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:02:07,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:02:07,862 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:02:08,489 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:02:10,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:02:12,491 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:02:14,492 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:02:16,493 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:02:18,494 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:02:20,495 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:02:22,496 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:02:23,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:02:23,102 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:02:24,497 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:02:26,498 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:02:28,499 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:02:30,500 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:02:32,501 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:02:34,502 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:02:35,231 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:02:36,502 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:02:38,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:02:38,436 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:02:38,504 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:02:40,505 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:02:42,505 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:02:44,506 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:02:46,507 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:02:48,508 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:02:50,509 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:02:52,510 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:02:53,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:02:53,734 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:02:55,511 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:02:57,512 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:02:59,513 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:03:01,514 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:03:03,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:03:05,306 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:03:05,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:03:07,516 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:03:09,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:03:09,126 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:03:09,517 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:03:11,518 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:03:13,519 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:03:15,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:03:17,521 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:03:19,522 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:03:21,523 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:03:23,523 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:03:24,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:03:24,356 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:03:25,524 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:03:27,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:03:29,526 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:03:31,526 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:03:33,527 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:03:35,383 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:03:35,528 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:03:37,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:03:39,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:03:39,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:03:39,634 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:03:42,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:03:44,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:03:46,532 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:03:48,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:03:50,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:03:52,534 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:03:54,535 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:03:54,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:03:54,915 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:03:56,536 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:03:58,536 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:04:00,537 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:04:02,538 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:04:04,538 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:04:05,461 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:04:06,539 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:04:08,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:04:10,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:04:10,184 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:04:10,541 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:04:12,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:04:14,543 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:04:25,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:04:25,410 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:04:35,539 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:04:40,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:04:40,653 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:04:55,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:04:55,921 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:05:05,615 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:05:11,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:05:11,182 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:05:11,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:05:11,588 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 14:05:11,641 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 14:05:11,718 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 14:05:12,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 14:05:12,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:05:20,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:05:26,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:05:26,423 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:05:35,782 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:05:40,579 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:05:41,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:05:41,702 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:05:56,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:05:56,939 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:06:05,859 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:06:12,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:06:12,164 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:06:27,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:06:27,400 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:06:35,937 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:06:42,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:06:42,660 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:06:57,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:06:57,930 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:07:06,021 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:07:13,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:07:13,552 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:07:28,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:07:28,776 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:07:36,091 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:07:44,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:07:44,002 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:07:59,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:07:59,226 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:08:06,166 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:08:14,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:08:14,448 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:08:29,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:08:29,705 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:08:30,654 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:08:31,655 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:08:36,240 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:08:45,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:08:45,040 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:09:00,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:09:00,267 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:09:06,318 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:09:15,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:09:15,491 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:09:28,680 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:09:29,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:09:30,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:09:30,749 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:09:34,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:09:34,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:09:34,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:09:34,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:09:34,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:09:34,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:09:34,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:09:34,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:09:35,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:09:35,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:09:35,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:09:35,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:09:35,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:09:35,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:09:35,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:09:35,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:09:36,396 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:09:40,685 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:09:44,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:09:45,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:09:45,974 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:09:51,689 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:09:51,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:09:51,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:09:51,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:09:51,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:09:51,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:09:51,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:09:51,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:09:51,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:09:51,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:09:51,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:09:51,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:09:51,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:09:51,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:09:51,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:09:51,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:09:51,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:09:53,690 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:09:57,692 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:10:01,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:10:01,384 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:10:01,693 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:10:05,695 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:10:06,469 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:10:09,697 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:10:11,697 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:10:15,699 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:10:16,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:10:16,897 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:10:17,700 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:10:21,701 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:10:23,702 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:10:27,704 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:10:29,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:10:32,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:10:32,594 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:10:33,706 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:10:35,707 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:10:36,545 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:10:37,708 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:10:39,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:10:43,711 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:10:45,711 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:10:47,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:10:47,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:10:47,829 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:10:49,713 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:10:51,714 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:10:55,715 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:10:57,716 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:10:59,717 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:11:01,717 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:11:03,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:11:03,054 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:11:03,718 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:11:03,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:03,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:03,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:03,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:03,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:03,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:03,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:03,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:03,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:03,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:03,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:03,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:04,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:04,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:04,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:04,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:05,719 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:11:06,612 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:11:07,720 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:11:09,720 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:11:10,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:10,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:10,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:10,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:10,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:10,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:10,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:10,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:10,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:10,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:10,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:10,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:10,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:10,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:10,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:10,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:11,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:11:12,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:12,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:12,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:12,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:12,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:12,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:12,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:12,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:12,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:12,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:12,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:12,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:12,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:12,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:12,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:12,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:12,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:12,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:12,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:12,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:12,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:12,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:12,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:12,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:12,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:12,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:12,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:12,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:12,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:12,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:12,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:12,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,722 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:11:13,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:13,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:15,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:15,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:15,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:15,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:15,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:15,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:15,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:15,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:15,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:15,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:15,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:15,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:15,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:15,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:15,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:15,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:15,723 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:11:16,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:16,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,723 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:11:17,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:17,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:18,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:11:18,312 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:11:19,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,724 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:11:19,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:19,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:20,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:20,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:20,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:20,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:20,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:20,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:20,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:20,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:20,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:20,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:20,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:20,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:20,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:20,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:20,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:20,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:20,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:20,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:20,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:20,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:20,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:20,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:20,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:20,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:20,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:20,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:20,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:20,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:20,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:20,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:20,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:20,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,725 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:11:21,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:21,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:22,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:22,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:22,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:22,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:22,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:22,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:22,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:22,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:22,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:22,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:22,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:22,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:22,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:22,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:22,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:22,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:22,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:22,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:22,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:22,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:22,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:22,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:22,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:22,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:22,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:22,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:22,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:22,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:22,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:22,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:22,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:22,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:23,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:23,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:23,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:23,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:23,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:23,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:23,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:23,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:23,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:23,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:23,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:23,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:23,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:23,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:23,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:23,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:23,726 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:11:23,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:23,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:23,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:23,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:23,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:23,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:23,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:23,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:23,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:23,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:23,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:23,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:23,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:23,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:23,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:23,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:25,726 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:11:26,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:26,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:26,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:26,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:26,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:26,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:26,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:26,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:26,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:26,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:26,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:26,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:26,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:26,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:26,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:26,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:26,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:26,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:26,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:26,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:26,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:26,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:26,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:26,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:26,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:26,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:26,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:26,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:26,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:26,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:26,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:26,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,727 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:11:27,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:27,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:28,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:28,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:28,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:28,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:28,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:28,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:28,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:28,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:28,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:28,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:28,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:28,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:28,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:28,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:28,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:28,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:28,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:28,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:28,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:28,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:28,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:28,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:28,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:28,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:28,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:28,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:28,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:28,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:28,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:28,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:28,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:28,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:29,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:11:31,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:31,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:31,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:31,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:31,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:31,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:31,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:31,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:31,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:31,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:31,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:31,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:31,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:31,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:31,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:31,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:31,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:31,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:31,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:31,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:31,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:31,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:31,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:31,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:31,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:31,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:31,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:31,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:32,729 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:11:34,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:11:34,001 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:11:34,730 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:11:35,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:35,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:35,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:35,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:35,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:35,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:35,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:35,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:35,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:35,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:35,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:35,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:35,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:35,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:35,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:35,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:36,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:36,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:36,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:36,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:36,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:36,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:36,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:36,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:36,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:36,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:36,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:36,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:36,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:36,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:36,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:36,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:36,678 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:11:42,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:42,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:42,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:42,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:42,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:42,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:42,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:42,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:42,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:42,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:42,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:42,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:42,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:42,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:42,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:42,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:42,734 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:11:46,735 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:11:49,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:11:49,236 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:11:50,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:11:51,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:51,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:51,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:51,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:51,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:51,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:51,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:51,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:51,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:51,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:51,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:51,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:51,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:51,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:51,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:51,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:54,739 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:11:54,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:54,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:54,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:54,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:54,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:54,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:54,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:54,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:54,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:54,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:54,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:54,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:54,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:54,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:54,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:54,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:11:58,740 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:12:02,742 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:12:04,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:12:04,740 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:12:06,744 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:12:06,748 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:12:08,749 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:12:12,750 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:12:16,752 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:12:18,753 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:12:19,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:12:19,966 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:12:22,754 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:12:24,755 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:12:26,756 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:12:30,757 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:12:32,758 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:12:34,759 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:12:35,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:12:35,322 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:12:36,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:12:36,811 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:12:40,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:12:42,763 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:12:44,764 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:12:46,765 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:12:48,765 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:12:50,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:12:50,725 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:12:50,766 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:12:54,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:12:56,769 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:12:59,770 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:13:01,771 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:13:03,772 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:13:05,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:13:05,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:13:05,951 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:13:06,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:06,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:06,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:06,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:06,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:06,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:06,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:06,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:06,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:06,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:06,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:06,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:06,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:06,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:06,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:06,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:06,882 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:13:07,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:13:09,775 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:13:11,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:11,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:11,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:11,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:11,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:11,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:11,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:11,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:11,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:11,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:11,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:11,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:11,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:11,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:11,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:11,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:11,775 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:13:12,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:12,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:12,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:12,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:12,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:12,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:12,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:12,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:12,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:12,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:12,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:12,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:12,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:12,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:12,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:12,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:13,776 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:13:14,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:14,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:14,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:14,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:14,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:14,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:14,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:14,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:14,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:14,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:14,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:14,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:14,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:14,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:14,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:14,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:14,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:14,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:14,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:14,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:14,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:14,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:14,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:14,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:14,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:14,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:14,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:14,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:14,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:14,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:14,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:14,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:15,777 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:13:16,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:16,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:17,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:13:18,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:18,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:19,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:19,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:19,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:19,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:19,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:19,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:19,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:19,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:19,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:19,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:19,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:19,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:19,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:19,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:19,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:19,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:19,779 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:13:20,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:20,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:13:21,208 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:13:21,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,780 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:13:21,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:21,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:22,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:23,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:23,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:23,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:23,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:23,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:23,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:23,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:23,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:23,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:23,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:23,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:23,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:23,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:23,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:23,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:23,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:23,781 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:13:24,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:24,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:24,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:24,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:24,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:24,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:24,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:24,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:24,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:24,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:24,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:24,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:24,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:24,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:24,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:24,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:24,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:24,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:24,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:24,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:24,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:24,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:24,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:24,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:24,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:24,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:24,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:24,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:24,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:24,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:24,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:24,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:25,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:25,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:25,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:25,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:25,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:25,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:25,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:25,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:25,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:25,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:25,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:25,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:25,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:25,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:25,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:25,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:25,781 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:13:27,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:27,782 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:13:28,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:28,938 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 14:13:29,125 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 14:13:29,208 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 14:13:29,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 14:13:29,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:13:30,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:13:31,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:13:33,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:33,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:33,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:33,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:33,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:33,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:33,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:33,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:33,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:33,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:33,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:33,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:33,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:33,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:33,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:33,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:35,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:35,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:35,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:35,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:35,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:35,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:35,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:35,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:35,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:35,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:35,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:35,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:35,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:35,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:35,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:35,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:36,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:13:36,431 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:13:37,228 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:13:41,787 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:13:44,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:44,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:44,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:44,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:44,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:44,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:44,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:44,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:44,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:44,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:44,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:44,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:44,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:44,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:44,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:44,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:46,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:46,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:46,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:46,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:46,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:46,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:46,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:46,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:46,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:46,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:46,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:46,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:46,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:46,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:46,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:46,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:47,789 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:13:51,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:13:51,654 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:13:51,791 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:13:53,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:53,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:53,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:53,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:53,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:53,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:53,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:53,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:53,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:53,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:53,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:53,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:53,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:53,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:53,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:53,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:53,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:53,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:53,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:53,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:53,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:53,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:53,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:53,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:53,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:53,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:53,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:53,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:53,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:53,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:53,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:53,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:55,793 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:13:55,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:55,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:55,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:55,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:55,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:55,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:55,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:55,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:55,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:55,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:55,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:55,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:55,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:55,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:55,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:55,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:13:59,794 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:14:03,796 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:14:07,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:14:07,062 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:14:07,301 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:14:07,798 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:14:10,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:14:10,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:14:10,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:14:10,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:14:10,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:14:10,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:14:10,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:14:10,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:14:10,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:14:10,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:14:10,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:14:10,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:14:10,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:14:10,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:14:10,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:14:10,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:14:11,799 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:14:15,801 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:14:17,802 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:14:21,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:14:22,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:14:22,281 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:14:23,804 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:14:27,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:14:29,807 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:14:33,808 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:14:35,809 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:14:37,376 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:14:37,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:14:37,740 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:14:37,810 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:14:41,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:14:43,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:14:45,813 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:14:47,814 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:14:49,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:14:51,816 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:14:53,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:14:53,387 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:14:55,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:14:57,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:14:59,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:15:01,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:15:03,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:15:05,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:15:07,444 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:15:07,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:15:08,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:15:08,625 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:15:09,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:15:11,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:11,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:11,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:11,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:11,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:15:11,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:11,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:11,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:11,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:11,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:11,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:11,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:11,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:11,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:11,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:11,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:11,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:13,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:15:15,826 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:15:17,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:15:18,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:18,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:18,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:18,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:18,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:18,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:18,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:18,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:18,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:18,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:18,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:18,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:18,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:18,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:18,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:18,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:19,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:19,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:19,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:19,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:19,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:19,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:19,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:19,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:19,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:19,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:19,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:19,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:19,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:19,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:19,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:19,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:19,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:19,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:19,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:19,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:19,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:19,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:19,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:19,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:19,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:19,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:19,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:19,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:19,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:19,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:19,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:19,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:19,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:15:21,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:15:21,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:21,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:22,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:22,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:22,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:22,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:22,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:22,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:22,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:22,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:22,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:22,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:22,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:22,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:22,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:22,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:22,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:22,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:23,829 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:15:23,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:15:23,848 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:15:25,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:25,829 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:15:26,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:26,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,831 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:15:27,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:27,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:28,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:28,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:28,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:28,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:28,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:28,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:28,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:28,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:28,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:28,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:28,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:28,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:28,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:28,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:28,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:28,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:29,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:29,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:29,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:29,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:29,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:29,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:29,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:29,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:29,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:29,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:29,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:29,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:29,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:29,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:29,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:29,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:29,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:29,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:29,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:29,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:29,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:29,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:29,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:29,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:29,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:29,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:29,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:29,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:29,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:29,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:29,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:29,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:29,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:15:30,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:30,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:30,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:30,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:30,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:30,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:30,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:30,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:30,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:30,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:30,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:30,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:30,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:30,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:30,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:30,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:31,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:31,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:31,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:31,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:31,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:31,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:31,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:31,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:31,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:31,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:31,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:31,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:31,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:31,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:31,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:31,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:31,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:31,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:31,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:31,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:31,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:31,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:31,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:31,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:31,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:31,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:31,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:31,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:31,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:15:33,833 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:15:35,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:35,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:35,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:35,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:35,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:35,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:35,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:35,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:35,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:35,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:35,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:35,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:35,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:35,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:35,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:35,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:37,510 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:15:39,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:15:39,155 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:15:41,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:41,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:41,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:41,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:41,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:41,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:41,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:41,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:41,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:41,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:41,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:41,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:41,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:41,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:41,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:41,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:41,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:41,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:41,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:41,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:41,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:41,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:41,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:41,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:41,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:41,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:41,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:41,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:41,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:41,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:41,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:41,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:42,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:42,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:42,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:42,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:42,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:42,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:42,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:42,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:42,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:42,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:42,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:42,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:42,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:42,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:42,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:42,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:43,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:15:49,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:49,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:49,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:49,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:49,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:49,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:49,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:49,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:49,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:49,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:49,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:49,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:49,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:49,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:49,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:49,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:49,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:15:50,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:50,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:50,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:50,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:50,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:50,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:50,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:50,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:50,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:50,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:50,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:50,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:50,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:50,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:50,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:50,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:50,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:50,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:50,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:50,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:50,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:50,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:50,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:50,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:50,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:50,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:50,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:50,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:50,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:50,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:50,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:50,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:51,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:51,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:51,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:51,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:51,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:51,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:51,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:51,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:51,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:51,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:51,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:51,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:51,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:51,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:51,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:51,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:53,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:15:54,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:15:54,953 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:15:56,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:56,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:56,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:56,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:56,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:56,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:56,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:56,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:56,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:56,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:56,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:56,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:56,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:56,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:56,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:56,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:56,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:56,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:56,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:56,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:56,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:56,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:56,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:56,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:56,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:56,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:56,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:56,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:56,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:56,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:56,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:56,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:57,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:15:58,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:58,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:58,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:58,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:58,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:58,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:58,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:58,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:58,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:58,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:58,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:58,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:58,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:58,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:58,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:15:58,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:01,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:16:02,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:02,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:02,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:02,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:02,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:02,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:02,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:02,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:02,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:02,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:02,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:02,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:02,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:02,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:02,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:02,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:04,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:04,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:04,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:04,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:04,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:04,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:04,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:04,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:04,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:04,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:04,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:04,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:04,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:04,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:04,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:04,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:04,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:04,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:04,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:04,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:04,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:04,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:04,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:04,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:04,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:04,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:04,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:04,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:04,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:04,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:04,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:04,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:05,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:16:07,579 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:16:09,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:16:10,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:16:10,351 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:16:11,846 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:16:16,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:16:20,850 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:16:22,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:22,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:22,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:22,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:22,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:22,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:22,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:22,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:22,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:22,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:22,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:22,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:22,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:22,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:22,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:22,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:16:22,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:16:25,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:16:25,585 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:16:26,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:16:28,854 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:16:32,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:16:34,856 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:16:36,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:16:37,649 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:16:40,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:16:40,825 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:16:40,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:16:42,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:16:44,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:16:48,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:16:50,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:16:52,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:16:54,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:16:56,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:16:56,237 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:16:56,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:17:00,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:17:02,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:17:04,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:17:06,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:17:07,722 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:17:08,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:17:10,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:17:11,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:17:11,529 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:17:12,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:17:14,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:17:16,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:17:17,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:17,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:17,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:17,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:17,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:17,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:17,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:17,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:17,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:17,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:17,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:17,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:17,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:17,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:17,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:17,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:18,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:17:20,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:17:22,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:17:24,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:24,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:24,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:24,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:24,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:24,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:24,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:24,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:24,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:24,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:24,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:24,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:24,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:24,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:24,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:24,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:24,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:17:25,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:25,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:25,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:25,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:25,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:25,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:25,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:25,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:25,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:25,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:25,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:25,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:25,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:25,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:25,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:25,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:26,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:26,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:26,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:26,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:26,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:26,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:26,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:26,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:26,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:26,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:26,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:26,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:26,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:26,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:26,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:26,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:26,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:17:26,757 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:17:26,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:17:26,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:26,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:26,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:26,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:26,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:26,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:26,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:26,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:26,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:26,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:26,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:26,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:26,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:26,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:26,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:26,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:27,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:28,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:28,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:28,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:28,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:28,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:28,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:28,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:28,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:28,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:28,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:28,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:28,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:28,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:28,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:28,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:28,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:28,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:17:29,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:29,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:29,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:29,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:29,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:29,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:29,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:29,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:29,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:29,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:29,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:29,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:29,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:29,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:29,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:29,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:30,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:17:31,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:31,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:31,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:31,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:31,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:31,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:31,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:31,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:31,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:31,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:31,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:31,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:31,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:31,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:31,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:31,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:31,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:31,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:31,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:31,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:31,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:31,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:31,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:31,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:31,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:31,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:31,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:31,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:31,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:31,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:31,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:31,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:32,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:17:33,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:33,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:34,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:17:35,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:35,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:35,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:35,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:35,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:35,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:35,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:35,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:35,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:35,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:35,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:35,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:35,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:35,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:35,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:35,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:35,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:35,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:35,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:35,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:35,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:35,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:35,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:35,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:35,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:35,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:35,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:35,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:35,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:35,973 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 14:17:36,150 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 14:17:36,213 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 14:17:36,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 14:17:36,882 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:17:37,852 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:17:37,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:17:42,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:17:42,023 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:17:44,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:44,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:44,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:44,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:44,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:44,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:44,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:44,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:44,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:44,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:44,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:44,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:44,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:44,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:44,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:44,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:45,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:45,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:45,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:45,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:45,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:45,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:45,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:45,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:45,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:45,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:45,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:45,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:45,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:45,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:45,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:45,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:46,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:17:47,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:47,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:47,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:47,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:47,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:47,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:47,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:47,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:47,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:47,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:47,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:47,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:47,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:47,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:47,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:47,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:52,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:52,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:52,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:52,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:52,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:52,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:52,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:52,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:52,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:52,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:52,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:52,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:52,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:52,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:52,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:52,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:52,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:17:54,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:54,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:54,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:54,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:54,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:54,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:54,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:54,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:54,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:54,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:54,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:54,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:54,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:54,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:54,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:54,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:54,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:54,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:54,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:54,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:54,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:54,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:54,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:54,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:54,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:54,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:54,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:54,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:54,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:54,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:54,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:54,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:55,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:55,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:55,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:55,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:55,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:55,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:55,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:55,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:55,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:55,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:55,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:55,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:55,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:55,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:55,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:55,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:56,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:56,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:56,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:56,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:56,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:56,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:56,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:56,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:56,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:56,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:56,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:56,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:56,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:56,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:56,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:56,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:56,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:17:57,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:57,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:57,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:57,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:57,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:57,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:57,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:57,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:57,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:57,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:57,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:57,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:57,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:57,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:57,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:57,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:17:57,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:17:57,258 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:18:00,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:18:04,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:18:06,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:06,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:06,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:06,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:06,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:06,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:06,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:06,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:06,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:06,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:06,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:06,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:06,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:06,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:06,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:06,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:06,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:06,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:06,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:06,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:06,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:06,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:06,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:06,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:06,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:06,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:06,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:06,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:06,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:06,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:06,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:06,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:07,924 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:18:08,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:08,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:18:12,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:18:12,682 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:18:12,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:18:13,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:13,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:13,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:13,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:13,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:13,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:13,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:13,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:13,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:13,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:13,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:13,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:13,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:13,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:13,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:13,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:13,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:13,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:13,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:13,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:13,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:13,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:13,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:13,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:13,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:13,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:13,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:13,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:13,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:13,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:13,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:13,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:14,900 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:18:19,901 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:18:20,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:20,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:20,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:20,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:20,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:20,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:20,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:20,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:20,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:20,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:20,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:20,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:20,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:20,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:20,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:20,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:21,902 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:18:25,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:18:27,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:18:28,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:18:28,077 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:18:31,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:18:33,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:18:36,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:36,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:36,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:36,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:36,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:36,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:36,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:36,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:36,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:36,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:36,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:36,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:36,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:36,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:36,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:36,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:18:37,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:18:37,997 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:18:39,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:18:41,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:18:43,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:18:43,453 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:18:45,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:18:47,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:18:49,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:18:51,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:18:53,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:18:57,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:18:58,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:18:58,676 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:18:59,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:19:01,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:19:03,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:19:05,921 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:19:07,922 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:19:08,065 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:19:09,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:19:11,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:19:13,925 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:19:14,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:19:14,028 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:19:15,925 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:19:17,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:19:19,927 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:19:21,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:19:23,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:19:25,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:25,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:25,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:25,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:25,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:25,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:25,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:25,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:25,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:25,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:25,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:25,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:25,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:25,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:25,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:25,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:25,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:19:27,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:19:28,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:28,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:28,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:28,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:28,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:28,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:28,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:28,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:28,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:28,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:28,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:28,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:28,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:28,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:28,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:28,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:19:29,244 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:19:29,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:29,932 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:19:30,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:30,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:30,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:30,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:30,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:30,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:30,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:30,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:30,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:30,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:30,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:30,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:30,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:30,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:30,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:30,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:31,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:31,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:31,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:31,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:31,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:31,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:31,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:31,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:31,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:31,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:31,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:31,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:31,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:31,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:31,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:31,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:31,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:31,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:31,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:31,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:31,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:31,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:31,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:31,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:31,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:31,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:31,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:31,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:31,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:31,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:31,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:31,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:31,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:19:32,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:32,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:32,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:32,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:32,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:32,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:32,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:32,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:32,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:32,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:32,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:32,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:32,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:32,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:32,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:32,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:32,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:32,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:32,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:32,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:32,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:32,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:32,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:32,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:32,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:32,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:32,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:32,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:32,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:32,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:32,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:32,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:33,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:33,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:33,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:33,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:33,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:33,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:33,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:33,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:33,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:33,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:33,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:33,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:33,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:33,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:33,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:33,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:33,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:33,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:33,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:33,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:33,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:33,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:33,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:33,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:33,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:33,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:33,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:33,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:33,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:33,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:33,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:33,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:33,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:19:34,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:34,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,935 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:19:35,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:35,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:36,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:36,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:36,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:36,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:36,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:36,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:36,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:36,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:36,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:36,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:36,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:36,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:36,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:36,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:36,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:36,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:36,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:36,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:36,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:36,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:36,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:36,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:36,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:36,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:36,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:36,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:36,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:36,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:37,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:19:38,135 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:19:40,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:40,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:40,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:40,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:40,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:40,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:40,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:40,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:40,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:40,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:40,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:40,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:40,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:40,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:40,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:40,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:44,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:19:44,470 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:19:45,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:45,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:45,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:45,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:45,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:45,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:45,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:45,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:45,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:45,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:45,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:45,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:45,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:45,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:45,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:45,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:47,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:47,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:47,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:47,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:47,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:47,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:47,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:47,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:47,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:47,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:47,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:47,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:47,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:47,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:47,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:47,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:47,940 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:19:50,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:50,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:50,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:50,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:50,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:50,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:50,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:50,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:50,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:50,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:50,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:50,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:50,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:50,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:50,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:50,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:51,942 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:19:52,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:52,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:52,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:52,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:52,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:52,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:52,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:52,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:52,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:52,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:52,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:52,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:52,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:52,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:52,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:52,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:53,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:53,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:53,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:53,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:53,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:53,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:53,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:53,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:53,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:53,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:53,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:53,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:53,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:53,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:53,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:53,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:55,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:55,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:55,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:55,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:55,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:55,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:55,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:55,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:55,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:55,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:55,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:55,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:55,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:55,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:55,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:55,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:55,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:55,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:55,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:55,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:55,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:55,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:55,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:55,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:55,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:55,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:55,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:55,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:55,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:55,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:55,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:55,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:57,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:57,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:57,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:57,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:57,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:57,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:57,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:57,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:57,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:57,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:57,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:57,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:57,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:57,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:57,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:57,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:57,944 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:19:59,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:59,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:59,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:59,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:59,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:59,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:59,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:59,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:59,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:59,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:59,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:59,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:59,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:59,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:59,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:59,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:19:59,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:19:59,707 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:20:00,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:00,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:00,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:00,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:00,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:00,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:00,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:00,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:00,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:00,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:00,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:00,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:00,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:00,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:00,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:00,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:01,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:01,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:01,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:01,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:01,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:01,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:01,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:01,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:01,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:01,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:01,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:01,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:01,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:01,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:01,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:01,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:01,945 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:20:04,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:04,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:04,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:04,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:04,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:04,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:04,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:04,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:04,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:04,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:04,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:04,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:04,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:04,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:04,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:04,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:05,947 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:20:06,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:06,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:06,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:06,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:06,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:06,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:06,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:06,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:06,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:06,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:06,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:06,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:06,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:06,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:06,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:06,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:07,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:07,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:07,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:07,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:07,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:07,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:07,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:07,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:07,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:07,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:07,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:07,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:07,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:07,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:07,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:07,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:08,209 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:20:09,949 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:20:11,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:11,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:11,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:11,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:11,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:11,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:11,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:11,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:11,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:11,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:11,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:11,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:11,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:11,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:11,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:11,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:11,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:11,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:11,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:11,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:11,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:11,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:11,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:11,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:11,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:11,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:11,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:11,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:11,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:11,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:11,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:11,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:13,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:13,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:13,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:13,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:13,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:13,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:13,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:13,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:13,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:13,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:13,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:13,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:13,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:13,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:13,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:13,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:13,951 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:20:14,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:20:14,929 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:20:15,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:15,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:15,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:15,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:15,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:15,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:15,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:15,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:15,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:15,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:15,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:15,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:15,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:15,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:15,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:15,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:16,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:16,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:16,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:16,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:16,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:16,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:16,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:16,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:16,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:16,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:16,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:16,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:16,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:16,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:16,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:16,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:16,952 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:20:18,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:18,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:18,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:18,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:18,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:18,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:18,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:18,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:18,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:18,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:18,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:18,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:18,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:18,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:18,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:18,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:20,954 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:20:22,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:22,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:22,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:22,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:22,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:22,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:22,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:22,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:22,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:22,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:22,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:22,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:22,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:22,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:22,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:22,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:24,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:24,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:24,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:24,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:24,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:24,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:24,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:24,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:24,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:24,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:24,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:24,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:24,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:24,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:24,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:24,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:24,956 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:20:26,956 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:20:30,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:20:30,194 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:20:30,958 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:20:32,959 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:20:34,960 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:20:38,286 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:20:38,961 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:20:40,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:20:42,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:42,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:42,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:42,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:42,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:42,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:42,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:42,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:42,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:42,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:42,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:42,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:42,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:42,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:42,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:42,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:20:42,963 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:20:45,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:20:45,521 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:20:46,964 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:20:48,965 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:20:50,966 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:20:52,967 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:20:54,967 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:20:56,968 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:21:00,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:21:00,751 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:21:00,970 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:21:02,971 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:21:04,972 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:21:06,973 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:21:08,356 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:21:08,974 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:21:10,975 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:21:12,975 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:21:14,976 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:21:15,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:21:15,977 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:21:16,978 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:21:18,979 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:21:20,980 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:21:22,981 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:21:24,981 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:21:26,982 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:21:28,983 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:21:29,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:29,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:29,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:29,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:29,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:29,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:29,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:29,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:29,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:29,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:29,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:29,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:29,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:29,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:29,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:29,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:30,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:30,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:30,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:30,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:30,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:30,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:30,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:30,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:30,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:30,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:30,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:30,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:30,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:30,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:30,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:30,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:30,984 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:21:31,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:21:31,202 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:21:31,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:31,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:31,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:31,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:31,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:31,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:31,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:31,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:31,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:31,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:31,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:31,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:31,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:31,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:31,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:31,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:32,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:32,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:32,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:32,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:32,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:32,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:32,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:32,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:32,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:32,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:32,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:32,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:32,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:32,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:32,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:32,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:32,985 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:21:33,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:33,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:34,986 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:21:35,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:35,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:36,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:36,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:36,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:36,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:36,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:36,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:36,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:36,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:36,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:36,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:36,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:36,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:36,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:36,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:36,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:36,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:36,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:36,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:36,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:36,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:36,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:36,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:36,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:36,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:36,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:36,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:36,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:36,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:36,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:36,686 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 14:21:36,908 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 14:21:36,975 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 14:21:36,987 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 14:21:37,987 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:21:38,479 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:21:38,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:21:39,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:21:40,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:40,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:40,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:40,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:40,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:40,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:40,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:40,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:41,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:41,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:41,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:41,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:41,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:41,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:41,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:41,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:42,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:42,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:42,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:42,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:42,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:42,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:42,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:42,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:42,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:42,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:42,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:42,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:42,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:42,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:42,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:42,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:42,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:42,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:42,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:42,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:42,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:42,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:42,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:42,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:42,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:42,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:42,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:42,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:42,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:42,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:42,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:42,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:45,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:45,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:45,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:45,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:45,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:45,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:45,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:45,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:45,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:45,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:45,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:45,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:45,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:45,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:45,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:45,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:46,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:46,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:46,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:46,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:46,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:46,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:46,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:46,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:46,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:46,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:46,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:46,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:46,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:46,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:46,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:46,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:46,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:21:46,425 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:21:46,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:46,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:46,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:46,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:46,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:46,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:46,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:46,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:46,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:46,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:46,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:46,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:46,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:46,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:46,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:46,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:47,991 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:21:49,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:49,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:49,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:49,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:49,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:49,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:49,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:49,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:49,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:49,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:49,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:49,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:49,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:49,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:49,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:49,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:52,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:52,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:52,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:52,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:52,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:52,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:52,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:52,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:52,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:52,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:52,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:52,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:52,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:52,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:52,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:52,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:53,994 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:21:54,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:54,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:56,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:56,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:56,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:56,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:56,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:56,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:56,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:56,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:56,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:56,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:56,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:56,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:56,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:56,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:56,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:56,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:56,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:56,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:56,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:56,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:56,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:56,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:56,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:56,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:56,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:56,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:56,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:56,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:56,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:56,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:56,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:56,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:57,995 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:21:58,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:21:58,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:01,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:22:01,771 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:22:01,997 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:22:03,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:03,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:03,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:03,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:03,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:03,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:03,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:03,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:03,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:03,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:03,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:03,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:03,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:03,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:03,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:03,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:04,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:04,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:04,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:04,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:04,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:04,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:04,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:04,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:04,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:04,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:04,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:04,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:04,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:04,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:04,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:04,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:04,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:04,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:04,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:04,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:04,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:04,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:04,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:04,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:04,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:04,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:04,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:04,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:04,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:04,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:04,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:04,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:05,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:05,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:05,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:05,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:05,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:05,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:05,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:05,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:05,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:05,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:05,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:05,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:05,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:05,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:05,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:05,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:05,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:22:08,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:08,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:08,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:08,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:08,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:08,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:08,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:08,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:08,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:08,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:08,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:08,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:08,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:08,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:08,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:08,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:08,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:08,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:08,556 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:22:08,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:08,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:08,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:08,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:08,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:08,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:08,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:08,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:08,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:08,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:08,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:08,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:08,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:08,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:10,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:22:10,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:10,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:10,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:10,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:10,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:10,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:10,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:10,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:10,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:10,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:10,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:10,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:10,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:10,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:10,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:10,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:12,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:12,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:12,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:12,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:12,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:12,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:12,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:12,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:12,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:12,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:12,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:12,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:12,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:12,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:12,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:12,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:13,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:13,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:13,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:13,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:13,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:13,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:13,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:13,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:13,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:13,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:13,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:13,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:13,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:13,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:13,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:13,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:14,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:22:15,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:15,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:15,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:15,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:15,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:15,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:15,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:15,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:15,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:15,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:15,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:15,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:15,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:15,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:15,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:15,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:17,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:22:17,016 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:22:18,004 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:22:19,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:19,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:19,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:19,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:19,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:19,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:19,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:19,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:19,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:19,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:19,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:19,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:19,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:19,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:19,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:19,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:20,004 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:22:20,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:20,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:20,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:20,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:20,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:20,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:20,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:20,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:20,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:20,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:20,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:20,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:20,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:20,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:20,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:20,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:22,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:22,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:22,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:22,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:22,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:22,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:22,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:22,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:22,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:22,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:22,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:22,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:22,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:22,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:22,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:22,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:24,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:22:24,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:24,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:24,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:24,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:24,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:24,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:24,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:24,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:24,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:24,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:24,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:24,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:24,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:24,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:24,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:24,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:28,008 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:22:30,009 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:22:32,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:22:32,372 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:22:33,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:33,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:33,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:33,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:33,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:33,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:33,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:33,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:33,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:33,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:33,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:33,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:33,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:33,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:33,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:33,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:33,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:33,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:33,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:33,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:33,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:33,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:33,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:33,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:33,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:33,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:33,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:33,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:33,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:33,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:33,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:33,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:34,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:22:34,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:34,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:34,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:34,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:34,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:34,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:34,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:34,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:34,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:34,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:34,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:34,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:34,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:34,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:34,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:34,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:37,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:22:38,632 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:22:41,013 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:22:43,014 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:22:45,015 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:22:47,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:22:47,609 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:22:49,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:22:51,017 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:22:53,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:22:55,019 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:22:56,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:56,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:56,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:56,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:56,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:56,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:56,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:56,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:56,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:56,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:56,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:56,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:56,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:56,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:56,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:56,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:22:57,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:23:01,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:23:02,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:23:02,932 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:23:03,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:23:05,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:23:07,025 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:23:08,709 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:23:09,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:23:11,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:23:13,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:23:15,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:23:17,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:23:18,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:23:18,203 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:23:19,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:23:21,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:23:23,031 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:23:25,032 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:23:27,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:23:29,034 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:23:31,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:23:32,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:32,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:32,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:32,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:32,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:32,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:32,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:32,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:32,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:32,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:32,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:32,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:32,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:32,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:32,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:32,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:33,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:23:33,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:23:33,457 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:23:33,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:33,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:33,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:33,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:33,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:33,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:33,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:33,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:33,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:33,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:33,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:33,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:33,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:33,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:33,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:33,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:35,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:23:35,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:35,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:35,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:35,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:35,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:35,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:35,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:35,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:35,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:35,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:35,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:35,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:35,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:35,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:35,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:35,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:36,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:36,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:36,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:36,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:36,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:36,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:36,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:36,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:36,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:36,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:36,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:36,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:36,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:36,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:36,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:36,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:23:37,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:37,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,781 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:23:38,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:38,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:39,038 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:23:41,039 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:23:43,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:43,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:43,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:43,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:43,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:43,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:43,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:43,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:43,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:43,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:43,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:43,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:43,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:43,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:43,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:43,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:48,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:23:48,731 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:23:48,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:48,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:48,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:48,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:48,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:48,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:48,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:48,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:48,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:48,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:48,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:48,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:48,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:48,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:48,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:48,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:51,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:23:51,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:51,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:51,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:51,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:51,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:51,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:51,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:51,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:51,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:51,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:51,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:51,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:51,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:51,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:51,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:51,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:53,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:53,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:53,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:53,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:53,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:53,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:53,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:53,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:53,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:53,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:53,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:53,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:53,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:53,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:53,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:53,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:57,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:23:58,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:58,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:59,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:59,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:59,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:59,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:59,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:59,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:59,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:59,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:59,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:59,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:59,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:59,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:59,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:59,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:59,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:23:59,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:01,047 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:24:02,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:02,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:24:04,442 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:24:04,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:04,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:05,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:05,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:05,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:05,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:05,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:05,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:05,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:05,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:05,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:05,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:05,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:24:06,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:06,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:06,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:06,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:06,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:06,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:06,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:06,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:06,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:06,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:06,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:06,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:06,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:06,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:06,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:06,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:08,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:08,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:08,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:08,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:08,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:08,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:08,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:08,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:08,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:08,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:08,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:08,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:08,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:08,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:08,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:08,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:08,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:08,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:08,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:08,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:08,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:08,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:08,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:08,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:08,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:08,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:08,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:08,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:08,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:08,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:08,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:08,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:08,855 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:24:09,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:24:10,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:10,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:10,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:10,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:10,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:10,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:10,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:10,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:10,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:10,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:10,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:10,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:10,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:10,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:10,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:10,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:12,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:12,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:12,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:12,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:12,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:12,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:12,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:12,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:12,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:12,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:12,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:12,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:12,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:12,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:12,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:12,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:12,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:12,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:12,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:12,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:12,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:12,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:12,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:12,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:12,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:12,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:12,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:12,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:12,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:12,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:12,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:12,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:24:13,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:13,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:17,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:24:17,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:17,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:17,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:17,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:17,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:17,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:17,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:17,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:17,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:17,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:17,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:17,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:17,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:17,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:17,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:17,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:18,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:18,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:18,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:18,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:18,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:18,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:18,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:18,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:18,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:18,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:18,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:18,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:18,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:18,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:18,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:18,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:19,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:24:19,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:24:19,766 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:24:20,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:20,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:20,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:20,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:20,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:20,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:20,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:20,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:20,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:20,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:20,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:20,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:20,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:20,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:20,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:20,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:23,056 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:24:23,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:23,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:23,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:23,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:23,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:23,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:23,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:23,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:23,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:23,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:23,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:23,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:23,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:23,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:23,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:23,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:24,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:24,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:24,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:24,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:24,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:24,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:24,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:24,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:24,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:24,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:24,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:24,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:24,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:24,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:24,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:24,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:25,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:24:28,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:28,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:28,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:28,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:28,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:28,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:28,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:28,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:28,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:28,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:28,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:28,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:28,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:28,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:28,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:28,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:29,059 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:24:29,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:29,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:29,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:29,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:29,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:29,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:29,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:29,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:29,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:29,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:29,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:29,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:29,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:29,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:29,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:29,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:31,060 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:24:31,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:31,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:31,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:31,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:31,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:31,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:31,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:31,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:31,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:31,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:31,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:31,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:31,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:31,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:31,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:31,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:32,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:32,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:32,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:32,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:32,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:32,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:32,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:32,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:33,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:33,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:33,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:33,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:33,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:33,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:33,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:33,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:34,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:34,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:34,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:34,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:34,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:34,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:34,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:34,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:34,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:34,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:34,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:34,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:34,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:34,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:34,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:34,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:35,061 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:24:35,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:24:35,122 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:24:37,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:24:37,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:37,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:37,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:37,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:37,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:37,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:37,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:37,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:37,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:37,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:37,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:37,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:37,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:37,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:37,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:37,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:38,929 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:24:41,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:24:42,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:42,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:42,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:42,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:42,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:42,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:42,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:42,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:42,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:42,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:42,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:42,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:42,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:42,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:42,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:42,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:44,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:24:46,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:24:50,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:24:50,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:24:50,386 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:24:52,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:24:54,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:24:56,071 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:24:58,071 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:24:59,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:59,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:59,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:59,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:59,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:59,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:59,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:59,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:59,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:59,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:59,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:59,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:59,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:59,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:59,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:24:59,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:02,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:25:04,074 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:25:05,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:25:05,726 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:25:06,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:25:08,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:25:08,998 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:25:10,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:25:12,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:25:14,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:25:16,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:25:18,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:25:20,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:25:21,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:25:21,095 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:25:22,081 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:25:24,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:25:26,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:25:28,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:25:30,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:25:32,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:25:34,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:25:36,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:25:36,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:36,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:36,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:36,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:36,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:36,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:36,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:36,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:36,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:36,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:36,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:36,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:36,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:36,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:36,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:36,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:36,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:25:36,325 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:25:36,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:36,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:36,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:36,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:36,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:36,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:36,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:36,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:36,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:36,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:36,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:36,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:36,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:36,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:36,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:36,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:38,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:25:38,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:38,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:38,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:38,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:38,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:38,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:38,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:38,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:38,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:38,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:38,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:38,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:38,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:38,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:38,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:38,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:38,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:38,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:38,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:38,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:38,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:38,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:38,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:38,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:38,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:38,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:38,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:38,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:38,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:38,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:38,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:38,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:39,066 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:25:39,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:39,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:39,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:39,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:40,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:40,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:40,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:40,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:40,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:40,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:40,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:40,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:40,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:25:40,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:40,332 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 14:25:40,583 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 14:25:40,661 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 14:25:41,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 14:25:42,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:25:43,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:43,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:43,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:43,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:43,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:43,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:43,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:43,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:43,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:43,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:43,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:43,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:43,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:43,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:43,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:43,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:43,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:43,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:43,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:43,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:43,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:43,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:43,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:43,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:43,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:43,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:43,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:43,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:43,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:43,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:43,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:43,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:44,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:44,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:44,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:44,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:44,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:44,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:44,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:44,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:44,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:44,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:44,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:44,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:44,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:44,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:44,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:44,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:45,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:45,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:45,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:45,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:45,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:45,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:45,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:45,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:45,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:45,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:45,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:45,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:45,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:45,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:45,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:45,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:51,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:25:51,593 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:25:51,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:51,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:51,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:51,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:51,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:51,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:51,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:51,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:51,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:51,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:51,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:51,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:51,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:51,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:51,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:51,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:51,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:51,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:51,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:51,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:51,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:51,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:51,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:51,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:51,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:51,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:51,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:51,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:51,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:51,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:51,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:51,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:52,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:25:54,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:54,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:54,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:54,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:54,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:54,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:54,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:54,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:54,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:54,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:54,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:54,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:54,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:54,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:54,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:54,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:54,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:54,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:54,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:54,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:54,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:54,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:54,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:54,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:54,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:54,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:54,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:54,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:54,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:54,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:54,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:54,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:25:58,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:26:01,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:01,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:01,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:01,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:01,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:01,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:01,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:01,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:01,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:01,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:01,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:01,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:01,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:01,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:01,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:01,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:02,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:26:03,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:03,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:03,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:03,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:03,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:03,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:03,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:03,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:03,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:03,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:03,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:03,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:03,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:03,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:03,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:03,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:06,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:26:06,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:26:06,846 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:26:07,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:07,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:07,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:07,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:07,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:07,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:07,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:07,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:07,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:07,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:07,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:07,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:07,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:07,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:07,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:07,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,166 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:26:09,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:09,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:10,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:26:11,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:11,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:11,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:11,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:11,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:11,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:11,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:11,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:11,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:11,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:11,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:11,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:11,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:11,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:11,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:11,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:13,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:14,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:26:15,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:15,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:15,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:15,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:15,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:15,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:15,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:15,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:15,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:15,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:15,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:15,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:15,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:15,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:15,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:15,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:15,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:15,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:15,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:15,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:15,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:15,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:15,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:15,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:15,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:15,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:15,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:15,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:15,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:15,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:15,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:15,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:17,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:17,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:17,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:17,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:17,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:17,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:17,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:17,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:17,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:17,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:17,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:17,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:17,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:17,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:17,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:17,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:26:18,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:18,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:26:20,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:20,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:22,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:26:22,079 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:26:23,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:23,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:23,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:23,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:23,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:23,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:23,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:23,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:23,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:23,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:23,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:23,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:23,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:23,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:23,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:23,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:24,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:26:26,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:26,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:26,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:26,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:26,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:26,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:26,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:26,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:26,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:26,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:26,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:26,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:26,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:26,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:26,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:26,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:28,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:26:29,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:29,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:29,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:29,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:29,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:29,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:29,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:29,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:29,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:29,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:29,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:29,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:29,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:29,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:29,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:29,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:29,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:29,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:29,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:29,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:29,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:29,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:29,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:29,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:29,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:29,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:29,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:29,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:29,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:29,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:29,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:29,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:30,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:26:31,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:31,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:31,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:31,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:31,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:31,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:31,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:31,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:31,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:31,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:31,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:31,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:31,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:31,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:31,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:31,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:34,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:26:34,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:34,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:34,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:34,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:34,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:34,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:34,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:34,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:34,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:34,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:34,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:34,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:34,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:34,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:34,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:34,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:35,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:35,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:35,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:35,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:35,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:35,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:35,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:35,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:35,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:35,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:35,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:35,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:35,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:35,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:35,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:35,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:36,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:26:37,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:26:37,306 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:26:37,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:37,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:37,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:37,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:37,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:37,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:37,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:37,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:37,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:37,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:37,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:37,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:37,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:37,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:37,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:37,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:38,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:38,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:38,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:38,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:38,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:38,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:38,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:38,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:38,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:38,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:38,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:38,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:38,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:38,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:38,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:38,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:39,240 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:26:40,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:26:40,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:40,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:40,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:40,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:40,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:40,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:40,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:40,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:40,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:40,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:40,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:40,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:40,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:40,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:40,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:40,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:42,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:26:43,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:43,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:43,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:43,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:43,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:43,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:43,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:43,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:43,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:43,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:43,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:43,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:43,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:43,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:43,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:43,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:44,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:26:48,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:26:48,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:48,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:48,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:48,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:48,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:48,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:48,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:48,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:48,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:48,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:48,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:48,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:48,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:48,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:48,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:48,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:26:50,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:26:52,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:26:52,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:26:52,531 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:26:54,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:26:58,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:27:00,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:27:02,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:27:03,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:03,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:03,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:03,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:03,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:03,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:03,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:03,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:03,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:03,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:03,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:03,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:03,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:03,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:03,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:03,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:04,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:27:06,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:27:07,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:27:07,866 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:27:08,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:27:09,314 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:27:10,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:27:12,128 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:27:14,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:27:16,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:27:18,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:27:20,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:27:22,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:27:23,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:27:23,089 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:27:24,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:27:26,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:27:28,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:27:30,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:27:32,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:27:34,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:27:36,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:27:37,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:37,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:37,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:37,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:37,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:37,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:37,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:37,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:37,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:37,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:37,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:37,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:37,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:37,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:37,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:37,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:38,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:38,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:38,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:38,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:38,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:38,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:38,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:38,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:38,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:38,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:38,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:38,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:38,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:38,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:38,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:38,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:38,140 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:27:38,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:27:38,387 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:27:39,389 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:27:39,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:39,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:39,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:39,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:39,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:39,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:39,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:39,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:39,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:39,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:39,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:39,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:39,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:39,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:39,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:39,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:39,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:39,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:39,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:39,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:39,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:39,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:39,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:39,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:39,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:39,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:39,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:39,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:40,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:27:42,142 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:27:52,146 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:27:53,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:53,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:53,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:53,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:53,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:53,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:53,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:53,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:53,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:53,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:53,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:53,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:53,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:53,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:53,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:53,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:53,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:27:53,609 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:27:55,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:55,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:57,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:57,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:57,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:57,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:57,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:57,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:57,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:57,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:57,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:57,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:57,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:57,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:57,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:57,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:57,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:57,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:58,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:27:58,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:58,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:58,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:58,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:58,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:58,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:58,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:58,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:58,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:58,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:58,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:58,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:58,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:58,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:58,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:27:58,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:00,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:00,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:00,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:00,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:00,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:00,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:00,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:00,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:00,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:00,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:00,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:00,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:00,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:00,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:00,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:00,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:02,150 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:28:02,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:02,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:02,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:02,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:02,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:02,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:02,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:02,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:02,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:02,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:02,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:02,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:02,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:02,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:02,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:02,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:04,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:04,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:04,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:04,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:04,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:04,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:04,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:04,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:04,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:04,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:04,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:04,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:04,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:04,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:04,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:04,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:06,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:28:07,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:07,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:07,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:07,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:07,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:07,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:07,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:07,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:07,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:07,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:07,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:07,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:07,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:07,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:07,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:07,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:09,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:28:09,040 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:28:09,463 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:28:10,153 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:28:14,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:28:14,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:14,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:14,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:14,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:14,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:14,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:14,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:14,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:14,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:14,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:14,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:14,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:14,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:14,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:14,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:14,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:16,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:17,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:17,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:17,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:17,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:17,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:17,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:17,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:17,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:17,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:17,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:17,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:17,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:17,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:17,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:17,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:17,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:18,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:28:18,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:18,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:18,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:18,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:18,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:18,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:18,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:18,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:18,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:18,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:18,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:18,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:18,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:18,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:18,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:18,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:19,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:19,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:19,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:19,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:19,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:19,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:19,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:19,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:19,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:19,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:19,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:19,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:19,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:19,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:19,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:19,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:19,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:19,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:19,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:19,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:19,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:19,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:19,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:19,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:19,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:19,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:19,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:19,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:19,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:19,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:19,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:19,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:20,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:20,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:20,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:20,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:20,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:20,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:20,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:20,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:20,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:20,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:20,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:20,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:20,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:20,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:20,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:20,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:21,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:23,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:28:23,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:23,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:23,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:23,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:23,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:23,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:23,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:23,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:23,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:23,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:23,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:23,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:23,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:23,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:23,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:23,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:24,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:28:24,292 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:28:24,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:24,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:24,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:24,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:24,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:24,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:24,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:24,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:24,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:24,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:24,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:24,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:24,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:24,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:24,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:24,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:25,159 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:28:26,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:26,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:27,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:27,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:27,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:27,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:27,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:27,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:27,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:27,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:27,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:27,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:27,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:27,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:27,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:27,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:27,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:27,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:29,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:28:29,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:29,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:29,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:29,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:29,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:29,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:29,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:29,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:29,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:29,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:29,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:29,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:29,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:29,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:29,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:29,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:29,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:29,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:29,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:29,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:29,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:29,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:29,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:29,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:29,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:29,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:29,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:29,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:29,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:29,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:29,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:29,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:31,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:31,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:31,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:31,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:31,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:31,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:31,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:31,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:31,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:31,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:31,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:31,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:31,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:31,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:31,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:31,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:32,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:32,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:32,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:32,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:32,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:32,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:32,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:32,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:32,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:32,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:32,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:32,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:32,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:32,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:32,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:32,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:33,163 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:28:35,163 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:28:35,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:35,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:35,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:35,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:35,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:35,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:35,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:35,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:35,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:35,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:35,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:35,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:35,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:35,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:35,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:35,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:35,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:35,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:35,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:35,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:35,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:35,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:35,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:35,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:35,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:35,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:35,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:35,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:35,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:35,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:35,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:35,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:38,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:39,165 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:28:39,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:28:39,515 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:28:39,738 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:28:39,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:39,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:39,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:39,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:39,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:39,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:39,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:39,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:39,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:39,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:39,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:39,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:39,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:39,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:39,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:39,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:41,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:28:42,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:42,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:42,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:42,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:42,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:42,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:42,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:42,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:42,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:42,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:42,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:42,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:42,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:42,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:42,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:42,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:43,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:28:45,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:45,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:45,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:45,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:45,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:45,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:45,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:45,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:45,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:45,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:45,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:45,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:45,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:45,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:45,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:45,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:47,168 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:28:47,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:47,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:47,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:47,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:48,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:48,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:48,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:48,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:48,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:48,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:48,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:48,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:48,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:48,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:48,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:48,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:48,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:48,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:48,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:48,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:48,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:48,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:48,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:48,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:48,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:48,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:48,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:48,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:48,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:48,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:48,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:48,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:49,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:28:50,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:50,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:50,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:50,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:50,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:50,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:50,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:50,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:50,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:50,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:50,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:50,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:50,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:50,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:50,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:50,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:28:51,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:28:53,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:28:54,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:28:54,740 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:28:55,172 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:28:59,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:29:01,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:29:03,175 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:29:05,175 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:29:07,176 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:29:09,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:09,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:09,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:09,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:09,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:09,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:09,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:09,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:09,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:09,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:09,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:09,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:09,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:09,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:09,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:09,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:09,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:29:09,612 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:29:09,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:29:09,957 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:29:11,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:29:13,179 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:29:15,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:29:17,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:29:19,182 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:29:21,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:29:23,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:29:25,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:29:25,183 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:29:25,186 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:29:27,187 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:29:29,188 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:29:31,189 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:29:33,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:29:35,191 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:29:37,191 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:29:39,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,192 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:29:39,689 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:29:39,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:39,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:40,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 14:29:40,248 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 14:29:40,371 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 14:29:40,429 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 14:29:40,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:29:40,463 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:29:41,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 14:29:41,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:29:42,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:29:43,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:29:45,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:29:47,270 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:29:49,270 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:29:51,271 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:29:53,272 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:29:55,273 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:29:55,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:29:55,688 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:29:57,274 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:29:59,275 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:30:01,276 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:30:03,277 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:30:05,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:30:07,279 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:30:09,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:30:09,802 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:30:11,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:30:11,189 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:30:11,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:30:13,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:30:15,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:30:18,283 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:30:20,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:30:22,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:30:24,285 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:30:26,286 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:30:26,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:30:26,420 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:30:28,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:30:30,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:30:32,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:30:34,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:30:36,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:30:38,290 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:30:39,876 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:30:40,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:30:41,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:30:41,648 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:30:42,292 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:30:44,292 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:30:46,293 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:30:48,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:30:50,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:30:52,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:30:54,296 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:30:56,297 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:30:57,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:30:57,159 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:30:58,298 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:31:00,298 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:31:02,299 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:31:04,300 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:31:06,300 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:31:08,301 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:31:09,951 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:31:10,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:31:12,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:31:12,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:31:12,382 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:31:14,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:31:17,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:31:19,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:31:21,306 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:31:23,306 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:31:25,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:31:27,308 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:31:27,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:31:27,735 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:31:29,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:31:31,310 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:31:33,310 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:31:35,311 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:31:37,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:31:39,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:31:40,024 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:31:41,313 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:31:42,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:31:42,962 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:31:43,314 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:31:45,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:31:47,316 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:31:49,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:31:51,318 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:31:53,318 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:31:55,319 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:31:57,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:31:58,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:31:58,249 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:31:59,321 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:32:01,322 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:32:03,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:32:05,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:32:07,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:32:09,326 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:32:10,100 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:32:11,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:32:13,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:32:13,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:32:13,507 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:32:15,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:32:17,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:32:19,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:32:21,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:32:23,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:32:25,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:32:27,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:32:28,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:32:28,762 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:32:30,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:32:32,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:32:34,335 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:32:36,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:32:38,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:32:40,176 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:32:40,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:32:42,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:32:44,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:32:44,064 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:32:44,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:32:46,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:32:48,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:32:50,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:32:52,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:32:54,342 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:32:56,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:32:58,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:32:59,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:32:59,336 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:33:00,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:33:02,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:33:04,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:33:06,346 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:33:08,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:33:10,248 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:33:10,348 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:33:12,348 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:33:14,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:33:14,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:33:14,638 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:33:16,350 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:33:18,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:33:20,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:33:22,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:33:24,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:33:26,354 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:33:28,354 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:33:29,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:33:29,974 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:33:30,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:33:32,356 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:33:34,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:33:36,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:33:38,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:33:40,323 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:33:40,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:33:42,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:33:44,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:33:45,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:33:45,198 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:33:46,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:33:48,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:33:50,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:33:52,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:33:54,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:33:56,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:33:58,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:34:00,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:34:00,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:34:00,466 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:34:02,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:34:05,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:34:07,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:34:09,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:34:10,398 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:34:11,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:34:13,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:34:15,371 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:34:15,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:34:15,690 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:34:17,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:34:19,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:34:21,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:34:23,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:34:25,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:34:27,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:34:29,376 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:34:30,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:34:30,912 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:34:31,377 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:34:33,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:34:35,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:34:37,379 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:34:39,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:34:40,470 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:34:41,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:34:43,381 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:34:45,382 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:34:46,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:34:46,181 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:34:47,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:34:49,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:34:51,384 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:34:53,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:34:56,387 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:34:58,387 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:35:00,388 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:35:01,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:35:01,479 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:35:02,389 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:35:04,389 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:35:06,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:35:08,391 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:35:10,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:35:10,547 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:35:12,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:35:14,393 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:35:16,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:35:16,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:35:16,863 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:35:18,395 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:35:20,396 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:35:22,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:35:24,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:35:26,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:35:28,399 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:35:30,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:35:32,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:35:32,110 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:35:32,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:35:34,402 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:35:36,402 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:35:38,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:35:40,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:35:40,622 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:35:42,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:35:44,406 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:35:46,407 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:35:47,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:35:47,418 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:35:48,407 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:35:50,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:35:52,409 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:35:54,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:35:56,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:35:58,411 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:36:00,412 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:36:02,413 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:36:02,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:36:02,694 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:36:04,414 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:36:06,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:36:08,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:36:10,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:36:10,698 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:36:12,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:36:15,419 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:36:17,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:36:17,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:36:17,968 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:36:19,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:36:21,421 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:36:23,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:36:25,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:36:27,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:36:29,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:36:31,425 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:36:33,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:36:33,260 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:36:33,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:36:35,427 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:36:37,428 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:36:39,429 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:36:40,770 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:36:41,430 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:36:43,431 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:36:45,432 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:36:47,433 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:36:48,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:36:48,484 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:36:49,434 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:36:51,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:36:53,436 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:36:55,437 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:36:57,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:36:59,439 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:37:01,440 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:37:03,441 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:37:03,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:37:03,780 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:37:05,442 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:37:07,443 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:37:09,443 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:37:10,845 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:37:11,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:37:13,445 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:37:15,446 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:37:17,447 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:37:19,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:37:19,220 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:37:19,448 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:37:21,449 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:37:23,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:37:25,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:37:27,451 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:37:29,452 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:37:31,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:37:33,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:37:34,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:37:34,440 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:37:35,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:37:37,455 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:37:39,456 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:37:40,918 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:37:41,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:37:43,458 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:37:45,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:37:47,460 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:37:49,461 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:37:49,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:37:49,762 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:37:51,461 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:37:53,462 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:37:56,464 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:37:58,465 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:38:00,466 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:38:02,467 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:38:04,468 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:38:04,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:38:04,996 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:38:06,468 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:38:08,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:38:10,470 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:38:10,993 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:38:12,471 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:38:14,472 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:38:16,473 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:38:18,474 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:38:20,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:38:20,219 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:38:20,475 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:38:22,476 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:38:24,477 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:38:26,478 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:38:28,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:38:30,480 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:38:32,480 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:38:34,481 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:38:35,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:38:35,440 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:38:36,482 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:38:38,483 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:38:40,484 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:38:41,067 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:38:42,485 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:38:44,486 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:38:46,486 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:38:48,487 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:38:50,488 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:38:50,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:38:50,917 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:38:52,489 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:38:54,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:38:56,493 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:38:58,493 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:39:00,494 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:39:02,495 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:39:05,496 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:39:06,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:39:06,598 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:39:07,497 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:39:09,498 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:39:11,143 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:39:11,499 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:39:13,500 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:39:15,501 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:39:17,502 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:39:19,502 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:39:21,503 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:39:21,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:39:21,820 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:39:23,504 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:39:25,505 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:39:27,506 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:39:29,506 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:39:31,507 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:39:33,508 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:39:35,509 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:39:37,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:39:37,151 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:39:37,510 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:39:39,511 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:39:41,215 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:39:41,512 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:39:43,513 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:39:45,514 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:39:47,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:39:49,516 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:39:51,517 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:39:52,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:39:52,377 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:39:53,517 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:39:55,518 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:39:57,519 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:39:59,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:40:01,521 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:40:03,522 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:40:05,523 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:40:07,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:40:07,635 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:40:08,524 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:40:10,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:40:11,289 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:40:12,526 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:40:14,527 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:40:16,528 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:40:18,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:40:20,530 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:40:22,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:40:22,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:40:22,906 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:40:24,532 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:40:26,532 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:40:28,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:40:30,534 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:40:32,535 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:40:34,536 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:40:36,537 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:40:38,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:40:38,324 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:40:38,538 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:40:40,539 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:40:41,364 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:40:42,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:40:44,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:40:46,541 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:40:48,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:40:50,543 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:40:52,544 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:40:53,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:40:53,584 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:40:54,545 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:40:56,545 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:40:58,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:41:00,547 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:41:02,547 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:41:04,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:41:06,549 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:41:08,549 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:41:08,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:41:08,894 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:41:10,550 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:41:11,436 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:41:12,551 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:41:14,552 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:41:16,552 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:41:18,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:41:20,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:41:22,555 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:41:24,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:41:24,129 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:41:24,555 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:41:26,556 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:41:28,557 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:41:30,558 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:41:32,558 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:41:35,559 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:41:37,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:41:39,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:41:39,353 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:41:39,561 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:41:41,509 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:41:41,562 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:41:43,562 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:41:45,563 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:41:47,564 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:41:49,564 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:41:51,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:41:53,567 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:41:54,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:41:54,750 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:41:55,567 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:41:57,568 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:41:59,569 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:42:01,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:42:03,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:42:05,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:42:07,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:42:09,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:42:10,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:42:10,036 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:42:11,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:42:11,584 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:42:13,574 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:42:15,574 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:42:17,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:42:19,576 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:42:21,576 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:42:23,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:42:25,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:42:25,329 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:42:25,578 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:42:27,578 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:42:29,579 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:42:31,580 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:42:34,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:42:36,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:42:38,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:42:40,583 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:42:40,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:42:40,712 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:42:41,651 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:42:42,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:42:44,585 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:42:46,585 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:42:48,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:42:50,587 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:42:52,587 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:42:54,588 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:42:55,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:42:55,935 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:42:56,589 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:42:58,589 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:43:00,590 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:43:02,591 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:43:04,591 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:43:06,592 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:43:08,593 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:43:10,593 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:43:11,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:43:11,164 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:43:11,726 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:43:12,594 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:43:14,595 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:43:16,596 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:43:18,596 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:43:20,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:43:22,598 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:43:24,598 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:43:26,599 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:43:26,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:43:26,673 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:43:28,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:43:30,601 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:43:32,601 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:43:35,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:43:37,603 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:43:39,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:43:41,605 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:43:41,800 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:43:42,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:43:42,054 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:43:43,606 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:43:45,607 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:43:47,608 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:43:49,608 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:43:51,609 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:43:53,610 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:43:55,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:43:57,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:43:57,340 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:43:57,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:43:59,613 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:44:01,614 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:44:03,615 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:44:05,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:44:07,617 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:44:09,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:44:11,619 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:44:11,875 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:44:12,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:44:12,592 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:44:13,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:44:15,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:44:17,621 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:44:19,622 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:44:21,623 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:44:23,624 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:44:25,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:44:27,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:44:27,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:44:27,956 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:44:29,626 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:44:31,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:44:33,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:44:35,629 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:44:37,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:44:39,631 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:44:41,632 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:44:41,949 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:44:43,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:44:43,236 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:44:43,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:44:45,634 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:44:47,634 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:44:49,635 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:44:52,637 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:44:54,638 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:44:56,638 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:44:58,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:44:58,460 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:44:58,639 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:45:00,640 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:45:02,641 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:45:04,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:45:06,643 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:45:08,644 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:45:10,645 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:45:12,022 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:45:12,646 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:45:13,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:45:13,772 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:45:14,646 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:45:16,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:45:18,648 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:45:20,649 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:45:22,649 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:45:24,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:45:26,651 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:45:28,652 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:45:29,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:45:29,153 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:45:30,653 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:45:32,654 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:45:34,655 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:45:36,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:45:38,657 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:45:40,658 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:45:42,096 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:45:42,659 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:45:44,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:45:44,565 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:45:44,659 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:45:46,661 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:45:48,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:45:50,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:45:52,663 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:45:54,664 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:45:56,665 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:45:59,666 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:45:59,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:45:59,791 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:46:01,667 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:46:03,667 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:46:05,668 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:46:07,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:46:09,670 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:46:11,671 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:46:12,169 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:46:13,672 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:46:15,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:46:15,174 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:46:15,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:46:17,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:46:19,674 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:46:21,675 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:46:23,675 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:46:25,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:46:27,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:46:29,678 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:46:30,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:46:30,595 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:46:31,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:46:33,680 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:46:35,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:46:37,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:46:39,682 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:46:41,683 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:46:42,246 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:46:43,683 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:46:45,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:46:45,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:46:45,819 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:46:47,685 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:46:49,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:46:51,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:46:53,687 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:46:55,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:46:57,689 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:46:59,689 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:47:01,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:47:01,111 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:47:01,690 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:47:03,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:47:05,692 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:47:07,693 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:47:09,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:47:11,695 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:47:12,320 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:47:13,696 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:47:15,697 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:47:16,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:47:16,344 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:47:17,697 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:47:20,698 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:47:22,699 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:47:24,700 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:47:26,701 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:47:28,702 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:47:30,702 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:47:31,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:47:31,559 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:47:32,703 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:47:34,704 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:47:36,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:47:38,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:47:40,706 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:47:42,395 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:47:42,707 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:47:44,708 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:47:46,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:47:46,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:47:46,806 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:47:48,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:47:50,710 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:47:52,711 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:47:54,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:47:56,713 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:47:58,714 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:48:00,715 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:48:02,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:48:02,090 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:48:02,715 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:48:04,716 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:48:06,717 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:48:08,718 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:48:10,719 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:48:12,470 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:48:12,720 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:48:14,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:48:16,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:48:17,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:48:17,345 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:48:18,722 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:48:20,723 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:48:22,724 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:48:24,724 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:48:26,725 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:48:28,726 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:48:30,727 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:48:32,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:48:32,644 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:48:32,727 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:48:34,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:48:36,729 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:48:38,730 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:48:40,730 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:48:42,545 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:48:42,731 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:48:44,732 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:48:46,732 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:48:47,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:48:47,940 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:48:48,733 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:48:50,734 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:48:52,734 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:48:54,735 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:48:56,736 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:48:58,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:49:00,738 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:49:02,739 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:49:03,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:49:03,204 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:49:04,740 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:49:06,741 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:49:08,742 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:49:10,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:49:12,619 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:49:13,745 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:49:15,745 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:49:17,747 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:49:18,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:49:18,447 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:49:19,748 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:49:21,749 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:49:23,750 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:49:25,751 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:49:27,752 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:49:29,753 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:49:31,754 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:49:33,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:49:33,672 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:49:33,754 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:49:35,755 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:49:37,757 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:49:39,758 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:49:41,758 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:49:42,695 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:49:43,759 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:49:45,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:49:47,761 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:49:48,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:49:48,896 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:49:49,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:49:51,763 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:49:53,764 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:49:55,765 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:49:57,766 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:49:59,767 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:50:01,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:50:03,769 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:50:04,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:50:04,150 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:50:05,770 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:50:07,771 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:50:09,772 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:50:11,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:50:12,768 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:50:13,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:50:15,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:50:17,775 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:50:19,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:50:19,483 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:50:19,776 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:50:21,777 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:50:24,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:50:26,779 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:50:28,780 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:50:30,780 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:50:32,781 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:50:34,782 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:50:34,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:50:34,820 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:50:36,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:50:38,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:50:40,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:50:42,785 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:50:42,837 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:50:44,786 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:50:46,787 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:50:48,788 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:50:50,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:50:50,084 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:50:50,789 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:50:52,790 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:50:54,790 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:50:56,791 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:50:58,792 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:51:00,792 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:51:02,793 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:51:04,794 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:51:05,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:51:05,350 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:51:06,795 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:51:08,795 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:51:10,796 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:51:12,797 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:51:12,911 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:51:14,798 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:51:16,799 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:51:18,799 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:51:20,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:51:20,625 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:51:20,800 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:51:22,801 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:51:24,801 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:51:27,802 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:51:29,804 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:51:31,805 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:51:33,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:51:35,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:51:35,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:51:35,968 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:51:37,807 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:51:39,808 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:51:41,809 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:51:42,980 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:51:43,809 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:51:45,810 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:51:47,811 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:51:49,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:51:51,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:51:51,228 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:51:51,813 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:51:53,814 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:51:55,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:51:57,816 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:51:59,816 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:52:01,817 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:52:03,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:52:05,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:52:06,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:52:06,464 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:52:07,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:52:09,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:52:11,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:52:13,051 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:52:13,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:52:15,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:52:17,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:52:19,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:52:21,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:52:21,792 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:52:21,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:52:23,826 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:52:25,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:52:27,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:52:29,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:52:31,829 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:52:33,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:52:35,831 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:52:37,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:52:37,098 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:52:37,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:52:39,833 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:52:42,834 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:52:43,123 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:52:44,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:52:46,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:52:48,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:52:50,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:52:52,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:52:52,322 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:52:52,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:52:54,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:52:56,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:52:58,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:53:00,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:53:02,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:53:04,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:53:06,846 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:53:07,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:53:07,553 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:53:08,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:53:10,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:53:12,849 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:53:13,196 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:53:14,850 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:53:16,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:53:18,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:53:20,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:53:22,854 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:53:22,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:53:22,876 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:53:24,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:53:26,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:53:28,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:53:30,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:53:32,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:53:34,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:53:36,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:53:38,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:53:38,115 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:53:38,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:53:41,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:53:43,268 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:53:43,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:53:45,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:53:47,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:53:49,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:53:51,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:53:53,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:53:53,338 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:53:53,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:53:55,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:53:57,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:53:59,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:54:01,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:54:03,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:54:05,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:54:07,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:54:08,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:54:08,638 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:54:09,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:54:11,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:54:13,342 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:54:13,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:54:15,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:54:17,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:54:19,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:54:21,882 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:54:23,883 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:54:23,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:54:23,929 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:54:25,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:54:27,885 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:54:29,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:54:31,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:54:33,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:54:35,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:54:37,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:54:39,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:54:39,203 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:54:39,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:54:41,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:54:43,417 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:54:43,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:54:45,894 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:54:47,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:54:49,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:54:51,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:54:53,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:54:54,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:54:54,577 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:54:55,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:54:57,900 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:54:59,901 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:55:01,902 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:55:03,902 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:55:06,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:55:08,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:55:09,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:55:09,825 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:55:10,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:55:12,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:55:13,492 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:55:14,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:55:16,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:55:18,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:55:20,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:55:22,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:55:24,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:55:25,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:55:25,097 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:55:26,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:55:28,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:55:30,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:55:32,916 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:55:34,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:55:36,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:55:38,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:55:40,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:55:40,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:55:40,950 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:55:42,921 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:55:43,568 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:55:44,922 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:55:46,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:55:48,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:55:50,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:55:52,925 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:55:54,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:55:56,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:55:56,170 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:55:56,927 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:55:58,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:56:00,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:56:02,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:56:04,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:56:06,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:56:08,932 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:56:10,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:56:11,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:56:11,452 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:56:12,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:56:13,642 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:56:14,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:56:16,935 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:56:18,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:56:20,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:56:22,937 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:56:24,938 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:56:26,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:56:26,770 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:56:26,939 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:56:28,939 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:56:30,940 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:56:33,942 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:56:35,942 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:56:37,944 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:56:39,944 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:56:41,945 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:56:42,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:56:42,114 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:56:43,718 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:56:43,946 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:56:45,946 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:56:47,947 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:56:49,948 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:56:51,949 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:56:53,950 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:56:55,951 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:56:57,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:56:57,339 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:56:57,952 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:56:59,953 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:57:01,953 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:57:03,955 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:57:05,956 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:57:07,956 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:57:09,957 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:57:11,958 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:57:12,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:57:12,748 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:57:13,793 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:57:13,959 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:57:15,960 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:57:17,961 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:57:19,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:57:21,963 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:57:23,964 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:57:25,965 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:57:27,966 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:57:28,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:57:28,004 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:57:29,967 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:57:31,968 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:57:33,969 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:57:35,970 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:57:37,971 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:57:39,972 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:57:41,973 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:57:43,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:57:43,230 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:57:43,873 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:57:43,974 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:57:45,975 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:57:47,976 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:57:50,977 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:57:52,978 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:57:54,979 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:57:56,980 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:57:58,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:57:58,588 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:57:58,981 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:58:00,982 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:58:02,983 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:58:04,984 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:58:06,985 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:58:08,986 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:58:10,987 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:58:12,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:58:13,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:58:13,815 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:58:14,048 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:58:14,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:58:16,989 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:58:18,990 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:58:20,992 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:58:22,993 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:58:24,994 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:58:26,995 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:58:28,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:58:29,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:58:29,175 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:58:30,997 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:58:32,998 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:58:34,998 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:58:36,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:58:39,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:58:41,001 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:58:43,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:58:44,030 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:58:44,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:58:44,512 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:58:45,003 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:58:48,004 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:58:50,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:58:52,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:58:54,007 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:58:56,008 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:58:58,009 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:59:00,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:59:02,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:59:03,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:59:03,984 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:59:04,012 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:59:06,013 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:59:08,014 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:59:10,015 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:59:12,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:59:14,017 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:59:14,105 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:59:16,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:59:18,019 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:59:19,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:59:19,305 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:59:20,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:59:22,021 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:59:24,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:59:26,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:59:28,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:59:30,025 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:59:32,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:59:34,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:59:34,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:59:34,551 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:59:36,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:59:38,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:59:40,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:59:42,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:59:44,031 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:59:44,176 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 14:59:46,032 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:59:48,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:59:49,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 14:59:49,769 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 14:59:50,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:59:52,034 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:59:54,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:59:56,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 14:59:58,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:00:00,038 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:00:02,039 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:00:04,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:00:05,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:00:05,066 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:00:07,041 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:00:09,042 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:00:11,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:00:13,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:00:14,252 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:00:15,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:00:17,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:00:19,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:00:20,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:00:20,431 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:00:21,047 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:00:23,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:00:25,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:00:27,049 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:00:29,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:00:31,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:00:33,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:00:35,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:00:35,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:00:35,657 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:00:37,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:00:39,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:00:41,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:00:43,056 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:00:44,326 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:00:45,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:00:47,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:00:49,059 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:00:50,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:00:50,973 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:00:51,060 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:00:53,061 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:00:55,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:00:57,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:00:59,063 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:01:01,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:01:03,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:01:05,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:01:06,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:01:06,397 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:01:07,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:01:09,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:01:11,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:01:13,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:01:14,400 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:01:15,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:01:18,071 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:01:20,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:01:21,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:01:21,694 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:01:22,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:01:24,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:01:26,074 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:01:28,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:01:30,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:01:32,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:01:34,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:01:36,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:01:36,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:01:36,923 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:01:38,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:01:40,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:01:42,081 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:01:44,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:01:44,474 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:01:46,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:01:48,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:01:50,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:01:52,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:01:52,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:01:52,191 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:01:54,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:01:56,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:01:58,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:02:00,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:02:02,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:02:04,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:02:06,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:02:07,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:02:07,433 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:02:08,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:02:10,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:02:12,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:02:14,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:02:14,548 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:02:16,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:02:18,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:02:21,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:02:22,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:02:22,877 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:02:23,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:02:25,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:02:27,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:02:29,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:02:31,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:02:33,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:02:35,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:02:37,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:02:38,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:02:38,102 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:02:39,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:02:41,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:02:43,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:02:44,625 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:02:45,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:02:47,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:02:49,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:02:51,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:02:53,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:02:53,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:02:53,431 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:02:55,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:02:57,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:02:59,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:03:01,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:03:03,121 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:03:05,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:03:07,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:03:08,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:03:08,712 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:03:09,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:03:11,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:03:13,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:03:14,704 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:03:15,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:03:17,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:03:19,128 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:03:21,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:03:23,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:03:24,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:03:24,030 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:03:25,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:03:28,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:03:30,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:03:32,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:03:34,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:03:36,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:03:38,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:03:39,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:03:39,299 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:03:40,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:03:42,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:03:44,140 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:03:44,779 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:03:46,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:03:48,142 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:03:50,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:03:52,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:03:54,145 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:03:54,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:03:54,654 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:03:56,146 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:03:58,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:04:00,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:04:02,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:04:04,150 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:04:06,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:04:08,152 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:04:09,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:04:09,878 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:04:10,153 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:04:12,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:04:14,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:04:14,851 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:04:16,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:04:18,157 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:04:20,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:04:22,159 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:04:24,160 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:04:25,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:04:25,281 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:04:26,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:04:28,162 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:04:30,162 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:04:33,165 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:04:35,165 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:04:37,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:04:39,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:04:40,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:04:40,504 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:04:41,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:04:43,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:04:44,925 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:04:45,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:04:47,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:04:49,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:04:51,172 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:04:53,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:04:55,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:04:55,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:04:55,773 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:04:57,175 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:04:59,175 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:05:01,176 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:05:03,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:05:05,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:05:07,179 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:05:09,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:05:11,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:05:11,175 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:05:11,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:05:13,182 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:05:15,026 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:05:15,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:05:17,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:05:19,184 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:05:22,186 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:05:24,187 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:05:26,188 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:05:26,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:05:26,403 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:05:28,189 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:05:30,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:05:32,191 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:05:34,192 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:05:36,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:05:38,194 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:05:40,195 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:05:41,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:05:41,758 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:05:42,195 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:05:44,196 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:05:45,074 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:05:46,197 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:05:48,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:05:50,199 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:05:52,200 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:05:54,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:05:56,202 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:05:56,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:05:56,982 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:05:58,203 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:06:00,204 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:06:02,205 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:06:04,206 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:06:06,207 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:06:08,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:06:10,209 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:06:12,210 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:06:12,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:06:12,316 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:06:14,211 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:06:15,151 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:06:16,211 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:06:18,212 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:06:20,213 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:06:22,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:06:24,215 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:06:26,215 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:06:27,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:06:27,561 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:06:28,216 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:06:30,217 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:06:32,218 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:06:34,219 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:06:36,220 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:06:38,221 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:06:40,222 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:06:42,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:06:42,952 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:06:43,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:06:45,224 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:06:45,231 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:06:47,224 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:06:49,225 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:06:51,226 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:06:53,227 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:06:55,228 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:06:57,229 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:06:58,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:06:58,176 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:06:59,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:07:01,231 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:07:03,232 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:07:05,233 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:07:07,233 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:07:09,234 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:07:11,235 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:07:13,235 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:07:13,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:07:13,469 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:07:15,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:07:15,299 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:07:17,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:07:19,237 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:07:21,238 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:07:23,238 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:07:25,239 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:07:27,239 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:07:28,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:07:28,712 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:07:29,240 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:07:31,241 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:07:33,241 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:07:35,242 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:07:37,243 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:07:39,244 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:07:41,245 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:07:43,246 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:07:44,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:07:44,017 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:07:45,247 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:07:45,365 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:07:47,248 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:07:49,249 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:07:51,250 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:07:53,250 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:07:55,251 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:07:57,252 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:07:59,253 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:07:59,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:07:59,286 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:08:01,254 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:08:04,255 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:08:06,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:08:08,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:08:10,257 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:08:12,258 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:08:14,259 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:08:14,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:08:14,521 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:08:15,440 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:08:16,259 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:08:18,260 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:08:20,261 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:08:22,261 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:08:24,262 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:08:26,263 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:08:28,264 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:08:29,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:08:29,746 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:08:30,264 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:08:32,265 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:08:34,266 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:08:36,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:08:38,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:08:40,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:08:42,270 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:08:44,271 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:08:45,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:08:45,041 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:08:45,513 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:08:46,272 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:08:48,272 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:08:50,273 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:08:52,274 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:08:54,275 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:08:56,276 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:08:58,277 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:09:00,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:09:00,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:09:00,410 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:09:02,279 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:09:04,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:09:06,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:09:08,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:09:10,283 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:09:12,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:09:14,285 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:09:15,585 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:09:15,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:09:15,632 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:09:16,286 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:09:18,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:09:20,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:09:22,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:09:24,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:09:27,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:09:29,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:09:31,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:09:31,080 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:09:31,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:09:33,306 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:09:35,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:09:37,308 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:09:39,308 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:09:41,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:09:43,310 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:09:45,311 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:09:45,660 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:09:46,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:09:46,506 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:09:47,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:09:49,313 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:09:51,314 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:09:53,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:09:55,316 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:09:57,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:09:59,318 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:10:01,319 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:10:01,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:10:01,812 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:10:03,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:10:05,321 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:10:07,322 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:10:09,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:10:11,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:10:13,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:10:15,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:10:15,734 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:10:17,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:10:17,033 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:10:17,326 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:10:19,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:10:21,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:10:23,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:10:25,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:10:27,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:10:29,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:10:31,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:10:32,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:10:32,353 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:10:33,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:10:35,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:10:37,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:10:39,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:10:41,335 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:10:43,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:10:45,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:10:45,809 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:10:47,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:10:47,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:10:47,782 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:10:49,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:10:52,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:10:54,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:10:56,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:10:58,342 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:11:00,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:11:02,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:11:03,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:11:03,150 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:11:04,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:11:06,346 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:11:08,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:11:10,348 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:11:12,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:11:14,350 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:11:15,883 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:11:16,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:11:18,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:11:18,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:11:18,479 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:11:20,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:11:22,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:11:24,354 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:11:26,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:11:28,356 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:11:30,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:11:32,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:11:33,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:11:33,703 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:11:34,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:11:36,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:11:38,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:11:40,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:11:42,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:11:44,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:11:45,960 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:11:46,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:11:48,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:11:49,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:11:49,007 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:11:50,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:11:52,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:11:54,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:11:56,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:11:58,371 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:12:00,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:12:02,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:12:04,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:12:04,238 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:12:04,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:12:06,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:12:08,376 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:12:10,377 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:12:12,377 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:12:14,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:12:16,034 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:12:16,379 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:12:18,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:12:19,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:12:19,484 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:12:20,381 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:12:22,381 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:12:25,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:12:27,384 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:12:29,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:12:31,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:12:33,386 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:12:34,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:12:34,810 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:12:35,387 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:12:37,388 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:12:39,389 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:12:41,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:12:43,391 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:12:45,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:12:46,108 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:12:47,393 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:12:49,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:12:50,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:12:50,113 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:12:51,395 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:12:53,396 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:12:55,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:12:57,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:12:59,399 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:13:01,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:13:03,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:13:05,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:13:05,343 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:13:05,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:13:07,402 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:13:09,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:13:11,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:13:13,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:13:15,406 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:13:16,181 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:13:17,407 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:13:19,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:13:20,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:13:20,716 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:13:21,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:13:23,409 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:13:25,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:13:27,411 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:13:29,412 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:13:31,413 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:13:33,414 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:13:35,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:13:35,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:13:35,947 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:13:37,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:13:39,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:13:41,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:13:43,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:13:45,419 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:13:46,254 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:13:47,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:13:49,421 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:13:51,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:13:51,320 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:13:51,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:13:53,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:13:55,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:13:57,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:13:59,425 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:14:01,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:14:06,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:14:06,544 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:14:16,318 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:14:21,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:14:21,799 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:14:37,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:14:37,064 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:14:46,394 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:14:52,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:14:52,328 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:15:05,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:15:05,235 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 15:15:05,290 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 15:15:05,359 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 15:15:05,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 15:15:07,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:15:07,624 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:15:08,452 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:15:16,456 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:15:16,490 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:15:22,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:15:22,878 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:15:38,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:15:38,104 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:15:38,466 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:15:46,571 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:15:53,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:15:53,375 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:16:08,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:16:08,645 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:16:16,649 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:16:23,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:16:23,870 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:16:39,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:16:39,095 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:16:46,723 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:16:54,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:16:54,323 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:17:09,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:17:09,548 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:17:16,798 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:17:24,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:17:24,840 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:17:40,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:17:40,063 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:17:46,873 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:17:55,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:17:55,300 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:18:10,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:18:10,541 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:18:16,950 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:18:25,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:18:25,772 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:18:41,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:18:41,000 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:18:47,030 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:18:56,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:18:56,230 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:19:11,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:19:11,490 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:19:17,109 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:19:26,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:19:26,781 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:19:28,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:19:37,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:37,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:37,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:37,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:37,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:37,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:37,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:37,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:37,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:37,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:37,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:37,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:37,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:37,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:37,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:37,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:40,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:19:42,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:19:42,202 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:19:44,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:19:47,184 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:19:47,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:47,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:47,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:47,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:47,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:47,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:47,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:47,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:47,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:47,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:47,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:47,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:47,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:47,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:47,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:47,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:47,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:47,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:47,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:47,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:47,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:47,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:47,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:47,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:47,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:47,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:47,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:47,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:47,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:47,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:47,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:47,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:49,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:49,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:49,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:49,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:49,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:49,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:49,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:49,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:49,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:49,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:49,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:49,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:49,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:49,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:49,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:49,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:49,579 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:19:51,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:51,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:51,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:51,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:51,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:51,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:51,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:51,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:51,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:51,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:51,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:51,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:51,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:51,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:51,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:51,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:51,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:51,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:51,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:51,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:51,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:51,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:51,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:51,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:51,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:51,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:51,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:51,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:51,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:51,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:51,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:51,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:53,580 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:19:53,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:53,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:53,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:53,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:53,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:53,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:53,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:53,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:53,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:53,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:53,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:53,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:53,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:53,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:53,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:53,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:57,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:57,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:57,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:57,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:57,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:57,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:57,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:57,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:57,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:57,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:57,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:57,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:57,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:57,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:57,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:57,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:57,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:19:57,449 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:19:57,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:19:57,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:57,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:57,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:57,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:57,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:57,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:57,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:57,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:57,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:57,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:57,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:57,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:57,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:57,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:57,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:19:57,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:01,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:01,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:01,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:01,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:01,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:01,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:01,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:01,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:01,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:01,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:01,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:01,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:01,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:01,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:01,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:01,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:01,583 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:20:04,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:04,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:04,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:04,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:04,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:04,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:04,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:04,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:04,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:04,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:04,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:04,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:04,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:04,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:04,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:04,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:05,585 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:20:06,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:06,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:06,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:06,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:06,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:06,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:06,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:06,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:06,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:06,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:06,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:06,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:06,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:06,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:06,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:06,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:08,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:09,587 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:20:10,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:10,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:10,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:10,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:10,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:10,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:10,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:10,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:10,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:10,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:10,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:10,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:10,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:10,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:10,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:10,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:11,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:11,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:11,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:11,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:11,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:11,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:11,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:11,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:11,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:11,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:11,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:11,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:11,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:11,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:11,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:11,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:12,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:20:12,678 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:20:13,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:13,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:13,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:13,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:13,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:13,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:13,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:13,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:13,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:13,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:13,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:13,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:13,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:13,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:13,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:13,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:13,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:13,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:13,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:13,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:13,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:13,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:13,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:13,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:13,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:13,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:13,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:13,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:13,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:13,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:13,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:13,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:13,588 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:20:14,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:14,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:14,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:14,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:14,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:14,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:14,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:14,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:14,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:14,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:14,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:14,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:14,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:14,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:14,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:14,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:15,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:15,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:15,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:15,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:15,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:15,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:15,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:15,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:15,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:15,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:15,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:15,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:15,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:15,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:15,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:15,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:15,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:15,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:15,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:15,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:15,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:15,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:15,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:15,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:15,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:15,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:15,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:15,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:15,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:15,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:15,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:15,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:15,589 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:20:16,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:16,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:16,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:16,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:16,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:16,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:16,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:16,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:16,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:16,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:16,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:16,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:16,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:16,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:16,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:16,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:17,256 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:20:18,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:18,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,590 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:20:19,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:19,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:20,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:20,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:20,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:20,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:20,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:20,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:20,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:20,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:20,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:20,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:20,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:20,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:20,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:20,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:20,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:20,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:21,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:21,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:21,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:21,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:21,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:21,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:21,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:21,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:21,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:21,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:21,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:21,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:21,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:21,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:21,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:21,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:21,591 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:20:22,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:22,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:22,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:22,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:22,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:22,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:22,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:22,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:22,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:22,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:22,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:22,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:22,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:22,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:22,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:22,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:25,593 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:20:26,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:26,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:26,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:26,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:26,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:26,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:26,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:26,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:26,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:26,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:26,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:26,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:26,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:26,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:26,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:26,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:27,594 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:20:27,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:27,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:27,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:27,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:27,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:27,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:27,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:27,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:27,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:27,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:27,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:27,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:27,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:27,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:27,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:27,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:27,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:20:27,902 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:20:28,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:28,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:28,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:28,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:28,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:28,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:28,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:28,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:28,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:28,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:28,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:28,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:28,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:28,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:28,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:28,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:28,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:28,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:28,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:28,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:28,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:28,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:28,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:28,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:28,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:28,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:28,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:28,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:28,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:28,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:28,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:28,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:29,595 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:20:31,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:31,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:31,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:31,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:31,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:31,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:31,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:31,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:31,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:31,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:31,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:31,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:31,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:31,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:31,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:31,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:33,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:33,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:33,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:33,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:33,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:33,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:33,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:33,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:33,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:33,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:33,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:33,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:33,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:33,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:33,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:33,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:33,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:33,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:33,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:33,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:33,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:33,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:33,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:33,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:33,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:33,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:33,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:33,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:33,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:33,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:33,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:33,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:33,596 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:20:34,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:34,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:34,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:34,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:34,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:34,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:34,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:34,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:34,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:34,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:34,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:34,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:34,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:34,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:34,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:34,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:35,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:20:35,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:35,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:35,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:35,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:35,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:35,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:35,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:35,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:35,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:35,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:35,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:35,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:35,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:35,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:35,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:35,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:35,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:35,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:35,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:35,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:35,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:35,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:35,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:35,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:35,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:35,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:35,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:35,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:35,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:35,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:35,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:35,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:37,598 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:20:39,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:39,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:39,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:39,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:39,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:39,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:39,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:39,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:39,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:39,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:39,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:39,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:39,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:39,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:39,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:39,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:39,599 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:20:40,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:40,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:40,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:40,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:40,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:40,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:40,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:40,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:40,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:40,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:40,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:40,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:40,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:40,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:40,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:40,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:40,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:40,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:40,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:40,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:40,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:40,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:40,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:40,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:40,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:40,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:40,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:40,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:40,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:40,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:40,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:40,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:43,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:20:43,271 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:20:43,601 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:20:45,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:20:47,327 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:20:47,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:20:49,603 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:20:51,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:20:53,605 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:20:55,606 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:20:57,606 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:20:58,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:58,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:58,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:58,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:58,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:58,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:58,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:58,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:58,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:58,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:58,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:58,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:58,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:58,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:58,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:58,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:20:58,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:20:58,558 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:20:59,607 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:21:01,608 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:21:03,608 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:21:05,609 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:21:07,610 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:21:09,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:21:11,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:21:13,613 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:21:13,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:21:13,887 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:21:15,614 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:21:17,400 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:21:17,615 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:21:19,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:21:21,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:21:23,617 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:21:25,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:21:26,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:26,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:26,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:26,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:26,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:26,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:26,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:26,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:26,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:26,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:26,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:26,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:27,619 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:21:29,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:21:29,151 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:21:35,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:35,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:35,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:35,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:35,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:35,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:35,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:35,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:35,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:35,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:35,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:35,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:35,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:35,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:35,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:35,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:37,621 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:21:37,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:37,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:37,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:37,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:37,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:37,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:37,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:37,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:37,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:37,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:37,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:37,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:37,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:37,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:37,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:37,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:40,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:40,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:40,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:40,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:40,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:40,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:40,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:40,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:40,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:40,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:40,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:40,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:40,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:40,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:40,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:40,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:43,624 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:21:44,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:21:44,392 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:21:46,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:46,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:46,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:46,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:46,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:46,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:46,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:46,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:46,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:46,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:46,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:46,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:46,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:46,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:46,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:46,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:47,474 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:21:47,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:21:50,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:50,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:50,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:50,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:50,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:50,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:50,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:50,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:50,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:50,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:50,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:50,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:50,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:50,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:50,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:50,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:51,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:21:54,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:54,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:54,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:54,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:54,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:54,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:54,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:54,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:54,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:54,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:54,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:54,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:54,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:54,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:54,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:54,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:54,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:54,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:54,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:54,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:54,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:54,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:54,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:54,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:54,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:54,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:54,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:54,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:54,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:54,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:54,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:54,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:55,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:21:58,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:58,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:58,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:58,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:58,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:58,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:58,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:58,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:58,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:58,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:58,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:58,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:58,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:58,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:58,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:58,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:58,629 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:21:58,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:58,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:58,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:58,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:58,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:58,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:58,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:58,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:58,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:58,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:58,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:58,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:58,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:58,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:58,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:58,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:21:59,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:21:59,615 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:22:02,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:02,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:02,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:02,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:02,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:02,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:02,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:02,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:02,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:02,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:02,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:02,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:02,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:02,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:02,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:02,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:02,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:02,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:02,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:02,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:02,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:02,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:02,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:02,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:02,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:02,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:02,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:02,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:02,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:02,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:02,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:02,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:02,631 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:22:06,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:22:06,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:06,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:08,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:22:11,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:11,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:11,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:11,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:11,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:11,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:11,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:11,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:11,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:11,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:11,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:11,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:11,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:11,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:11,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:11,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:12,635 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:22:13,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:13,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:13,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:13,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:13,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:13,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:13,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:13,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:13,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:13,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:13,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:13,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:13,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:13,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:13,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:13,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:15,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:22:15,425 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:22:15,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:15,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:15,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:15,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:15,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:15,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:15,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:15,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:15,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:15,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:15,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:15,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:15,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:15,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:15,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:15,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:16,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:16,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:16,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:16,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:16,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:16,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:16,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:16,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:16,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:16,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:16,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:16,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:16,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:16,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:16,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:16,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:16,636 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:22:17,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,545 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:22:17,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:17,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:18,637 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:22:19,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:19,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:20,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:20,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:20,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:20,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:20,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:20,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:20,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:20,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:20,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:20,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:20,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:20,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:20,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:20,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:20,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:20,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:21,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:21,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:21,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:21,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:21,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:21,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:21,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:21,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:21,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:21,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:21,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:21,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:21,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:21,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:21,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:21,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:21,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:21,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:21,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:21,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:21,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:21,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:21,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:21,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:21,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:21,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:21,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:21,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:21,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:21,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:21,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:21,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:22,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:22,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:22,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:22,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:22,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:22,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:22,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:22,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:22,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:22,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:22,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:22,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:22,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:22,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:22,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:22,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:22,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:22,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:22,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:22,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:22,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:22,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:22,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:22,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:22,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:22,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:22,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:22,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:22,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:22,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:22,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:22,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:22,638 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:22:23,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:23,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:24,639 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:22:26,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:26,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:26,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:26,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:26,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:26,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:26,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:26,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:26,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:26,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:26,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:26,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:26,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:26,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:26,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:26,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:26,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:26,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:26,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:26,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:26,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:26,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:26,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:26,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:26,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:26,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:26,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:26,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:26,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:26,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:26,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:26,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:26,640 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:22:27,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:27,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:27,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:27,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:27,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:27,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:27,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:27,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:27,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:27,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:27,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:27,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:27,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:27,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:27,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:27,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:30,641 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:22:30,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:22:30,702 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:22:32,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:32,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:32,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:32,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:32,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:32,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:32,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:32,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:32,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:32,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:32,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:32,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:32,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:32,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:32,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:32,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:32,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:22:33,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:33,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:33,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:33,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:33,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:33,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:33,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:33,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:33,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:33,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:33,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:33,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:33,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:33,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:33,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:33,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:34,643 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:22:36,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:36,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:36,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:36,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:36,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:36,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:36,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:36,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:36,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:36,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:36,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:36,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:36,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:36,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:36,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:36,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:36,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:36,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:36,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:36,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:36,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:36,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:36,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:36,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:36,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:36,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:36,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:36,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:36,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:36,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:36,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:36,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:36,643 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:22:37,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:37,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:37,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:37,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:37,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:37,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:37,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:37,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:37,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:37,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:37,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:37,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:37,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:37,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:37,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:37,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:37,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:37,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:37,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:37,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:37,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:37,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:37,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:37,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:37,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:37,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:37,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:37,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:37,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:37,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:37,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:37,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:39,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:39,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:39,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:39,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:39,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:39,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:39,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:39,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:39,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:39,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:39,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:39,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:39,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:39,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:39,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:39,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:39,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:39,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:40,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:40,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:40,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:40,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:40,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:40,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:40,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:40,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:40,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:40,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:40,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:40,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:40,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:40,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:40,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:40,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:40,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:40,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:40,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:40,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:40,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:40,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:40,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:40,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:40,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:40,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:40,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:40,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:40,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:40,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:40,645 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:22:41,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:41,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:41,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:41,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:41,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:41,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:41,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:41,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:41,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:41,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:41,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:41,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:41,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:41,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:41,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:41,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:42,645 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:22:44,646 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:22:45,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:22:45,928 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:22:45,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:45,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:45,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:45,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:45,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:45,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:45,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:45,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:45,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:46,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:46,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:46,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:46,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:46,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:46,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:46,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:22:46,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:22:47,611 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:22:48,648 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:22:50,648 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:22:52,649 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:22:54,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:22:56,651 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:22:58,651 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:23:00,652 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:23:00,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:00,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:00,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:00,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:00,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:00,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:00,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:00,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:00,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:00,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:00,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:00,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:00,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:00,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:00,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:00,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:01,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:23:01,253 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:23:02,653 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:23:04,654 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:23:06,654 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:23:08,655 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:23:10,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:23:12,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:23:14,657 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:23:16,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:23:16,475 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:23:16,658 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:23:17,684 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:23:18,659 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:23:20,659 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:23:22,660 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:23:24,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:24,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:24,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:24,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:24,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:24,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:24,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:24,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:24,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:24,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:24,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:24,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:24,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:24,653 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 15:23:24,782 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:23:24,857 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 15:23:24,955 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 15:23:25,767 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 15:23:25,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:23:26,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:23:31,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:23:31,756 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:23:34,771 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:23:40,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:23:44,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,775 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:23:44,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:44,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:46,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:23:46,980 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:23:47,773 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:23:48,804 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:23:52,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:23:56,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:56,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:56,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:56,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:56,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:56,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:56,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:56,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:56,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:56,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:56,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:56,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:56,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:56,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:56,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:56,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:56,807 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:23:57,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:57,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:57,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:57,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:57,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:57,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:57,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:57,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:57,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:57,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:57,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:57,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:57,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:57,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:57,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:23:57,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:00,809 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:24:00,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:00,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:00,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:00,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:00,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:00,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:00,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:00,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:00,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:00,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:00,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:00,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:00,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:00,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:00,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:00,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:02,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:24:02,321 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:24:02,810 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:24:03,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:03,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:03,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:03,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:03,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:03,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:03,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:03,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:03,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:03,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:03,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:03,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:03,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:03,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:03,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:03,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:03,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:03,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:03,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:03,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:03,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:03,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:03,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:03,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:03,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:03,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:03,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:03,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:03,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:03,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:03,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:03,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:06,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:06,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:06,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:06,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:06,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:06,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:06,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:06,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:06,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:06,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:06,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:06,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:06,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:06,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:06,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:06,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:06,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:06,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:06,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:06,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:06,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:06,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:06,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:06,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:06,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:06,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:06,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:06,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:06,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:06,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:06,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:06,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:06,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:24:07,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:07,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:07,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:07,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:07,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:07,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:07,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:07,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:07,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:07,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:07,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:07,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:07,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:07,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:07,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:07,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:08,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:24:09,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:09,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:09,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:09,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:09,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:09,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:09,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:09,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:09,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:09,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:09,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:09,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:09,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:09,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:09,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:09,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:10,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:10,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:10,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:10,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:10,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:10,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:10,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:10,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:10,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:10,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:10,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:10,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:10,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:10,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:10,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:10,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:10,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:10,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:10,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:10,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:10,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:10,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:10,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:10,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:10,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:10,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:10,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:10,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:10,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:10,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:10,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:10,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:12,814 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:24:14,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:24:17,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:24:17,720 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:24:17,942 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:24:19,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:19,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:19,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:19,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:19,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:19,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:19,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:19,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:19,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:19,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:19,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:19,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:19,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:19,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:19,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:19,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:19,816 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:24:21,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:21,817 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:24:22,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:22,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:22,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:22,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:22,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:22,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:22,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:22,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:22,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:22,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:22,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:22,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:22,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:22,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:22,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:22,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:23,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:23,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:23,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:23,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:23,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:23,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:23,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:23,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:23,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:23,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:23,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:23,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:23,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:23,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:23,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:23,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:24,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:24,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:24,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:24,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:24,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:24,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:24,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:24,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:24,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:24,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:24,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:24,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:24,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:24,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:24,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:24,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:24,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:24,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:24,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:24,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:24,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:24,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:24,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:24,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:24,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:24,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:24,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:24,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:24,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:24,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:24,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:24,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:25,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:25,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:25,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:25,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:25,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:25,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:25,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:25,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:25,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:25,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:25,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:25,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:25,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:25,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:25,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:25,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:25,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:24:26,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:26,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:27,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:27,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:27,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:27,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:27,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:27,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:27,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:27,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:27,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:27,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:27,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:27,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:27,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:27,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:27,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:27,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:27,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:24:27,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:27,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:27,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:27,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:27,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:27,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:27,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:27,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:27,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:27,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:27,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:27,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:27,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:27,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:27,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:27,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:29,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:29,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:29,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:29,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:29,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:29,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:29,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:29,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:29,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:29,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:29,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:29,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:29,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:29,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:29,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:29,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:29,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:24:30,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:30,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:30,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:30,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:30,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:30,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:30,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:30,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:30,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:30,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:30,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:30,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:30,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:30,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:30,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:30,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:31,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:31,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:31,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:31,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:31,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:31,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:31,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:31,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:31,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:31,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:31,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:31,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:31,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:31,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:31,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:31,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:32,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:24:32,943 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:24:33,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:24:35,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:35,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:35,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:35,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:35,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:35,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:35,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:35,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:35,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:35,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:35,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:35,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:35,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:35,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:35,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:35,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:35,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:24:36,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:36,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:36,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:36,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:36,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:36,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:36,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:36,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:36,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:36,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:36,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:36,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:36,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:36,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:36,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:36,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:37,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:24:38,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:38,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:38,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:38,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:38,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:38,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:38,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:38,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:38,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:38,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:38,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:38,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:38,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:38,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:39,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:39,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:39,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:39,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:39,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:39,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:39,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:39,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:39,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:39,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:39,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:39,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:39,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:39,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:39,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:39,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:39,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:39,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:39,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:24:40,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:40,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:40,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:40,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:40,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:40,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:40,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:40,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:40,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:40,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:40,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:40,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:40,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:40,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:40,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:40,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:40,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:40,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:40,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:40,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:40,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:40,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:40,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:40,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:40,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:40,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:40,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:40,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:40,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:40,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:40,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:40,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:41,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:41,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:41,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:41,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:41,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:41,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:41,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:41,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:41,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:41,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:41,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:41,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:41,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:41,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:41,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:41,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:41,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:41,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:41,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:41,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:41,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:41,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:41,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:41,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:41,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:41,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:41,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:41,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:41,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:41,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:41,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:41,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:43,826 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:24:45,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:24:45,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:45,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:45,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:45,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:45,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:45,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:45,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:45,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:45,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:45,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:45,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:45,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:45,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:45,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:45,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:45,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:46,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:46,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:46,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:46,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:46,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:46,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:46,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:46,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:46,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:46,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:46,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:46,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:46,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:46,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:46,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:46,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:47,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:24:47,920 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:24:48,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:24:48,227 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:24:49,829 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:24:50,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:50,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:50,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:50,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:50,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:50,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:50,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:50,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:50,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:50,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:50,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:50,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:50,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:50,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:50,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:50,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:24:51,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:24:53,831 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:24:55,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:24:57,833 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:24:59,834 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:25:00,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:00,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:00,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:00,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:00,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:00,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:00,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:00,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:00,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:00,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:00,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:00,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:00,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:00,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:00,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:00,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:01,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:25:03,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:25:03,469 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:25:03,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:25:05,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:25:07,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:25:09,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:25:11,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:25:13,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:25:15,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:25:17,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:25:17,991 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:25:18,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:25:18,731 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:25:19,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:25:21,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:21,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:21,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:21,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:21,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:21,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:21,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:21,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:21,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:21,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:21,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:21,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:21,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:25:23,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:25:33,849 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:25:33,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:25:33,953 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:25:39,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:25:43,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:25:48,053 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:25:49,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:25:49,322 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:25:49,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:25:50,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:50,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:50,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:50,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:50,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:50,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:50,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:50,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:50,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:50,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:50,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:50,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:50,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:50,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:50,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:50,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:51,856 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:25:52,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:52,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:52,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:52,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:52,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:52,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:52,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:52,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:52,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:52,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:52,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:52,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:52,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:52,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:52,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:52,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:55,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:55,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:55,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:55,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:55,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:55,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:55,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:25:55,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:55,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:55,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:55,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:55,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:55,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:55,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:55,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:55,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:55,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:25:59,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:26:01,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:01,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:01,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:01,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:01,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:01,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:01,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:01,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:01,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:01,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:01,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:01,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:01,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:01,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:01,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:01,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:02,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:02,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:02,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:02,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:02,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:02,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:02,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:02,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:02,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:02,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:02,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:02,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:02,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:02,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:02,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:02,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:03,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:26:04,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:26:04,580 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:26:04,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:04,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:04,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:04,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:04,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:04,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:04,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:04,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:04,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:04,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:04,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:04,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:04,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:04,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:04,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:04,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:05,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:05,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:05,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:05,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:05,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:05,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:05,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:05,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:05,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:05,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:05,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:05,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:05,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:05,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:05,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:05,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:07,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:26:08,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:08,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:08,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:08,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:08,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:08,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:08,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:08,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:08,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:08,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:08,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:08,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:08,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:08,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:08,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:08,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:09,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:26:11,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:11,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:11,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:11,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:11,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:11,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:11,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:11,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:11,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:11,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:11,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:11,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:11,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:11,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:11,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:11,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:12,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:13,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:26:15,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:26:18,125 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:26:19,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:26:19,856 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:26:19,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:26:19,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:19,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:19,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:19,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:19,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:19,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:19,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:19,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:19,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:19,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:19,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:19,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:19,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:19,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:19,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:19,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:20,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:20,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:20,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:20,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:20,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:20,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:20,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:20,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:20,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:20,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:20,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:20,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:20,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:20,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:20,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:20,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:21,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:21,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:21,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:21,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:21,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:21,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:21,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:21,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:21,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:21,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:21,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:21,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:21,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:21,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:21,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:21,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:21,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:21,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:21,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:21,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:21,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:21,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:21,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:21,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:21,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:21,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:21,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:21,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:21,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:21,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:21,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:21,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:21,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:26:22,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:22,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:22,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:22,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:22,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:22,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:22,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:22,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:22,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:22,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:22,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:22,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:22,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:22,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:22,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:22,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:22,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:22,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:22,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:22,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:22,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:22,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:22,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:22,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:22,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:22,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:22,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:22,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:22,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:22,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:22,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:22,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:23,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:26:25,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:25,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:27,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:26:28,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:28,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:28,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:28,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:28,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:28,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:28,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:28,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:28,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:28,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:28,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:28,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:28,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:28,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:28,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:28,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:28,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:28,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:28,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:28,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:28,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:28,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:28,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:28,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:28,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:28,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:28,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:28,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:28,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:28,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:28,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:28,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:29,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:26:30,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:30,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:30,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:30,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:30,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:30,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:30,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:30,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:30,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:30,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:30,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:30,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:30,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:30,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:30,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:30,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:31,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:31,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:31,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:31,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:31,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:31,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:31,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:31,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:31,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:31,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:31,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:31,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:31,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:31,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:31,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:31,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:31,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:26:32,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:32,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:32,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:32,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:32,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:32,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:32,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:32,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:32,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:32,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:32,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:32,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:32,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:32,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:32,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:32,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:32,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:32,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:32,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:32,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:32,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:32,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:32,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:32,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:32,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:32,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:32,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:32,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:32,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:32,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:32,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:32,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:33,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:33,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:33,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:33,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:33,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:33,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:33,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:33,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:33,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:33,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:33,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:33,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:33,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:33,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:33,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:33,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:26:35,077 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:26:35,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:35,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:26:37,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:37,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:37,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:37,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:37,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:37,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:37,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:37,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:37,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:37,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:37,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:37,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:37,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:37,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:37,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:37,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:37,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:26:39,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:39,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:39,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:39,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:39,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:39,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:39,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:39,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:39,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:39,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:39,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:39,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:39,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:39,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:39,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:39,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:39,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:26:39,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:39,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:39,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:39,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:39,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:39,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:39,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:39,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:39,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:39,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:39,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:39,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:39,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:39,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:39,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:39,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:41,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:26:42,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:42,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:42,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:42,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:42,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:42,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:42,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:42,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:42,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:42,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:42,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:42,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:42,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:42,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:42,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:42,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:43,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:26:44,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:44,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:44,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:44,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:44,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:44,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:44,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:44,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:44,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:44,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:44,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:44,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:44,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:44,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:44,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:44,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:26:45,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:45,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:46,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:46,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:46,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:46,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:46,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:46,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:46,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:46,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:46,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:46,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:46,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:46,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:46,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:46,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:46,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:46,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:47,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:26:48,191 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:26:48,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:48,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:48,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:48,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:48,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:48,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:48,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:48,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:48,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:48,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:48,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:48,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:48,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:48,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:48,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:48,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:49,882 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:26:50,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:26:50,372 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:26:51,883 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:26:53,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:53,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:53,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:53,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:53,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:53,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:53,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:53,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:53,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:53,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:53,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:53,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:53,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:53,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:53,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:53,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:53,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:26:54,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:54,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:54,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:54,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:54,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:54,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:54,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:54,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:54,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:54,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:54,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:54,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:54,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:54,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:54,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:54,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:26:55,885 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:26:57,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:26:59,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:27:01,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:27:02,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:02,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:02,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:02,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:02,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:02,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:02,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:02,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:02,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:02,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:02,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:02,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:02,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:02,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:02,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:02,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:03,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:27:05,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:27:05,636 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:27:05,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:27:07,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:27:09,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:27:11,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:27:13,894 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:27:15,894 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:27:17,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:27:18,259 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:27:19,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:27:20,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:27:20,875 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:27:21,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:21,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:21,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:21,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:21,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:21,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:21,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:21,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:21,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:21,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:21,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:21,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:21,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:21,959 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:27:21,969 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 15:27:22,191 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 15:27:22,266 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 15:27:22,954 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 15:27:22,955 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:27:23,955 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:27:33,959 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:27:36,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:27:36,202 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:27:37,960 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:27:42,963 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:27:48,356 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:27:48,965 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:27:51,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:27:51,426 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:27:52,966 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:27:54,967 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:27:55,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:55,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:55,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:55,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:55,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:55,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:55,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:55,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:55,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:55,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:55,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:55,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:55,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:55,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:55,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:55,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:58,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:58,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:58,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:58,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:58,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:58,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:58,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:58,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:58,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:58,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:58,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:58,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:58,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:58,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:58,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:58,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:27:58,969 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:28:00,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:00,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:00,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:00,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:00,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:00,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:00,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:00,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:00,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:00,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:00,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:00,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:00,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:00,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:00,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:00,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:02,970 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:28:06,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:28:06,651 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:28:06,971 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:28:08,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:08,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:08,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:08,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:08,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:08,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:08,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:08,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:08,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:08,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:08,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:08,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:08,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:08,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:08,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:08,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:08,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:08,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:08,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:08,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:08,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:08,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:08,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:08,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:08,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:08,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:08,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:08,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:08,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:08,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:08,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:08,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:08,972 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:28:09,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:09,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:09,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:09,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:09,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:09,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:09,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:09,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:09,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:09,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:09,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:09,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:09,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:09,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:09,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:09,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:10,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:10,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:10,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:10,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:10,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:10,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:10,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:10,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:10,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:10,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:10,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:10,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:10,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:10,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:10,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:10,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:12,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:12,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:12,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:12,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:12,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:12,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:12,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:12,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:12,973 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:28:12,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:12,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:12,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:12,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:12,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:12,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:12,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:12,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:14,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:14,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:14,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:14,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:14,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:14,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:14,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:14,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:14,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:14,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:14,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:14,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:14,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:14,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:14,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:14,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:14,974 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:28:15,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:15,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:15,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:15,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:15,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:15,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:15,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:15,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:15,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:15,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:15,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:15,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:15,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:15,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:15,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:15,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:18,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:18,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:18,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:18,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:18,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:18,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:18,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:18,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:18,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:18,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:18,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:18,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:18,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:18,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:18,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:18,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:18,457 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:28:18,976 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:28:19,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:19,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:19,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:19,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:19,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:19,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:19,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:19,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:19,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:19,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:19,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:19,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:19,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:19,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:19,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:19,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:20,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:20,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:20,977 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:28:20,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:20,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:20,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:20,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:20,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:20,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:20,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:20,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:20,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:20,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:20,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:20,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:20,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:20,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:21,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:28:21,886 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:28:22,978 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:28:24,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:24,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:24,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:24,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:24,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:24,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:24,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:24,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:24,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:24,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:24,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:24,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:24,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:24,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:24,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:24,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:24,979 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:28:25,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:25,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:25,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:25,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:25,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:25,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:25,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:25,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:25,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:25,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:25,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:25,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:25,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:25,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:25,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:25,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:26,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:26,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:26,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:26,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:26,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:26,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:26,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:26,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:26,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:26,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:26,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:26,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:26,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:26,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:26,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:26,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:26,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:26,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:26,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:26,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:26,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:26,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:26,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:26,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:26,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:26,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:26,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:26,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:26,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:26,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:26,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:26,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:27,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:27,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:27,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:27,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:27,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:27,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:27,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:27,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:27,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:27,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:27,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:27,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:27,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:27,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:27,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:27,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:27,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:27,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:27,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:27,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:27,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:27,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:27,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:27,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:27,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:27,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:27,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:27,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:27,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:27,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:27,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:27,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:28,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:28,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:28,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:28,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:28,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:28,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:28,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:28,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:28,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:28,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:28,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:28,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:28,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:28,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:28,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:28,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:28,980 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:28:30,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,981 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:28:30,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:30,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:31,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:31,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:31,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:31,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:31,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:31,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:31,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:31,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:31,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:31,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:31,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:31,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:31,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:31,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:31,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:31,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:32,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:32,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:32,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:32,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:32,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:32,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:32,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:32,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:32,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:32,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:32,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:32,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:32,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:32,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:32,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:32,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:32,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:32,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:32,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:32,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:32,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:32,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:32,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:32,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:32,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:32,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:32,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:32,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:32,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:32,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:32,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:32,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:32,981 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:28:33,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:33,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:33,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:33,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:33,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:33,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:33,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:33,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:33,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:33,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:33,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:33,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:33,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:33,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:33,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:33,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:34,982 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:28:35,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:35,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:35,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:35,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:35,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:35,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:35,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:35,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:35,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:35,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:35,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:35,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:35,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:35,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:35,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:35,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:36,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:36,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:36,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:36,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:36,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:36,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:36,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:36,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:36,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:36,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:36,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:36,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:36,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:36,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:36,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:36,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:36,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:36,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:36,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:36,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:36,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:36,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:36,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:36,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:36,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:36,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:36,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:36,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:36,983 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:28:36,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:36,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:36,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:36,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:37,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:28:37,115 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:28:37,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:37,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:37,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:37,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:37,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:37,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:37,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:37,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:37,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:37,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:37,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:37,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:37,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:37,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:37,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:37,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:38,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:39,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:39,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:39,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:39,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:39,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:39,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:39,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:39,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:39,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:39,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:39,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:39,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:39,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:39,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:39,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:39,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:40,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:40,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:40,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:40,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:40,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:40,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:40,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:40,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:40,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:40,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:40,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:40,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:40,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:40,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:40,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:40,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:40,984 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:28:41,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:41,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:41,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:41,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:41,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:41,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:41,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:41,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:41,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:41,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:41,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:41,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:41,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:41,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:41,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:41,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:42,985 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:28:44,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:44,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:44,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:44,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:44,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:44,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:44,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:44,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:44,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:44,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:44,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:44,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:44,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:44,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:44,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:44,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:44,985 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:28:46,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:46,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:46,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:46,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:46,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:46,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:46,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:46,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:46,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:46,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:46,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:46,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:46,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:46,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:46,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:46,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:46,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:46,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:46,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:46,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:46,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:46,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:46,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:46,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:46,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:46,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:46,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:46,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:46,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:46,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:46,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:46,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:46,986 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:28:47,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:47,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:47,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:47,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:47,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:47,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:47,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:47,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:47,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:47,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:47,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:47,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:47,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:47,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:47,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:47,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:48,535 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:28:48,987 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:28:49,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:49,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:49,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:49,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:49,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:49,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:49,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:49,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:49,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:49,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:49,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:49,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:49,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:49,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:49,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:49,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:49,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:49,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:49,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:49,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:49,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:49,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:49,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:49,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:49,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:49,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:49,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:49,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:49,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:49,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:49,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:49,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:50,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:50,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:50,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:50,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:50,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:50,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:50,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:50,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:50,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:50,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:50,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:50,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:50,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:50,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:50,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:50,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:50,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:28:52,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:52,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:52,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:52,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:52,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:52,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:52,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:52,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:52,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:52,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:52,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:52,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:52,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:52,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:52,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:52,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:52,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:28:52,466 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:28:52,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:28:54,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:54,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:54,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:54,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:54,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:54,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:54,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:54,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:54,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:54,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:54,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:54,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:54,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:54,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:54,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:54,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:54,989 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:28:55,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:55,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:55,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:55,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:55,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:55,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:55,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:55,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:55,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:55,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:55,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:55,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:55,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:55,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:55,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:55,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:28:56,990 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:28:58,991 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:29:00,992 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:29:02,993 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:29:03,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:03,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:03,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:03,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:03,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:03,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:03,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:03,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:03,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:03,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:03,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:03,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:03,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:03,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:03,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:03,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:04,994 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:29:06,995 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:29:07,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:29:07,697 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:29:08,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:29:10,997 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:29:12,998 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:29:14,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:29:17,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:29:18,614 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:29:18,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:18,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:18,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:18,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:18,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:18,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:18,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:18,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:18,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:18,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:18,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:18,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:19,001 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:29:21,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:29:22,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:29:22,971 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:29:29,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:29:35,007 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:29:38,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:29:38,228 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:29:39,009 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:29:43,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:29:47,013 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:29:48,683 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:29:51,014 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:29:52,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:52,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:52,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:52,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:52,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:52,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:52,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:52,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:52,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:52,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:52,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:52,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:52,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:52,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:52,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:52,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:29:53,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:29:53,458 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:29:55,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:29:59,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:30:03,019 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:30:03,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:03,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:03,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:03,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:03,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:03,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:03,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:03,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:03,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:03,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:03,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:03,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:03,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:03,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:03,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:03,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:05,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:30:08,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:30:08,884 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:30:09,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:09,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:09,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:09,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:09,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:09,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:09,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:09,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:09,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:09,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:09,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:09,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:09,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:09,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:09,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:09,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:10,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:30:10,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:10,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:10,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:10,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:10,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:10,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:10,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:10,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:10,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:10,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:10,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:10,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:10,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:10,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:10,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:10,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:12,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:30:13,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:13,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:13,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:13,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:13,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:13,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:13,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:13,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:13,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:13,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:14,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:15,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:15,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:15,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:15,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:15,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:15,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:15,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:15,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:15,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:15,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:15,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:15,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:15,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:15,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:15,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:15,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:16,025 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:30:18,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:30:18,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:18,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:18,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:18,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:18,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:18,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:18,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:18,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:18,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:18,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:18,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:18,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:18,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:18,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:18,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:18,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:18,757 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:30:20,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:20,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:20,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:20,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:20,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:20,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:20,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:20,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:20,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:20,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:20,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:20,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:20,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:20,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:20,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:20,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:22,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:30:22,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:22,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:22,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:22,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:22,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:22,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:22,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:22,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:22,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:22,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:22,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:22,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:22,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:22,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:22,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:22,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:24,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:24,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:24,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:24,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:24,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:24,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:24,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:24,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:24,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:24,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:24,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:24,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:24,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:24,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:24,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:24,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:24,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:30:24,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:30:24,107 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:30:25,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:25,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:25,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:25,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:25,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:25,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:25,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:25,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:25,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:25,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:25,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:25,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:25,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:25,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:25,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:25,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:26,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:30:26,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:26,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:26,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:26,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:26,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:26,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:26,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:26,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:26,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:26,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:26,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:26,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:26,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:26,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:26,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:26,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:27,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:27,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:27,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:27,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:27,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:27,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:27,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:27,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:27,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:27,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:27,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:27,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:27,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:27,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:27,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:27,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:29,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:29,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:29,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:29,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:29,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:29,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:29,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:29,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:29,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:29,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:29,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:29,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:29,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:29,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:29,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:29,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:30,031 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:30:31,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:31,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:32,032 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:30:33,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:33,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:33,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:33,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:33,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:33,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:33,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:33,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:33,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:33,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:33,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:33,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:33,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:33,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:33,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:33,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:33,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:33,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:33,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:33,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:33,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:33,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:33,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:33,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:33,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:33,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:33,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:33,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:33,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:33,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:33,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:33,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:34,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:30:34,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:34,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:34,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:34,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:34,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:34,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:34,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:34,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:34,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:34,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:34,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:34,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:34,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:34,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:34,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:34,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:34,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:34,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:34,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:34,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:34,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:34,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:34,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:34,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:34,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:34,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:34,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:34,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:34,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:34,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:34,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:34,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:35,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:35,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:35,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:35,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:35,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:35,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:35,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:35,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:35,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:35,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:35,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:35,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:35,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:35,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:35,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:35,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:36,034 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:30:36,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:36,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:36,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:36,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:36,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:36,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:36,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:36,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:36,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:36,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:36,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:36,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:36,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:36,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:36,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:36,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:36,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:36,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:36,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:36,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:36,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:36,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:36,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:36,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:36,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:36,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:36,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:36,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:36,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:36,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:36,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:36,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:37,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:37,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:37,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:37,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:37,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:37,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:37,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:37,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:37,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:37,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:37,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:37,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:37,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:37,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:37,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:37,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:38,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:39,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:39,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:39,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:39,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:39,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:39,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:39,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:39,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:39,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:39,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:39,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:39,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:39,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:39,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:39,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:39,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:39,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:30:39,388 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:30:40,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:30:40,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:40,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:40,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:40,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:40,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:40,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:40,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:40,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:40,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:40,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:40,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:40,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:40,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:40,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:40,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:40,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:42,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:30:42,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:42,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:42,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:42,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:42,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:42,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:42,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:42,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:42,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:42,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:42,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:42,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:42,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:42,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:42,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:42,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:42,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:42,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:42,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:42,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:42,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:42,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:42,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:42,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:42,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:42,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:42,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:42,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:42,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:42,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:42,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:42,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:43,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:43,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:43,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:43,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:43,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:43,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:43,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:43,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:43,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:43,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:43,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:43,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:43,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:43,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:43,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:43,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:44,038 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:30:44,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:44,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:45,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:45,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:45,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:45,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:45,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:45,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:45,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:45,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:45,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:45,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:45,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:45,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:45,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:45,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:45,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:45,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:45,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:45,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:45,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:45,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:45,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:45,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:45,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:45,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:45,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:45,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:45,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:45,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:45,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:45,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:46,039 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:30:46,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:46,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:46,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:46,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:46,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:46,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:46,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:46,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:46,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:46,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:46,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:46,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:46,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:46,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:46,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:46,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:48,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:30:48,830 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:30:50,041 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:30:50,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:50,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:50,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:50,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:50,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:50,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:50,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:50,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:50,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:50,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:50,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:50,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:50,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:50,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:50,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:50,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:51,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:51,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:51,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:51,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:51,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:51,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:51,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:51,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:51,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:51,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:51,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:51,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:51,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:51,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:51,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:51,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:52,042 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:30:52,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:52,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:52,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:52,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:52,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:52,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:52,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:52,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:52,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:52,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:52,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:52,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:52,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:52,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:52,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:52,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:53,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:53,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:53,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:53,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:53,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:53,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:53,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:53,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:53,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:53,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:53,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:53,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:53,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:53,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:53,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:53,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:54,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:30:54,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:30:54,718 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:30:54,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:54,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:54,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:54,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:54,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:54,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:54,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:54,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:54,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:54,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:54,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:54,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:54,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:54,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:54,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:54,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:54,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:54,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:54,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:54,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:54,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:54,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:54,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:54,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:54,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:54,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:54,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:54,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:54,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:54,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:54,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:54,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:55,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:55,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:55,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:55,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:55,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:55,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:55,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:55,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:55,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:55,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:55,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:55,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:55,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:55,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:55,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:55,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:56,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:30:56,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:56,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:56,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:56,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:56,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:56,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:56,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:56,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:56,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:56,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:56,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:56,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:56,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:56,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:56,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:56,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:58,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:30:58,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:58,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:58,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:58,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:58,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:58,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:58,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:58,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:58,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:58,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:58,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:58,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:58,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:58,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:58,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:30:58,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:00,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:31:02,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:31:04,047 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:31:06,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:31:08,049 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:31:08,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:08,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:08,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:08,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:08,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:08,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:08,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:08,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:08,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:08,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:08,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:08,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:08,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:08,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:08,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:08,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:09,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:31:09,981 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:31:10,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:31:12,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:31:14,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:31:16,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:31:18,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:31:18,903 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:31:20,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:31:20,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:20,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:20,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:20,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:20,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:20,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:20,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:20,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:20,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:20,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:20,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:20,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:20,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:21,044 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 15:31:21,304 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 15:31:21,375 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 15:31:22,160 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 15:31:22,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:31:25,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:31:25,242 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:31:30,164 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:31:37,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:31:40,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:31:40,469 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:31:41,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:31:45,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:31:49,039 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:31:49,172 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:31:53,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:31:55,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:31:55,699 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:31:57,175 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:31:58,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:58,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:58,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:58,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:58,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:58,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:58,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:58,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:58,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:58,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:58,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:58,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:58,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:58,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:58,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:58,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:31:59,176 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:32:03,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:32:07,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:32:09,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:32:11,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:32:11,083 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:32:13,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:32:13,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:13,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:13,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:13,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:13,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:13,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:13,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:13,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:13,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:13,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:13,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:13,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:13,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:13,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:13,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:13,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:13,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:13,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:13,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:13,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:13,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:13,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:13,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:13,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:13,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:13,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:13,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:13,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:13,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:13,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:13,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:13,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:14,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:14,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:14,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:14,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:14,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:14,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:14,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:14,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:14,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:14,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:14,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:14,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:14,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:14,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:14,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:14,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:15,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:32:17,184 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:32:19,112 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:32:19,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:19,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:19,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:19,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:19,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:19,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:19,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:19,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:19,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:19,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:19,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:19,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:19,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:19,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:19,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:19,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:20,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:20,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:20,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:20,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:20,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:20,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:20,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:20,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:20,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:20,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:20,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:20,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:20,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:20,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:20,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:20,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:21,186 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:32:22,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:22,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:22,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:22,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:22,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:22,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:22,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:22,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:22,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:22,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:22,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:22,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:22,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:22,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:22,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:22,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:22,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:22,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:22,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:22,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:22,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:22,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:22,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:22,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:22,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:22,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:22,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:22,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:22,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:22,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:22,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:22,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:23,187 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:32:23,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:23,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:23,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:23,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:23,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:23,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:23,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:23,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:23,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:23,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:23,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:23,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:23,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:23,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:23,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:23,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:24,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:24,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:24,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:24,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:24,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:24,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:24,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:24,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:24,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:24,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:24,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:24,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:24,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:24,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:24,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:24,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:25,188 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:32:26,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:26,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:26,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:26,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:26,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:26,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:26,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:26,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:26,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:26,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:26,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:26,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:26,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:26,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:26,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:26,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:26,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:26,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:26,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:26,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:26,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:26,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:26,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:26,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:26,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:26,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:26,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:26,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:26,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:26,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:26,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:26,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:26,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:32:26,313 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:32:28,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:28,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:28,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:28,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:28,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:28,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:28,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:28,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:28,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:28,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:28,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:28,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:28,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:28,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:28,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:28,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:28,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:28,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:28,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:28,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:28,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:28,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:28,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:28,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:28,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:28,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:28,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:28,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:28,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:28,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:28,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:28,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:29,189 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:32:30,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:30,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:30,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:30,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:30,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:30,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:30,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:30,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:30,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:30,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:30,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:30,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:30,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:30,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:30,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:30,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:31,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:32:33,191 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:32:34,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:34,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:35,191 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:32:37,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:37,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:37,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:37,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:37,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:37,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:37,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:37,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:37,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:37,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:37,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:37,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:37,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:37,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:37,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:37,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:37,192 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:32:38,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:38,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:38,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:38,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:38,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:38,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:38,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:38,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:38,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:38,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:38,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:38,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:38,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:38,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:38,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:38,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:38,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:38,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:38,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:38,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:38,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:38,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:38,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:38,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:38,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:38,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:38,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:38,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:38,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:38,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:38,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:38,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:39,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:39,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:39,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:39,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:39,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:39,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:39,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:39,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:39,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:39,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:39,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:39,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:39,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:39,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:39,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:39,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:39,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:39,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:39,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:39,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:39,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:39,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:39,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:39,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:39,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:39,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:39,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:39,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:39,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:39,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:39,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:39,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:40,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:32:41,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:41,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:32:41,583 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:32:43,194 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:32:43,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:43,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:43,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:43,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:43,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:43,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:43,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:43,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:43,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:43,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:43,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:43,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:43,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:43,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:43,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:43,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:43,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:43,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:43,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:43,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:43,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:43,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:43,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:43,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:43,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:43,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:43,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:43,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:43,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:43,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:43,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:43,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:44,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:44,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:44,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:44,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:44,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:44,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:44,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:44,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:44,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:44,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:44,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:44,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:44,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:44,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:44,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:44,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:45,195 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:32:45,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:45,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:45,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:45,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:45,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:45,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:45,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:45,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:45,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:45,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:45,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:45,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:45,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:45,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:45,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:45,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:46,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:46,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:46,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:46,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:46,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:46,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:46,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:46,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:46,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:46,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:46,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:46,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:46,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:46,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:46,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:46,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:47,196 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:32:47,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:47,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:47,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:47,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:47,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:47,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:47,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:47,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:47,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:47,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:47,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:47,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:47,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:47,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:47,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:47,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:48,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:48,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:48,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:48,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:48,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:48,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:48,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:48,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:48,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:48,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:48,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:48,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:48,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:48,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:48,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:48,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:49,180 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:32:49,197 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:32:50,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:50,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:50,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:50,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:50,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:50,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:50,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:50,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:50,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:50,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:50,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:50,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:50,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:50,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:50,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:50,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:51,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:32:52,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:52,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:52,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:52,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:52,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:52,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:52,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:52,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:52,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:52,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:52,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:52,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:52,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:52,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:52,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:52,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:53,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:32:53,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:53,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:53,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:53,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:53,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:53,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:53,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:53,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:53,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:53,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:53,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:53,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:53,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:53,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:53,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:53,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:53,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:53,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:53,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:53,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:53,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:53,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:53,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:53,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:53,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:53,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:53,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:53,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:53,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:53,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:53,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:53,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:55,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:55,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:55,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:55,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:55,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:55,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:55,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:55,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:55,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:55,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:55,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:55,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:55,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:55,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:55,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:55,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:55,199 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:32:56,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:56,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:56,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:56,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:56,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:56,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:56,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:56,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:56,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:56,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:56,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:56,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:56,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:56,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:56,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:56,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:56,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:32:56,854 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:32:57,200 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:32:57,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:57,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:57,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:57,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:57,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:57,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:57,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:57,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:57,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:57,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:57,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:57,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:57,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:57,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:57,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:57,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:58,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:58,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:58,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:58,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:58,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:58,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:58,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:58,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:58,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:58,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:58,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:58,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:58,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:58,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:58,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:58,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:32:59,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:33:00,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:00,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:00,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:00,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:00,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:00,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:00,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:00,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:00,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:00,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:00,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:00,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:00,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:00,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:00,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:00,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:01,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:33:01,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:01,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:01,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:01,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:01,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:01,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:01,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:01,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:01,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:01,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:01,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:01,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:01,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:01,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:01,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:01,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:03,202 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:33:05,203 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:33:07,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:07,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:07,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:07,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:07,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:07,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:07,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:07,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:07,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:07,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:07,205 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:33:07,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:07,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:07,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:07,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:07,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:07,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:09,205 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:33:11,207 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:33:12,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:33:12,164 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:33:13,207 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:33:15,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:33:17,209 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:33:18,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:18,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:18,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:18,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:18,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:18,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:18,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:18,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:18,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:18,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:18,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:18,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:19,209 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:33:19,256 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:33:27,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:33:27,390 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:33:29,212 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:33:35,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:33:39,215 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:33:42,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:33:42,624 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:33:43,217 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:33:47,219 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:33:49,329 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:33:51,221 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:33:56,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:33:57,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:33:57,879 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:33:58,224 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:33:59,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:59,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:59,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:59,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:59,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:59,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:59,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:59,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:59,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:59,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:59,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:59,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:59,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:59,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:59,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:33:59,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:02,225 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:34:06,227 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:34:08,228 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:34:12,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:34:13,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:34:13,161 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:34:14,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:34:18,232 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:34:19,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:19,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:19,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:19,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:19,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:19,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:19,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:19,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:19,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:19,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:19,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:19,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:19,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:19,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:19,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:19,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:19,404 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:34:20,233 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:34:20,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:20,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:20,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:20,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:20,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:20,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:20,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:20,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:20,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:20,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:20,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:20,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:20,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:20,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:20,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:20,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:20,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:20,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:20,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:20,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:20,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:20,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:20,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:20,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:20,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:20,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:20,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:20,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:20,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:20,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:20,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:20,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:24,235 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:34:24,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:24,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:24,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:24,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:24,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:24,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:24,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:24,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:24,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:24,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:24,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:24,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:24,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:24,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:24,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:24,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:24,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:24,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:24,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:24,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:24,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:24,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:24,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:24,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:24,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:24,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:24,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:24,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:24,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:24,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:24,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:24,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:25,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:25,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:25,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:25,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:25,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:25,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:25,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:25,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:25,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:25,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:25,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:25,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:25,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:25,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:25,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:25,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:26,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:34:27,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:27,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:27,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:27,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:27,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:27,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:27,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:27,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:27,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:27,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:27,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:27,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:27,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:27,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:27,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:27,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:27,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:27,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:27,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:27,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:27,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:27,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:27,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:27,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:27,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:27,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:27,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:27,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:27,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:27,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:27,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:27,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:28,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:34:28,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:34:28,387 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:34:30,237 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:34:31,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:31,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:31,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:31,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:31,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:31,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:31,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:31,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:31,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:31,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:31,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:31,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:31,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:31,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:31,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:31,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:32,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:32,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:32,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:32,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:32,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:32,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:32,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:32,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:32,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:32,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:32,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:32,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:32,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:32,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:32,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:32,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:32,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:32,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:32,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:32,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:32,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:32,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:32,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:32,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:32,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:32,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:32,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:32,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:32,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:32,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:32,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:32,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:33,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:33,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:33,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:33,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:33,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:33,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:33,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:33,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:33,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:33,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:33,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:33,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:33,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:33,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:33,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:33,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:33,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:33,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:33,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:33,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:33,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:33,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:33,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:33,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:33,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:33,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:33,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:33,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:33,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:33,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:33,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:33,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:34,240 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:34:36,240 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:34:37,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:37,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:37,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:37,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:37,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:37,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:37,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:37,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:37,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:37,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:37,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:37,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:37,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:37,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:37,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:37,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:38,241 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:34:39,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:39,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:40,242 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:34:42,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:42,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:42,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:42,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:42,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:42,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:42,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:42,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:42,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:42,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:42,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:42,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:42,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:42,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:42,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:42,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:42,243 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:34:43,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:43,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:43,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:43,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:43,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:43,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:43,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:43,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:43,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:43,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:43,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:43,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:43,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:43,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:43,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:43,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:43,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:34:43,680 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:34:44,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:44,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:44,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:44,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:44,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:44,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:44,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:44,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:44,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:44,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:44,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:44,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:44,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:44,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:44,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:44,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:44,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:44,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:44,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:44,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:44,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:44,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:44,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:44,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:44,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:44,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:44,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:44,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:44,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:44,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:44,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:44,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:45,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:46,244 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:34:46,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:46,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:46,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:46,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:46,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:46,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:46,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:46,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:46,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:46,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:46,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:46,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:46,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:46,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:46,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:46,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:47,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:47,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:47,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:47,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:47,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:47,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:47,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:47,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:47,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:47,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:47,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:47,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:47,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:47,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:47,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:47,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:48,245 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:34:48,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:48,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:48,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:48,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:48,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:48,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:48,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:48,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:48,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:48,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:48,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:48,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:48,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:48,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:48,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:48,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:49,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:49,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:49,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:49,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:49,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:49,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:49,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:49,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:49,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:49,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:49,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:49,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:49,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:49,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:49,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:49,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:49,478 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:34:50,246 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:34:50,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:50,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:51,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:51,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:51,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:51,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:51,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:51,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:51,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:51,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:51,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:51,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:51,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:51,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:51,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:51,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:51,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:51,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:52,247 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:34:52,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:52,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:52,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:52,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:52,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:52,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:52,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:52,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:52,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:52,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:52,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:52,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:52,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:52,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:52,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:52,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:54,248 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:34:54,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:54,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:54,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:54,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:54,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:54,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:54,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:54,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:54,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:54,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:54,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:54,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:54,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:54,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:54,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:54,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:55,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:55,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:55,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:55,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:55,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:55,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:55,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:55,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:55,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:55,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:55,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:55,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:55,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:55,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:55,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:55,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:55,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:55,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:55,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:55,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:55,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:55,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:55,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:55,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:55,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:55,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:55,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:55,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:55,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:55,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:55,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:55,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:56,248 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:34:56,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:56,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:56,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:56,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:56,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:56,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:56,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:56,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:56,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:56,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:56,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:56,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:56,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:56,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:56,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:56,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:56,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:56,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:56,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:56,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:56,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:56,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:56,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:56,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:56,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:56,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:56,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:56,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:56,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:56,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:56,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:56,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:58,249 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:34:58,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:58,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:58,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:58,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:58,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:58,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:58,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:58,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:58,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:58,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:58,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:58,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:58,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:58,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:58,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:58,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:58,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:34:58,916 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:34:58,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:58,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:58,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:58,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:58,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:58,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:58,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:58,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:58,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:58,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:58,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:58,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:58,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:58,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:58,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:58,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:59,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:59,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:59,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:59,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:59,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:59,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:59,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:59,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:59,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:59,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:59,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:59,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:59,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:59,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:59,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:34:59,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:00,250 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:35:00,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:00,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:00,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:00,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:00,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:00,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:00,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:00,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:00,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:00,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:00,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:00,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:00,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:00,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:00,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:00,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:02,251 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:35:02,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:02,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:02,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:02,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:02,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:02,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:02,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:02,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:02,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:02,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:02,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:02,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:02,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:02,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:02,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:02,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:04,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:04,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:04,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:04,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:04,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:04,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:04,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:04,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:04,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:04,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:04,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:04,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:04,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:04,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:04,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:04,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:04,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:04,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:04,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:04,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:04,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:04,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:04,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:04,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:04,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:04,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:04,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:04,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:04,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:04,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:04,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:04,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:04,251 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:35:06,252 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:35:08,253 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:35:10,254 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:35:12,254 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:35:14,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:35:14,149 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:35:14,255 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:35:15,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:15,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:15,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:15,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:15,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:15,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:15,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:15,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:15,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:15,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:15,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:15,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:15,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:15,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:15,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:15,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:16,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:35:18,257 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:35:19,553 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:35:20,257 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:35:20,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:20,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:20,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:20,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:20,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:20,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:20,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:20,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:20,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:20,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:20,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:20,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:20,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:35:20,702 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 15:35:20,927 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 15:35:21,005 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 15:35:21,258 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 15:35:21,258 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:35:22,258 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:35:29,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:35:29,380 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:35:32,262 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:35:38,264 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:35:42,266 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:35:44,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:35:44,609 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:35:46,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:35:49,676 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:35:50,270 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:35:54,271 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:35:58,273 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:36:00,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:36:00,181 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:36:02,275 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:36:04,276 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:36:07,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:07,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:07,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:07,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:07,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:07,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:07,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:07,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:07,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:07,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:07,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:07,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:07,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:07,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:07,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:07,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:08,277 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:36:10,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:36:14,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:36:15,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:36:15,445 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:36:16,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:36:19,751 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:36:21,283 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:36:23,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:36:26,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:26,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:26,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:26,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:26,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:26,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:26,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:26,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:26,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:26,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:26,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:26,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:26,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:26,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:26,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:26,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:27,286 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:36:28,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:28,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:28,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:28,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:28,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:28,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:28,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:28,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:28,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:28,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:28,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:28,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:28,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:28,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:28,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:28,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:28,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:28,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:28,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:28,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:28,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:28,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:28,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:28,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:28,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:28,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:28,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:28,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:28,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:28,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:28,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:28,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:29,286 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:36:30,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:36:30,710 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:36:31,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:36:31,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:31,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:31,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:31,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:31,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:31,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:31,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:31,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:31,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:31,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:31,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:31,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:31,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:31,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:31,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:31,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:32,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:32,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:32,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:32,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:32,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:32,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:32,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:32,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:32,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:32,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:32,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:32,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:32,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:32,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:32,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:32,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:35,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:36:35,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:35,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:35,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:35,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:35,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:35,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:35,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:35,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:35,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:35,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:35,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:35,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:35,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:35,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:35,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:35,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:35,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:35,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:35,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:35,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:35,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:35,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:35,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:35,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:35,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:35,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:35,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:35,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:35,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:35,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:35,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:35,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:36,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:36,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:36,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:36,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:36,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:36,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:36,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:36,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:36,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:36,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:36,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:36,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:36,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:36,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:36,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:36,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:36,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:36,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:36,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:36,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:36,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:36,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:36,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:36,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:36,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:36,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:36,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:36,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:36,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:36,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:36,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:36,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:37,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:36:39,290 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:36:40,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:40,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:40,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:40,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:40,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:40,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:40,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:40,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:40,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:40,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:40,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:40,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:40,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:40,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:40,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:40,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:41,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:41,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:41,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:41,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:41,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:41,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:41,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:41,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:41,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:41,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:41,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:41,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:41,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:41,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:41,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:41,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:41,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:36:42,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:42,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:42,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:42,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:42,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:42,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:42,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:42,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:42,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:42,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:42,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:42,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:42,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:42,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:42,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:42,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:43,292 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:36:43,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:43,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:43,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:43,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:43,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:43,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:43,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:43,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:43,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:43,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:43,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:43,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:43,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:43,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:43,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:43,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:45,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:45,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:45,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:45,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:45,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:45,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:45,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:45,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:45,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:45,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:45,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:45,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:45,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:45,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:45,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:45,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:46,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:36:46,040 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:36:46,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:46,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:46,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:46,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:46,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:46,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:46,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:46,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:46,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:46,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:46,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:46,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:46,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:46,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:46,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:46,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:47,293 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:36:47,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:47,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:47,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:47,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:47,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:47,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:47,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:47,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:47,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:47,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:47,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:47,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:47,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:47,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:47,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:47,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:49,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:36:49,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:49,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:49,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:49,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:49,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:49,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:49,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:49,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:49,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:49,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:49,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:49,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:49,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:49,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:49,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:49,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:49,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:49,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:49,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:49,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:49,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:49,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:49,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:49,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:49,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:49,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:49,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:49,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:49,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:49,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:49,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:49,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:49,825 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:36:50,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:50,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:50,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:50,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:50,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:50,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:50,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:50,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:50,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:50,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:50,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:50,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:50,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:50,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:50,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:50,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:51,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:36:52,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:52,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:53,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:36:53,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:53,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:53,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:53,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:53,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:53,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:53,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:53,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:53,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:53,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:53,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:53,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:53,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:53,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:53,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:53,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:53,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:53,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:53,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:53,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:53,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:53,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:53,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:53,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:53,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:53,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:53,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:53,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:53,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:53,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:53,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:53,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:55,296 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:36:55,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:55,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:55,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:55,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:55,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:55,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:55,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:55,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:55,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:55,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:55,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:55,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:55,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:55,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:55,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:55,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:55,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:55,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:55,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:55,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:55,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:55,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:55,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:55,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:55,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:55,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:55,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:55,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:55,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:55,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:55,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:55,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:57,297 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:36:57,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:57,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:57,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:57,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:57,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:57,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:57,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:57,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:57,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:57,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:57,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:57,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:57,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:57,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:57,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:57,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:58,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:58,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:58,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:58,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:58,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:58,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:58,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:58,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:58,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:58,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:58,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:58,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:58,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:58,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:58,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:58,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:59,297 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:36:59,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:59,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:59,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:59,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:59,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:59,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:59,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:59,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:59,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:59,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:59,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:59,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:59,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:59,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:59,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:36:59,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:00,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:00,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:00,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:00,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:00,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:00,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:00,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:00,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:00,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:00,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:00,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:00,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:00,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:00,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:00,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:00,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:00,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:00,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:00,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:00,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:00,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:00,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:00,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:00,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:00,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:00,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:00,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:00,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:00,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:00,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:00,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:00,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:37:01,268 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:37:01,298 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:37:01,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:01,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:02,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:02,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:02,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:02,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:02,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:02,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:02,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:02,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:02,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:02,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:02,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:02,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:02,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:02,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:02,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:02,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:02,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:02,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:02,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:02,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:02,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:02,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:02,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:02,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:02,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:02,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:02,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:02,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:02,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:02,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:02,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:02,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:03,299 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:37:04,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:04,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:05,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:05,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:05,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:05,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:05,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:05,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:05,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:05,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:05,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:05,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:05,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:05,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:05,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:05,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:05,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:05,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:05,300 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:37:07,301 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:37:08,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:08,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:08,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:08,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:08,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:08,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:08,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:08,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:08,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:08,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:08,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:08,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:08,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:08,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:08,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:08,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:08,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:08,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:08,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:08,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:08,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:08,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:08,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:08,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:08,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:08,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:08,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:08,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:08,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:08,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:08,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:08,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:09,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:37:09,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:09,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:09,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:09,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:09,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:09,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:09,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:09,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:09,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:09,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:09,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:09,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:09,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:09,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:09,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:09,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:10,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:10,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:10,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:10,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:10,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:10,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:10,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:10,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:10,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:10,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:10,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:10,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:10,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:10,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:10,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:10,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:11,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:37:13,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:37:15,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:37:16,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:37:16,492 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:37:17,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:37:19,306 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:37:19,900 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:37:21,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:21,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:21,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:21,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:21,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:21,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:21,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:21,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:21,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:21,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:21,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:21,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:21,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:21,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:21,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:21,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:21,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:37:23,308 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:37:24,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:24,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:24,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:24,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:24,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:24,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:24,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:24,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:24,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:24,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:24,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:24,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:37:25,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:37:31,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:37:31,719 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:37:33,311 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:37:39,314 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:37:43,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:37:46,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:37:46,947 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:37:47,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:37:49,972 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:37:51,318 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:37:55,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:37:57,321 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:38:01,322 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:38:02,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:38:02,305 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:38:05,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:38:07,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:38:11,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:11,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:11,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:11,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:11,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:11,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:11,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:11,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:11,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:11,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:11,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:11,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:11,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:11,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:11,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:11,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:12,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:38:14,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:38:16,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:38:17,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:38:17,617 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:38:20,045 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:38:20,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:38:22,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:38:24,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:38:28,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:38:30,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:30,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:30,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:30,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:30,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:30,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:30,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:30,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:30,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:30,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:30,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:30,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:30,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:30,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:30,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:30,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:30,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:38:32,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:32,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:32,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:32,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:32,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:32,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:32,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:32,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:32,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:32,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:32,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:32,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:32,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:32,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:32,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:32,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:32,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:38:33,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:38:33,084 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:38:34,335 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:38:34,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:34,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:34,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:34,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:34,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:34,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:34,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:34,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:34,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:34,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:34,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:34,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:34,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:34,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:34,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:34,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:36,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:38:36,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:37,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:39,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:39,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:39,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:39,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:39,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:39,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:39,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:39,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:39,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:39,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:39,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:39,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:39,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:39,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:39,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:39,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:40,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:38:40,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:40,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:40,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:40,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:40,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:40,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:40,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:40,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:40,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:40,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:40,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:40,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:40,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:40,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:40,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:40,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:41,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:41,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:41,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:41,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:41,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:41,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:41,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:41,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:41,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:41,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:41,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:41,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:41,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:41,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:41,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:41,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:41,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:41,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:41,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:41,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:41,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:41,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:41,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:41,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:41,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:41,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:41,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:41,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:41,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:41,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:41,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:41,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:42,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:38:43,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:43,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:43,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:43,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:43,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:43,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:43,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:43,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:43,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:43,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:43,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:43,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:43,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:43,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:43,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:43,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:43,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:43,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:43,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:43,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:43,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:43,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:43,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:43,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:43,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:43,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:43,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:43,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:43,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:43,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:43,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:43,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:44,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:38:46,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:46,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:46,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:46,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:46,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:46,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:46,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:46,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:46,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:46,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:46,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:46,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:46,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:46,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:46,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:46,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:46,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:38:47,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:47,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:47,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:47,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:47,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:47,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:47,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:47,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:47,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:47,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:47,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:47,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:47,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:47,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:47,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:47,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:47,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:47,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:47,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:47,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:47,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:47,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:47,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:47,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:47,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:47,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:47,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:47,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:47,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:47,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:47,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:47,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:48,342 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:38:48,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:38:48,364 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:38:50,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:50,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:50,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:50,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:50,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:50,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:50,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:50,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:50,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:50,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:50,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:50,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:50,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:50,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:50,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:50,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:50,120 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:38:50,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:38:51,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:51,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:51,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:51,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:51,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:51,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:51,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:51,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:51,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:51,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:51,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:51,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:51,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:51,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:51,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:51,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:51,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:51,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:51,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:51,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:51,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:51,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:51,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:51,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:51,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:51,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:51,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:51,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:51,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:51,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:51,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:51,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:52,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:52,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:52,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:52,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:52,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:52,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:52,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:52,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:52,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:52,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:52,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:52,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:52,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:52,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:52,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:52,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:52,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:38:53,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:53,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:53,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:53,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:53,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:53,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:53,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:53,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:53,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:53,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:53,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:53,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:53,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:53,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:53,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:53,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:54,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:54,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:54,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:54,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:54,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:54,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:54,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:54,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:54,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:54,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:54,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:54,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:54,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:54,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:54,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:54,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:54,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:38:54,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:54,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:54,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:54,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:54,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:54,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:54,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:54,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:54,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:54,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:54,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:54,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:54,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:54,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:54,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:54,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:55,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:56,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:38:56,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:56,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:56,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:56,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:56,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:56,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:56,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:56,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:56,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:57,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:57,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:57,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:57,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:57,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:57,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:57,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:58,346 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:38:59,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:59,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:59,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:59,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:59,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:59,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:59,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:59,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:59,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:59,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:59,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:59,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:59,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:59,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:59,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:38:59,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:00,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:39:00,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:00,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:00,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:00,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:00,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:00,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:00,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:00,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:00,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:00,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:00,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:00,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:00,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:00,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:00,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:00,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,348 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:39:02,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:02,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:03,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:03,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:03,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:03,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:03,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:03,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:03,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:03,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:03,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:03,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:03,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:03,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:03,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:03,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:03,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:03,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:03,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:03,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:03,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:03,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:03,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:03,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:03,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:03,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:03,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:03,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:03,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:03,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:03,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:03,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:03,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:03,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:03,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:39:03,674 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:39:04,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:39:04,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:04,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:04,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:04,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:04,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:04,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:04,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:04,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:04,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:04,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:04,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:04,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:04,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:04,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:04,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:04,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:04,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:04,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:04,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:04,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:04,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:04,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:04,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:04,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:04,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:04,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:04,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:04,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:04,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:04,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:04,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:04,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:05,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:05,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:05,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:05,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:05,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:05,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:05,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:05,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:05,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:05,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:05,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:05,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:05,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:05,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:05,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:05,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:06,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:06,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:06,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:06,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:06,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:06,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:06,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:06,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:06,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:06,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:06,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:06,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:06,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:06,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:06,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:06,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:06,350 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:39:08,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:39:08,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:08,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:10,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:10,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:10,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:10,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:10,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:10,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:10,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:10,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:10,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:10,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:10,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:10,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:10,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:10,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:10,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:10,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:10,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:39:12,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:39:14,354 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:39:16,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:39:18,356 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:39:18,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:39:18,911 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:39:20,195 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:39:20,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:39:20,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:20,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:20,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:20,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:20,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:20,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:20,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:20,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:20,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:20,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:20,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:20,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:20,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 15:39:20,897 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 15:39:21,117 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 15:39:21,195 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 15:39:21,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 15:39:22,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:39:24,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:39:26,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:39:28,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:39:30,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:39:32,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:39:34,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:39:34,214 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:39:34,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:39:36,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:39:38,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:39:40,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:39:42,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:39:44,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:39:46,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:39:48,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:39:49,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:39:49,510 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:39:50,344 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:39:50,371 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:39:52,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:39:54,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:39:56,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:39:58,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:40:01,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:40:03,376 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:40:04,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:40:04,741 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:40:05,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:40:07,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:40:09,379 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:40:11,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:40:13,381 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:40:15,382 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:40:17,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:40:19,384 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:40:20,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:40:20,150 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:40:20,421 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:40:21,384 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:40:23,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:40:25,386 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:40:27,387 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:40:29,388 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:40:31,389 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:40:33,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:40:35,391 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:40:35,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:40:35,418 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:40:37,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:40:39,393 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:40:41,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:40:43,395 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:40:45,396 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:40:47,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:40:49,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:40:50,495 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:40:50,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:40:50,636 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:40:51,399 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:40:53,399 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:40:55,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:40:57,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:40:59,402 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:41:01,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:41:03,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:41:05,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:41:05,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:41:05,946 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:41:08,407 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:41:10,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:41:12,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:41:14,409 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:41:16,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:41:18,411 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:41:20,412 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:41:20,569 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:41:21,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:41:21,698 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:41:22,413 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:41:24,414 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:41:26,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:41:28,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:41:30,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:41:32,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:41:34,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:41:36,419 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:41:36,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:41:36,958 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:41:38,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:41:40,421 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:41:42,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:41:44,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:41:46,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:41:48,425 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:41:50,425 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:41:50,642 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:41:52,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:41:52,338 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:41:52,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:41:54,427 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:41:56,428 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:41:58,429 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:42:00,430 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:42:02,431 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:42:04,432 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:42:07,433 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:42:07,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:42:07,615 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:42:09,434 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:42:11,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:42:13,436 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:42:15,437 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:42:17,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:42:19,439 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:42:20,716 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:42:21,440 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:42:22,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:42:22,834 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:42:23,441 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:42:25,442 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:42:27,443 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:42:29,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:42:31,445 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:42:33,446 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:42:35,447 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:42:37,448 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:42:38,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:42:38,062 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:42:39,449 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:42:41,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:42:43,451 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:42:45,452 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:42:47,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:42:49,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:42:50,787 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:42:51,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:42:53,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:42:53,374 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:42:53,455 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:42:55,456 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:42:57,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:42:59,458 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:43:01,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:43:03,460 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:43:05,461 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:43:07,462 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:43:08,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:43:08,598 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:43:09,463 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:43:11,464 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:43:13,465 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:43:15,466 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:43:17,467 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:43:19,468 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:43:20,863 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:43:21,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:43:23,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:43:24,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:43:24,044 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:43:25,470 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:43:27,471 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:43:29,472 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:43:32,474 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:43:34,475 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:43:36,476 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:43:38,477 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:43:39,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:43:39,276 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:43:40,478 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:43:42,478 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:43:44,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:43:46,480 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:43:48,481 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:43:50,482 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:43:50,939 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:43:52,483 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:43:54,484 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:43:54,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:43:54,532 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:43:56,485 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:43:58,486 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:44:00,487 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:44:02,487 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:44:04,488 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:44:06,489 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:44:08,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:44:09,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:44:09,789 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:44:10,491 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:44:12,491 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:44:14,492 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:44:16,493 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:44:18,494 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:44:20,495 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:44:21,015 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:44:22,496 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:44:24,497 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:44:25,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:44:25,101 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:44:26,498 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:44:29,499 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:44:31,500 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:44:33,501 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:44:35,502 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:44:37,503 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:44:39,504 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:44:40,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:44:40,571 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:44:41,505 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:44:43,506 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:44:45,506 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:44:47,507 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:44:49,508 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:44:51,090 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:44:51,509 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:44:53,510 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:44:55,510 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:44:55,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:44:55,830 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:44:57,511 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:44:59,512 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:45:01,513 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:45:03,514 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:45:05,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:45:07,516 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:45:09,517 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:45:11,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:45:11,199 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:45:11,517 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:45:13,518 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:45:15,519 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:45:17,521 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:45:19,522 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:45:21,165 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:45:21,523 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:45:23,524 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:45:25,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:45:26,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:45:26,458 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:45:27,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:45:29,526 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:45:31,527 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:45:33,528 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:45:35,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:45:37,530 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:45:39,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:45:41,532 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:45:41,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:45:41,771 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:45:43,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:45:45,534 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:45:47,535 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:45:49,536 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:45:51,242 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:45:51,537 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:45:53,538 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:45:55,539 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:45:56,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:45:56,996 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:45:58,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:46:00,541 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:46:02,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:46:04,543 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:46:06,544 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:46:08,545 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:46:10,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:46:12,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:46:12,233 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:46:12,547 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:46:14,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:46:16,549 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:46:18,550 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:46:20,551 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:46:21,317 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:46:22,552 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:46:24,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:46:26,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:46:27,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:46:27,521 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:46:28,563 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:46:30,563 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:46:32,564 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:46:34,565 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:46:36,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:46:38,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:46:40,567 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:46:42,568 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:46:42,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:46:42,794 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:46:44,569 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:46:46,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:46:48,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:46:50,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:46:51,391 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:46:52,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:46:54,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:46:56,574 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:46:58,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:46:58,076 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:46:58,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:47:00,576 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:47:02,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:47:04,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:47:06,578 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:47:08,579 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:47:10,580 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:47:12,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:47:13,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:47:13,441 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:47:14,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:47:16,583 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:47:18,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:47:20,585 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:47:21,468 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:47:22,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:47:24,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:47:26,587 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:47:28,588 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:47:28,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:47:28,661 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:47:30,589 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:47:32,590 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:47:34,591 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:47:36,592 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:47:38,593 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:47:40,594 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:47:42,595 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:47:43,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:47:43,882 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:47:44,596 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:47:46,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:47:48,598 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:47:51,543 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:47:51,599 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:47:53,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:47:55,601 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:47:57,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:47:59,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:47:59,217 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:47:59,603 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:48:01,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:48:03,605 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:48:05,605 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:48:07,606 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:48:09,607 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:48:11,608 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:48:13,609 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:48:14,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:48:14,489 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:48:15,610 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:48:17,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:48:19,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:48:21,613 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:48:21,616 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:48:23,614 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:48:25,615 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:48:27,615 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:48:29,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:48:29,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:48:29,721 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:48:31,617 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:48:33,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:48:35,619 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:48:37,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:48:39,621 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:48:42,622 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:48:44,623 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:48:44,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:48:44,947 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:48:46,624 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:48:48,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:48:50,626 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:48:51,690 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:48:52,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:48:54,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:48:56,629 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:48:58,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:49:00,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:49:00,225 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:49:00,631 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:49:02,632 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:49:04,632 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:49:06,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:49:08,634 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:49:10,635 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:49:12,636 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:49:14,637 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:49:15,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:49:15,539 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:49:16,638 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:49:18,639 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:49:20,640 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:49:21,764 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:49:22,641 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:49:24,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:49:26,643 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:49:29,644 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:49:30,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:49:30,772 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:49:31,646 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:49:33,646 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:49:35,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:49:37,648 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:49:39,649 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:49:41,649 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:49:43,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:49:45,651 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:49:46,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:49:46,325 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:49:47,652 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:49:49,653 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:49:51,653 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:49:51,844 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:49:53,654 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:49:55,655 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:49:57,655 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:49:59,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:50:01,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:50:01,617 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:50:01,657 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:50:03,658 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:50:05,658 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:50:07,659 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:50:09,660 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:50:11,660 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:50:13,661 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:50:15,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:50:16,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:50:16,846 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:50:17,663 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:50:19,664 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:50:21,665 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:50:21,919 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:50:23,666 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:50:25,667 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:50:27,668 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:50:29,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:50:31,670 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:50:32,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:50:32,213 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:50:34,671 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:50:36,672 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:50:38,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:50:40,674 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:50:42,675 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:50:44,676 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:50:46,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:50:47,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:50:47,625 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:50:48,678 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:50:50,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:50:51,993 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:50:52,680 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:50:54,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:50:56,682 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:50:58,683 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:51:00,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:51:02,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:51:02,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:51:02,926 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:51:04,685 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:51:06,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:51:08,687 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:51:10,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:51:12,689 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:51:14,690 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:51:16,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:51:18,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:51:18,153 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:51:18,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:51:20,693 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:51:22,068 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:51:22,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:51:24,695 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:51:26,696 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:51:28,697 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:51:30,698 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:51:32,698 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:51:33,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:51:33,512 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:51:34,699 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:51:36,700 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:51:38,701 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:51:40,701 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:51:43,702 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:51:45,703 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:51:47,704 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:51:48,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:51:48,797 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:51:49,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:51:51,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:51:52,143 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:51:53,706 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:51:55,707 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:51:57,707 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:51:59,708 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:52:01,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:52:03,710 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:52:04,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:52:04,025 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:52:05,711 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:52:07,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:52:09,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:52:11,713 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:52:13,714 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:52:15,715 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:52:17,715 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:52:19,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:52:19,396 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:52:19,716 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:52:21,717 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:52:22,218 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:52:23,718 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:52:25,719 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:52:27,720 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:52:29,720 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:52:31,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:52:33,722 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:52:34,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:52:34,624 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:52:35,723 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:52:37,724 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:52:39,725 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:52:41,726 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:52:43,726 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:52:45,727 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:52:47,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:52:49,729 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:52:49,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:52:49,886 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:52:51,730 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:52:52,291 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:52:53,730 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:52:55,731 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:52:57,732 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:52:59,733 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:53:02,735 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:53:04,736 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:53:05,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:53:05,199 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:53:06,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:53:08,738 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:53:10,738 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:53:12,739 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:53:14,740 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:53:16,741 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:53:18,742 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:53:20,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:53:20,449 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:53:20,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:53:22,364 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:53:22,744 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:53:24,745 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:53:26,746 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:53:28,747 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:53:30,748 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:53:32,749 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:53:34,750 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:53:35,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:53:35,720 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:53:36,751 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:53:38,752 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:53:40,753 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:53:42,754 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:53:44,755 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:53:46,756 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:53:48,757 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:53:50,758 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:53:50,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:53:50,943 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:53:52,439 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:53:52,759 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:53:54,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:53:56,761 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:53:58,761 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:54:00,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:54:02,763 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:54:04,764 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:54:06,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:54:06,228 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:54:06,765 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:54:08,765 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:54:10,766 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:54:12,767 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:54:14,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:54:16,769 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:54:18,770 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:54:21,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:54:21,463 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:54:21,771 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:54:22,515 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:54:23,772 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:54:25,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:54:27,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:54:29,775 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:54:31,776 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:54:33,777 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:54:35,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:54:36,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:54:36,862 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:54:37,779 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:54:39,780 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:54:41,781 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:54:43,782 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:54:45,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:54:47,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:54:49,785 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:54:51,786 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:54:52,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:54:52,120 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:54:52,588 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:54:53,787 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:54:55,788 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:54:57,789 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:54:59,790 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:55:01,791 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:55:03,792 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:55:05,793 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:55:07,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:55:07,337 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:55:07,793 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:55:09,794 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:55:11,795 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:55:13,795 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:55:15,796 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:55:17,797 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:55:19,798 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:55:21,798 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:55:22,660 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:55:22,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:55:22,668 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:55:23,799 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:55:25,800 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:55:27,801 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:55:29,802 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:55:31,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:55:33,804 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:55:35,805 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:55:37,805 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:55:37,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:55:37,885 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:55:39,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:55:41,807 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:55:43,808 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:55:45,809 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:55:47,810 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:55:49,810 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:55:52,733 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:55:52,811 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:55:53,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:55:53,113 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:55:54,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:55:56,813 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:55:58,813 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:56:00,814 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:56:02,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:56:04,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:56:06,816 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:56:08,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:56:08,336 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:56:08,817 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:56:10,817 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:56:12,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:56:14,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:56:16,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:56:18,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:56:20,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:56:22,809 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:56:22,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:56:23,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:56:23,701 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:56:24,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:56:26,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:56:28,826 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:56:30,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:56:32,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:56:34,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:56:36,829 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:56:38,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:56:39,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:56:39,002 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:56:40,831 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:56:42,831 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:56:44,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:56:46,833 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:56:49,834 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:56:51,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:56:52,883 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:56:53,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:56:54,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:56:54,297 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:56:55,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:56:57,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:56:59,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:57:01,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:57:03,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:57:05,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:57:07,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:57:09,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:57:09,752 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:57:09,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:57:11,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:57:13,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:57:15,846 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:57:17,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:57:19,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:57:21,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:57:22,959 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:57:23,849 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:57:25,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:57:25,050 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:57:25,850 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:57:27,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:57:29,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:57:31,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:57:33,854 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:57:35,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:57:37,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:57:39,856 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:57:40,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:57:40,325 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:57:41,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:57:43,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:57:46,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:57:48,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:57:50,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:57:52,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:57:53,032 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:57:54,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:57:55,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:57:55,562 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:57:56,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:57:58,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:58:00,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:58:02,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:58:04,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:58:06,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:58:08,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:58:10,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:58:10,786 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:58:10,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:58:12,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:58:14,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:58:16,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:58:18,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:58:20,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:58:22,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:58:23,111 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:58:24,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:58:26,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:58:26,187 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:58:26,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:58:28,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:58:30,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:58:32,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:58:34,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:58:36,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:58:38,882 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:58:40,883 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:58:41,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:58:41,448 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:58:42,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:58:44,885 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:58:46,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:58:48,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:58:50,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:58:52,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:58:53,186 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:58:54,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:58:56,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:58:56,734 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:58:56,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:58:58,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:59:00,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:59:02,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:59:05,894 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:59:07,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:59:09,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:59:11,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:59:12,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:59:12,171 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:59:13,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:59:15,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:59:17,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:59:19,900 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:59:21,901 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:59:23,260 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:59:23,902 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:59:25,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:59:27,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:59:27,395 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:59:27,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:59:29,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:59:31,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:59:33,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:59:35,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:59:37,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:59:39,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:59:41,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:59:42,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:59:42,686 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:59:43,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:59:45,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:59:47,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:59:49,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:59:51,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:59:53,329 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 15:59:53,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:59:55,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:59:57,916 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 15:59:58,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 15:59:58,164 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 15:59:59,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:00:01,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:00:04,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:00:06,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:00:08,921 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:00:10,922 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:00:12,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:00:13,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:00:13,386 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:00:14,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:00:16,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:00:18,925 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:00:20,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:00:22,927 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:00:23,403 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:00:24,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:00:26,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:00:28,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:00:28,657 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:00:28,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:00:30,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:00:32,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:00:34,932 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:00:36,932 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:00:38,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:00:40,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:00:42,935 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:00:43,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:00:43,879 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:00:44,935 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:00:46,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:00:48,937 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:00:50,938 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:00:52,938 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:00:53,478 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:00:54,939 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:00:56,940 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:00:58,941 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:00:59,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:00:59,276 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:01:00,941 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:01:02,942 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:01:04,943 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:01:06,943 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:01:08,944 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:01:10,945 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:01:12,945 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:01:14,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:01:14,501 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:01:14,946 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:01:16,947 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:01:18,947 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:01:20,948 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:01:22,949 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:01:23,554 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:01:24,949 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:01:27,951 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:01:29,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:01:29,819 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:01:29,951 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:01:31,952 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:01:33,953 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:01:35,953 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:01:37,954 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:01:39,955 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:01:41,956 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:01:43,956 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:01:45,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:01:45,314 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:01:45,957 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:01:47,958 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:01:49,959 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:01:51,960 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:01:53,632 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:01:53,960 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:01:55,961 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:01:57,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:01:59,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:02:00,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:02:00,725 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:02:01,963 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:02:03,964 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:02:05,965 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:02:07,965 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:02:09,966 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:02:11,967 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:02:13,967 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:02:15,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:02:15,950 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:02:15,968 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:02:17,969 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:02:19,970 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:02:21,970 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:02:23,699 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:02:23,971 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:02:25,972 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:02:27,973 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:02:29,974 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:02:31,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:02:31,309 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:02:31,974 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:02:33,975 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:02:35,976 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:02:37,977 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:02:39,978 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:02:41,979 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:02:43,980 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:02:45,981 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:02:46,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:02:46,569 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:02:48,982 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:02:50,983 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:02:52,984 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:02:53,770 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:02:54,985 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:02:56,986 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:02:58,987 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:03:00,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:03:01,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:03:01,883 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:03:02,989 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:03:04,990 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:03:06,991 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:03:08,992 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:03:10,993 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:03:12,994 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:03:14,995 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:03:16,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:03:17,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:03:17,202 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:03:18,997 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:03:20,998 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:03:22,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:03:23,845 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:03:25,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:03:27,001 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:03:29,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:03:31,003 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:03:32,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:03:32,428 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:03:33,004 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:03:35,004 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:03:37,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:03:39,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:03:41,007 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:03:43,008 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:03:46,009 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:03:47,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:03:47,721 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:03:48,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:03:50,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:03:52,012 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:03:53,919 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:03:54,013 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:03:56,014 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:03:58,015 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:04:00,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:04:02,017 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:04:02,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:04:02,952 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:04:04,017 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:04:06,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:04:08,019 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:04:10,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:04:12,021 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:04:14,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:04:16,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:04:18,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:04:18,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:04:18,215 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:04:20,025 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:04:22,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:04:23,980 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:04:24,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:04:26,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:04:28,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:04:30,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:04:32,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:04:33,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:04:33,715 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:04:34,031 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:04:36,032 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:04:38,032 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:04:40,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:04:42,034 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:04:44,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:04:46,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:04:48,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:04:48,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:04:48,942 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:04:50,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:04:52,038 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:04:54,051 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:04:55,039 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:04:57,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:04:59,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:05:01,041 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:05:03,042 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:05:04,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:05:04,228 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:05:05,042 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:05:07,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:05:09,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:05:11,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:05:13,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:05:15,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:05:17,047 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:05:19,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:05:19,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:05:19,610 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:05:21,049 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:05:23,049 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:05:24,117 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:05:25,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:05:27,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:05:29,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:05:31,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:05:33,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:05:34,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:05:34,834 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:05:35,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:05:37,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:05:39,056 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:05:41,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:05:43,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:05:45,059 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:05:47,059 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:05:50,060 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:05:50,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:05:50,248 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:05:52,061 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:05:54,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:05:54,187 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:05:56,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:05:58,063 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:06:00,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:06:02,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:06:04,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:06:05,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:06:05,562 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:06:06,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:06:08,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:06:10,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:06:12,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:06:14,071 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:06:16,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:06:18,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:06:20,074 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:06:20,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:06:20,842 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:06:22,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:06:24,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:06:24,254 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:06:26,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:06:28,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:06:30,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:06:32,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:06:34,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:06:36,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:06:36,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:06:36,182 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:06:38,081 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:06:40,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:06:42,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:06:44,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:06:46,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:06:48,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:06:50,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:06:51,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:06:51,436 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:06:52,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:06:54,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:06:54,322 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:06:56,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:06:58,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:07:00,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:07:02,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:07:04,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:07:06,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:07:06,706 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:07:07,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:07:09,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:07:11,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:07:13,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:07:15,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:07:17,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:07:19,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:07:21,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:07:21,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:07:21,963 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:07:23,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:07:24,394 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:07:25,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:07:27,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:07:29,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:07:31,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:07:33,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:07:35,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:07:37,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:07:37,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:07:37,264 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:07:39,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:07:41,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:07:43,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:07:45,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:07:47,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:07:49,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:07:51,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:07:52,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:07:52,497 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:07:53,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:07:54,469 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:07:55,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:07:57,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:07:59,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:08:01,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:08:03,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:08:05,121 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:08:07,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:08:07,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:08:07,739 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:08:09,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:08:11,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:08:14,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:08:16,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:08:18,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:08:20,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:08:22,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:08:22,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:08:22,974 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:08:24,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:08:24,543 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:08:26,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:08:28,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:08:30,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:08:32,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:08:34,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:08:36,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:08:38,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:08:38,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:08:38,330 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:08:40,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:08:42,140 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:08:44,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:08:46,142 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:08:48,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:08:50,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:08:52,145 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:08:53,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:08:53,555 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:08:54,145 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:08:54,615 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:08:56,146 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:08:58,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:09:00,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:09:02,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:09:04,150 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:09:06,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:09:08,152 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:09:08,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:09:08,846 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:09:10,153 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:09:12,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:09:14,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:09:16,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:09:18,157 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:09:20,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:09:22,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:09:24,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:09:24,092 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:09:24,159 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:09:24,688 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:09:26,160 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:09:28,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:09:30,162 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:09:33,163 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:09:35,164 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:09:37,165 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:09:39,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:09:39,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:09:39,310 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:09:41,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:09:43,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:09:45,168 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:09:47,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:09:49,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:09:51,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:09:53,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:09:54,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:09:54,533 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:09:54,762 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:09:55,172 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:09:57,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:09:59,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:10:01,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:10:03,175 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:10:05,176 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:10:07,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:10:09,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:10:09,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:10:09,940 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:10:11,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:10:13,179 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:10:15,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:10:17,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:10:19,182 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:10:21,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:10:23,184 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:10:24,835 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:10:25,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:10:25,166 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:10:25,185 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:10:27,186 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:10:29,187 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:10:31,188 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:10:33,189 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:10:35,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:10:37,191 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:10:40,192 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:10:40,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:10:40,512 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:10:42,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:10:44,194 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:10:46,195 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:10:48,196 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:10:50,197 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:10:52,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:10:54,199 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:10:54,911 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:10:55,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:10:55,787 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:10:56,200 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:10:58,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:11:00,202 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:11:02,203 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:11:04,204 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:11:06,205 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:11:08,206 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:11:10,207 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:11:11,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:11:11,011 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:11:12,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:11:14,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:11:16,209 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:11:18,210 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:11:20,211 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:11:22,212 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:11:24,213 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:11:24,986 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:11:26,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:11:26,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:11:26,306 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:11:28,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:11:30,215 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:11:32,216 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:11:34,217 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:11:36,218 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:11:38,219 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:11:40,220 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:11:41,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:11:41,651 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:11:43,221 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:11:45,222 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:11:47,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:11:49,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:11:51,224 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:11:53,225 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:11:55,057 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:11:55,226 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:11:56,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:11:56,877 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:11:57,227 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:11:59,228 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:12:01,229 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:12:03,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:12:05,231 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:12:07,232 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:12:09,233 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:12:11,233 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:12:12,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:12:12,223 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:12:13,234 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:12:15,235 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:12:17,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:12:19,237 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:12:21,238 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:12:23,238 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:12:25,131 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:12:25,239 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:12:27,240 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:12:27,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:12:27,567 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:12:29,241 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:12:31,242 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:12:33,243 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:12:35,244 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:12:37,245 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:12:39,246 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:12:42,247 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:12:42,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:12:42,894 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:12:44,248 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:12:46,249 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:12:48,250 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:12:50,251 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:12:52,252 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:12:54,253 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:12:55,205 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:12:56,254 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:12:58,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:12:58,175 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:12:58,255 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:13:00,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:13:02,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:13:04,257 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:13:06,258 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:13:08,259 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:13:10,260 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:13:12,261 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:13:13,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:13:13,403 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:13:14,262 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:13:16,263 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:13:18,263 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:13:20,265 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:13:22,265 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:13:24,266 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:13:25,280 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:13:26,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:13:28,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:13:28,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:13:28,685 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:13:30,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:13:32,270 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:13:34,271 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:13:37,272 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:13:39,273 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:13:41,274 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:13:43,274 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:13:44,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:13:44,014 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:13:45,275 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:13:47,276 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:13:49,277 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:13:51,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:13:53,279 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:13:55,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:13:55,355 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:13:57,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:13:59,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:13:59,240 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:13:59,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:14:01,283 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:14:03,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:14:05,285 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:14:07,286 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:14:09,286 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:14:11,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:14:13,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:14:14,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:14:14,492 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:14:15,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:14:17,290 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:14:19,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:14:21,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:14:23,292 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:14:25,293 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:14:25,430 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:14:27,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:14:29,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:14:29,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:14:29,773 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:14:31,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:14:33,296 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:14:35,297 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:14:37,298 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:14:39,298 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:14:41,299 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:14:43,300 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:14:44,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:14:44,998 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:14:45,301 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:14:47,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:14:49,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:14:51,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:14:53,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:14:55,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:14:55,505 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:14:57,306 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:14:59,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:15:00,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:15:00,526 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:15:01,308 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:15:03,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:15:05,310 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:15:07,310 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:15:10,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:15:12,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:15:14,313 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:15:15,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:15:15,865 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:15:16,314 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:15:18,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:15:20,316 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:15:22,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:15:24,318 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:15:25,580 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:15:26,319 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:15:28,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:15:30,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:15:31,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:15:31,157 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:15:32,321 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:15:34,322 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:15:36,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:15:38,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:15:40,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:15:42,326 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:15:44,326 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:15:46,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:15:46,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:15:46,553 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:15:48,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:15:50,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:15:52,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:15:54,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:15:55,658 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:15:56,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:15:59,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:16:01,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:16:01,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:16:01,839 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:16:03,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:16:05,335 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:16:07,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:16:09,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:16:11,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:16:13,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:16:15,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:16:17,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:16:17,063 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:16:17,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:16:19,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:16:21,342 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:16:23,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:16:25,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:16:25,733 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:16:27,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:16:29,346 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:16:31,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:16:32,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:16:32,389 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:16:33,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:16:35,348 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:16:37,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:16:39,350 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:16:41,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:16:43,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:16:45,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:16:47,354 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:16:47,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:16:47,702 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:16:49,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:16:51,356 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:16:53,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:16:55,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:16:55,806 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:16:57,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:16:59,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:17:01,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:17:02,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:17:02,930 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:17:03,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:17:05,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:17:07,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:17:09,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:17:11,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:17:13,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:17:15,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:17:17,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:17:18,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:17:18,289 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:17:19,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:17:21,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:17:23,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:17:25,376 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:17:25,883 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:17:27,377 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:17:29,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:17:31,379 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:17:33,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:17:33,516 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:17:34,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:17:36,381 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:17:38,382 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:17:40,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:17:42,384 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:17:44,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:17:46,386 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:17:48,387 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:17:48,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:17:48,787 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:17:50,388 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:17:52,389 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:17:54,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:17:55,957 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:17:56,391 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:17:58,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:18:00,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:18:02,393 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:18:04,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:18:04,014 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:18:04,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:18:06,395 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:18:08,395 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:18:10,396 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:18:12,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:18:14,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:18:16,399 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:18:18,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:18:19,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:18:19,384 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:18:20,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:18:22,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:18:24,402 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:18:26,025 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:18:26,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:18:28,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:18:30,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:18:32,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:18:34,406 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:18:34,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:18:34,827 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:18:36,407 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:18:39,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:18:41,409 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:18:43,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:18:45,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:18:47,411 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:18:49,412 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:18:50,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:18:50,214 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:18:51,413 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:18:53,414 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:18:55,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:18:56,088 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:18:57,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:18:59,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:19:01,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:19:03,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:19:05,419 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:19:05,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:19:05,442 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:19:07,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:19:09,421 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:19:11,421 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:19:13,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:19:15,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:19:17,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:19:19,425 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:19:20,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:19:20,709 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:19:21,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:19:23,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:19:25,427 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:19:26,137 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:19:27,428 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:19:29,429 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:19:31,430 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:19:33,431 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:19:35,432 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:19:35,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:19:35,989 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:19:37,433 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:19:39,433 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:19:41,434 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:19:43,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:19:45,436 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:19:47,436 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:19:49,437 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:19:51,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:19:51,220 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:19:51,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:19:53,439 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:19:55,440 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:19:56,189 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:19:57,440 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:19:59,441 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:20:01,442 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:20:04,443 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:20:06,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:20:06,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:20:06,562 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:20:08,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:20:10,445 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:20:12,446 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:20:14,446 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:20:16,447 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:20:18,448 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:20:20,449 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:20:21,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:20:21,831 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:20:22,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:20:24,451 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:20:26,252 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:20:26,452 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:20:28,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:20:30,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:20:32,455 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:20:34,456 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:20:36,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:20:37,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:20:37,099 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:20:38,458 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:20:40,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:20:42,460 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:20:44,461 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:20:46,462 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:20:48,462 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:20:50,463 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:20:52,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:20:52,393 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:20:52,464 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:20:54,465 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:20:56,329 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:20:56,466 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:20:58,467 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:21:00,468 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:21:02,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:21:04,470 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:21:06,471 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:21:07,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:21:07,657 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:21:08,472 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:21:10,472 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:21:12,473 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:21:15,475 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:21:17,476 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:21:19,477 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:21:21,477 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:21:22,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:21:22,935 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:21:23,478 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:21:25,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:21:26,405 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:21:27,480 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:21:29,481 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:21:31,482 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:21:33,483 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:21:35,484 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:21:37,485 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:21:38,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:21:38,159 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:21:39,486 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:21:41,487 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:21:43,488 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:21:45,489 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:21:47,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:21:49,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:21:51,491 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:21:53,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:21:53,483 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:21:53,492 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:21:55,493 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:21:56,482 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:21:57,494 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:21:59,495 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:22:01,496 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:22:03,496 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:22:05,497 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:22:07,498 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:22:08,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:22:08,709 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:22:09,499 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:22:11,500 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:22:13,501 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:22:15,502 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:22:17,503 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:22:19,504 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:22:21,505 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:22:23,506 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:22:24,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:22:24,022 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:22:25,507 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:22:26,556 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:22:27,507 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:22:29,508 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:22:31,509 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:22:33,510 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:22:35,511 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:22:37,512 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:22:39,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:22:39,350 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:22:39,513 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:22:41,514 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:22:43,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:22:45,516 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:22:47,516 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:22:49,517 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:22:51,518 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:22:53,519 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:22:54,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:22:54,576 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:22:55,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:22:56,630 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:22:57,521 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:22:59,522 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:23:01,522 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:23:03,523 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:23:05,524 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:23:07,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:23:09,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:23:09,805 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:23:10,526 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:23:12,527 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:23:14,528 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:23:16,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:23:18,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:23:20,530 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:23:22,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:23:24,532 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:23:25,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:23:25,042 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:23:26,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:23:26,703 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:23:28,534 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:23:30,535 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:23:32,535 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:23:40,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:23:40,380 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:23:55,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:23:55,632 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:23:56,780 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:24:11,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:24:11,237 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:24:26,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:24:26,511 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:24:26,855 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:24:32,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:24:32,171 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 16:24:32,227 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 16:24:32,309 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 16:24:32,555 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 16:24:34,556 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:24:40,558 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:24:41,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:24:41,764 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:24:56,977 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:24:56,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:24:56,997 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:25:02,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:25:12,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:25:12,291 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:25:27,054 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:25:28,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:25:28,074 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:25:43,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:25:43,344 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:25:57,133 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:25:58,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:25:58,570 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:26:13,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:26:13,974 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:26:27,214 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:26:29,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:26:29,210 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:26:44,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:26:44,436 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:26:57,292 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:26:59,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:26:59,724 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:27:14,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:27:14,953 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:27:27,369 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:27:30,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:27:30,184 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:27:45,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:27:45,409 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:27:57,446 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:28:00,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:28:00,635 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:28:15,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:28:15,861 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:28:27,521 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:28:31,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:28:31,090 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:28:46,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:28:46,315 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:28:52,665 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:28:54,665 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:28:57,598 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:28:57,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:28:57,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:28:57,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:28:57,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:28:57,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:28:57,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:28:57,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:28:57,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:28:57,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:28:57,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:28:57,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:28:57,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:28:57,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:28:57,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:28:57,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:28:57,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:29:01,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:29:01,574 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:29:03,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:29:09,671 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:29:13,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:29:16,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:29:16,800 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:29:17,674 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:29:21,675 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:29:25,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:29:27,674 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:29:29,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:29:31,680 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:29:32,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:29:32,027 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:29:35,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:29:39,683 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:29:41,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:29:45,685 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:29:47,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:29:47,315 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:29:47,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:29:48,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:29:48,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:29:48,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:29:48,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:29:48,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:29:48,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:29:48,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:29:48,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:29:48,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:29:48,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:29:48,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:29:48,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:29:48,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:29:48,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:29:48,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:29:48,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:29:51,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:29:53,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:29:57,690 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:29:57,748 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:29:59,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:30:01,692 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:30:02,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:30:02,761 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:30:03,692 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:30:06,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:06,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:06,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:06,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:06,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:06,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:06,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:06,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:06,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:06,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:06,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:06,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:06,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:06,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:06,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:06,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:07,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:30:09,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:09,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:09,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:09,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:09,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:09,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:09,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:09,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:09,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:09,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:09,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:09,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:09,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:09,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:09,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:09,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:09,695 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:30:10,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:10,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:10,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:10,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:10,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:10,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:10,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:10,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:10,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:10,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:10,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:10,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:10,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:10,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:10,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:10,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:11,696 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:30:11,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:11,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:11,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:11,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:11,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:11,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:11,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:11,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:11,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:11,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:11,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:11,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:11,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:11,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:11,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:11,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:13,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:13,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:13,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:13,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:13,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:13,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:13,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:13,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:13,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:13,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:13,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:13,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:13,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:13,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:13,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:13,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:13,696 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:30:15,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:15,697 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:30:17,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:17,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:17,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:17,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:17,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:17,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:17,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:17,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:17,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:17,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:17,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:17,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:17,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:17,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:17,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:17,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:17,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:17,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:17,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:17,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:17,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:17,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:17,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:17,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:17,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:17,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:17,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:17,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:17,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:17,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:17,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:17,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:17,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:30:17,987 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:30:18,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:18,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:19,699 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:30:19,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:19,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:19,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:19,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:19,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:19,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:19,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:19,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:19,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:19,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:19,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:19,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:19,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:19,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:19,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:19,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:21,699 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:30:23,700 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:30:25,701 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:30:26,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:26,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:27,702 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:30:27,817 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:30:27,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:27,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:27,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:27,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:27,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:27,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:27,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:27,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:27,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:27,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:27,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:27,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:27,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:27,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:27,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:27,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:29,703 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:30:29,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:29,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:29,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:29,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:29,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:29,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:29,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:29,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:29,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:29,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:29,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:29,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:29,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:29,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:29,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:29,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:30,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:30,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:30,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:30,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:30,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:30,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:30,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:30,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:30,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:30,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:30,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:30,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:30,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:30,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:30,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:30,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:30,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:30,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:30,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:30,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:30,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:30,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:30,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:30,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:30,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:30,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:30,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:30,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:30,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:30,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:30,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:30,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:31,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:31,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:31,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:31,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:31,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:31,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:31,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:31,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:31,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:31,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:31,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:31,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:31,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:31,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:31,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:31,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:31,703 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:30:31,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:31,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:31,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:31,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:31,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:31,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:31,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:31,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:31,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:31,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:31,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:31,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:31,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:31,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:31,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:31,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:32,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:33,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:30:33,292 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:30:33,704 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:30:33,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:33,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:33,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:33,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:33,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:33,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:33,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:33,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:33,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:33,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:33,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:33,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:33,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:33,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:33,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:33,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:34,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:34,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:34,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:34,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:34,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:34,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:34,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:34,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:34,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:34,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:34,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:34,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:34,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:34,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:34,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:34,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:35,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:35,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:35,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:35,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:35,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:35,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:35,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:35,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:35,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:35,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:35,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:35,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:35,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:35,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:35,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:35,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:35,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:30:37,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:37,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:37,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:37,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:37,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:37,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:37,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:37,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:37,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:37,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:37,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:37,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:37,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:37,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:37,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:37,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:37,706 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:30:37,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:37,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:37,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:37,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:37,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:37,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:37,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:37,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:37,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:37,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:37,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:37,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:37,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:37,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:37,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:37,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:38,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:38,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:38,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:38,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:38,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:38,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:38,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:38,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:38,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:38,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:38,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:38,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:38,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:38,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:38,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:38,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:38,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:38,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:38,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:38,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:38,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:38,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:38,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:38,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:38,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:38,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:38,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:38,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:38,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:38,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:38,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:38,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:39,707 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:30:40,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:40,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:40,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:40,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:40,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:40,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:40,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:40,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:40,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:40,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:40,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:40,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:40,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:40,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:40,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:40,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:41,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:41,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:41,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:41,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:41,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:41,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:41,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:41,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:41,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:41,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:41,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:41,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:41,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:41,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:41,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:41,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:41,708 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:30:42,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:42,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:42,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:42,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:42,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:42,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:42,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:42,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:42,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:42,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:42,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:42,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:42,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:42,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:42,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:42,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:42,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:42,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:42,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:42,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:42,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:42,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:42,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:42,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:42,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:42,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:42,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:42,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:42,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:42,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:42,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:42,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:43,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:43,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:43,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:43,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:43,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:43,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:43,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:43,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:43,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:43,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:43,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:43,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:43,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:43,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:43,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:43,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:43,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:30:43,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:43,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:43,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:43,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:43,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:43,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:43,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:43,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:43,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:43,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:43,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:43,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:43,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:43,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:43,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:43,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:44,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:44,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:44,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:44,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:44,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:44,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:44,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:44,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:44,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:44,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:44,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:44,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:44,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:44,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:44,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:44,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:44,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:44,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:44,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:44,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:44,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:44,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:44,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:44,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:44,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:44,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:44,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:44,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:44,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:44,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:44,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:44,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:45,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:45,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:45,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:45,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:45,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:45,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:45,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:45,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:45,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:45,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:45,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:45,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:45,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:45,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:45,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:45,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:45,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:30:47,710 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:30:48,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:30:48,537 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:30:49,711 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:30:51,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:30:53,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:53,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:53,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:53,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:53,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:53,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:53,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:53,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:53,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:53,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:53,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:53,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:30:53,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:30:55,713 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:30:57,890 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:31:03,716 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:31:03,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:31:03,830 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:31:07,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:31:07,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:31:07,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:31:07,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:31:07,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:31:07,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:31:07,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:31:07,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:31:07,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:31:07,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:31:07,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:31:07,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:31:07,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:31:07,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:31:07,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:31:07,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:31:09,718 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:31:13,720 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:31:17,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:31:19,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:31:19,057 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:31:24,724 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:31:26,725 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:31:27,965 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:31:30,726 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:31:34,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:31:34,313 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:31:34,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:31:36,729 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:31:40,731 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:31:42,732 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:31:46,734 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:31:48,735 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:31:49,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:31:49,539 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:31:52,736 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:31:53,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:31:53,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:31:53,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:31:53,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:31:53,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:31:53,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:31:53,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:31:53,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:31:53,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:31:53,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:31:53,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:31:53,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:31:53,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:31:53,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:31:53,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:31:53,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:31:54,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:31:56,738 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:31:58,037 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:32:00,740 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:32:02,741 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:32:04,742 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:32:04,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:32:04,854 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:32:06,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:32:08,744 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:32:10,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:10,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:10,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:10,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:10,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:10,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:10,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:10,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:10,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:10,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:10,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:10,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:10,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:10,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:10,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:10,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:12,746 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:32:14,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:14,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:14,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:14,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:14,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:14,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:14,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:14,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:14,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:14,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:14,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:14,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:14,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:14,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:14,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:14,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:14,747 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:32:16,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:16,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:16,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:16,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:16,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:16,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:16,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:16,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:16,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:16,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:16,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:16,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:16,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:16,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:16,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:16,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:16,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:16,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:16,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:16,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:16,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:16,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:16,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:16,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:16,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:16,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:16,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:16,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:16,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:16,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:16,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:16,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:16,748 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:32:18,749 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:32:18,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:18,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:18,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:18,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:18,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:18,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:18,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:18,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:18,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:18,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:18,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:18,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:18,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:18,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:18,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:18,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:19,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:19,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:19,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:19,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:19,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:19,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:19,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:19,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:19,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:19,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:19,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:19,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:19,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:19,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:19,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:19,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:20,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:32:20,129 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:32:20,749 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:32:21,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:21,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:21,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:21,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:21,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:21,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:21,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:21,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:21,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:21,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:21,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:21,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:21,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:21,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:21,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:21,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,750 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:32:22,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:22,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:23,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:23,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:23,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:23,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:23,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:23,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:23,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:23,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:23,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:23,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:23,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:23,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:23,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:23,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:23,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:23,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:23,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:23,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:23,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:23,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:23,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:23,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:23,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:23,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:23,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:23,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:23,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:23,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:23,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:23,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:23,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:23,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:24,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:24,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:24,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:24,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:24,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:24,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:24,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:24,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:24,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:24,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:24,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:24,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:24,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:24,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:24,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:24,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:24,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:24,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:24,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:24,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:24,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:24,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:24,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:24,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:24,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:24,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:24,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:24,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:24,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:24,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:24,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:24,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:24,751 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:32:26,752 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:32:28,111 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:32:28,753 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:32:30,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:30,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:30,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:30,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:30,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:30,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:30,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:30,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:30,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:30,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:30,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:30,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:30,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:30,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:30,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:30,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:30,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:30,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:30,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:30,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:30,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:30,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:30,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:30,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:30,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:30,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:30,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:30,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:30,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:30,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:30,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:30,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:30,754 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:32:31,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:31,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:31,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:31,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:31,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:31,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:31,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:31,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:31,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:31,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:31,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:31,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:31,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:31,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:31,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:31,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:32,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:32,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:32,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:32,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:32,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:32,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:32,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:32,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:32,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:32,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:32,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:32,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:32,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:32,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:32,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:32,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:32,755 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:32:33,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:33,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,755 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:32:34,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:34,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:35,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:32:35,506 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:32:36,756 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:32:37,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:37,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:38,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:38,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:38,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:38,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:38,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:38,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:38,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:38,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:38,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:38,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:38,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:38,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:38,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:38,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:38,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:38,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:38,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:38,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:38,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:38,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:38,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:38,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:38,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:38,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:38,757 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:32:39,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:39,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:39,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:39,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:39,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:39,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:39,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:39,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:39,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:39,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:39,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:39,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:39,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:39,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:39,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:39,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:39,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:39,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:39,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:39,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:39,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:39,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:39,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:39,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:39,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:39,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:39,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:39,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:39,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:39,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:39,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:39,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:40,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:40,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:40,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:40,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:40,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:40,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:40,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:40,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:40,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:40,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:40,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:40,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:40,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:40,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:40,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:40,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:40,758 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:32:40,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:40,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:40,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:40,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:40,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:40,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:40,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:40,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:40,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:40,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:40,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:40,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:40,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:40,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:40,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:40,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:41,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:41,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:41,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:41,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:41,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:41,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:41,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:41,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:41,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:41,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:41,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:41,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:41,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:41,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:41,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:41,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:41,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:41,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:41,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:41,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:41,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:41,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:41,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:41,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:41,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:41,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:41,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:41,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:41,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:41,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:41,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:41,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:42,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:42,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:42,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:42,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:42,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:42,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:42,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:42,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:42,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:42,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:42,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:42,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:42,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:42,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:42,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:42,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:42,759 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:32:43,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:43,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:43,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:43,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:43,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:43,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:43,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:43,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:43,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:43,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:43,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:43,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:43,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:43,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:43,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:43,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:44,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:44,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:44,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:44,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:44,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:44,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:44,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:44,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:44,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:44,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:44,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:44,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:44,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:44,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:44,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:44,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:44,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:32:45,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:45,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:45,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:45,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:45,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:45,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:45,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:45,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:45,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:45,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:45,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:45,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:45,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:45,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:45,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:45,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:45,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:45,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:45,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:45,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:45,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:45,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:45,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:45,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:45,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:45,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:45,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:45,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:45,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:45,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:45,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:45,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:46,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:46,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:46,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:46,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:46,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:46,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:46,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:46,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:46,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:46,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:46,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:46,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:46,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:46,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:46,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:46,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:46,761 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:32:46,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:46,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:46,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:46,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:46,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:46,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:46,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:46,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:46,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:46,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:46,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:46,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:46,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:46,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:46,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:46,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:47,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:47,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:47,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:47,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:47,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:47,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:47,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:47,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:47,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:47,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:47,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:47,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:47,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:47,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:47,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:47,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:47,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:47,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:47,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:47,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:47,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:47,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:47,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:47,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:47,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:47,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:47,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:47,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:47,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:47,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:47,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:47,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:48,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:48,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:48,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:48,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:48,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:48,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:48,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:48,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:48,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:48,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:48,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:48,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:48,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:48,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:48,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:48,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:49,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:49,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:49,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:49,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:49,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:49,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:49,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:49,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:49,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:49,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:49,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:49,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:49,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:49,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:49,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:49,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:49,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:32:50,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:32:50,729 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:32:51,763 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:32:53,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:53,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:53,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:53,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:53,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:53,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:53,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:53,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:53,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:53,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:53,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:53,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:53,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:32:53,826 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:32:53,851 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 16:32:54,064 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 16:32:54,141 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 16:32:54,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 16:32:54,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:32:55,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:32:58,252 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:33:03,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:33:05,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:33:05,965 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:33:09,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:33:13,829 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:33:17,831 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:33:21,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:33:21,185 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:33:21,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:33:25,834 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:33:27,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:33:27,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:33:27,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:33:27,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:33:27,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:33:27,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:33:27,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:33:27,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:33:27,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:33:27,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:33:27,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:33:27,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:33:27,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:33:27,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:33:27,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:33:27,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:33:28,326 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:33:29,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:33:33,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:33:36,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:33:36,566 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:33:37,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:33:39,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:33:43,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:33:45,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:33:49,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:33:51,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:33:51,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:33:51,997 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:33:55,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:33:57,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:33:58,398 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:33:59,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:34:02,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:02,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:02,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:02,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:02,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:02,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:02,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:02,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:02,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:02,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:02,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:02,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:02,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:02,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:02,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:02,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:03,849 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:34:05,850 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:34:07,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:34:07,224 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:34:07,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:34:09,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:34:11,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:34:15,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:34:16,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:16,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:16,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:16,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:16,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:16,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:16,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:16,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:16,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:16,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:16,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:16,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:16,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:16,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:16,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:16,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:17,856 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:34:19,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:34:21,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:21,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:21,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:21,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:21,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:21,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:21,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:21,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:21,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:21,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:21,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:21,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:21,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:21,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:21,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:21,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:21,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:34:22,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:34:22,450 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:34:23,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:23,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:23,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:23,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:23,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:23,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:23,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:23,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:23,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:23,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:23,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:23,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:23,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:23,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:23,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:23,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:23,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:23,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:23,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:23,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:23,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:23,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:23,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:23,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:23,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:23,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:23,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:23,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:23,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:23,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:23,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:23,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:23,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:34:24,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:24,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:24,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:24,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:24,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:24,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:24,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:24,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:24,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:24,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:24,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:24,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:24,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:24,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:24,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:24,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:24,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:24,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:24,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:24,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:24,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:24,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:24,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:24,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:24,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:24,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:24,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:24,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:24,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:24,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:24,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:24,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:25,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:25,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:25,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:25,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:25,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:25,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:25,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:25,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:25,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:25,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:25,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:25,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:25,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:25,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:25,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:25,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:25,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:34:27,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:27,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:27,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:27,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:27,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:27,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:27,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:27,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:27,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:27,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:27,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:27,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:27,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:27,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:27,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:27,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:28,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:28,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:28,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:28,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:28,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:28,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:28,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:28,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:28,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:28,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:28,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:28,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:28,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:28,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:28,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:28,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:28,473 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:34:28,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:34:30,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:30,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:34:31,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:31,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:31,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:31,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:31,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:31,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:31,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:31,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:31,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:31,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:31,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:31,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:31,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:31,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:31,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:31,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:32,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:32,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:32,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:32,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:32,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:32,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:32,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:32,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:32,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:32,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:32,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:32,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:32,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:32,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:32,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:32,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:32,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:34:34,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:34:35,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:35,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:35,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:35,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:35,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:35,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:35,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:35,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:35,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:35,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:35,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:35,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:35,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:35,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:35,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:35,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:35,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:35,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:35,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:35,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:35,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:35,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:35,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:35,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:35,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:35,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:35,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:35,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:35,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:35,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:35,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:35,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:36,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:34:37,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:37,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:37,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:37,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:37,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:37,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:37,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:37,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:37,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:37,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:37,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:37,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:37,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:37,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:37,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:37,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:37,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:37,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:37,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:37,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:37,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:37,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:37,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:37,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:37,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:37,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:37,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:37,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:37,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:37,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:37,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:37,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:37,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:34:37,852 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:34:38,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:34:38,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:38,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:39,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:39,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:39,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:39,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:39,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:39,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:39,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:39,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:39,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:39,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:39,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:39,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:39,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:39,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:39,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:39,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:39,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:39,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:39,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:39,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:39,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:39,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:39,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:39,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:39,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:40,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:40,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:40,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:40,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:40,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:40,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:40,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:40,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:40,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:40,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:40,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:40,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:40,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:40,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:40,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:40,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:40,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:40,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:40,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:40,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:40,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:40,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:40,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:40,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:34:41,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:41,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:41,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:41,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:41,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:41,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:41,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:41,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:41,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:41,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:41,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:41,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:41,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:41,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:41,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:41,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:41,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:41,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:41,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:41,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:41,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:41,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:41,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:41,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:41,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:41,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:41,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:41,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:41,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:41,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:41,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:41,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:42,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:34:44,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:44,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:44,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:44,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:44,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:44,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:44,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:44,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:44,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:44,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:44,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:44,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:44,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:44,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:44,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:44,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:44,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:44,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:44,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:44,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:44,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:44,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:44,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:44,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:44,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:44,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:44,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:44,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:44,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:44,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:44,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:44,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:44,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:34:45,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:45,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:45,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:45,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:45,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:45,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:45,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:45,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:45,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:45,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:45,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:45,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:45,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:45,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:45,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:45,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:34:46,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:46,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:48,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:48,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:48,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:48,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:48,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:48,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:48,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:48,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:48,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:48,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:48,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:48,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:48,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:48,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:48,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:48,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:48,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:48,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:48,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:48,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:48,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:48,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:48,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:48,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:48,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:48,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:48,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:48,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:48,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:48,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:48,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:48,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:48,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:34:49,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:49,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:49,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:49,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:49,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:49,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:49,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:49,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:49,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:49,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:49,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:49,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:49,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:49,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:49,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:49,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:49,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:49,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:49,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:49,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:49,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:49,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:49,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:49,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:49,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:49,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:49,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:49,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:49,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:49,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:49,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:49,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:34:50,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:50,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:51,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:51,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:51,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:51,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:51,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:51,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:51,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:51,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:51,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:51,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:51,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:51,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:51,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:51,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:51,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:51,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:52,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:52,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:52,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:52,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:52,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:52,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:52,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:52,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:52,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:52,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:52,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:52,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:52,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:52,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:52,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:52,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:52,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:34:53,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:34:53,073 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:34:53,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:53,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:53,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:53,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:53,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:53,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:53,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:53,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:53,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:53,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:53,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:53,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:53,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:53,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:53,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:53,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:53,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:53,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:53,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:53,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:53,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:53,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:53,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:53,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:53,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:53,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:53,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:53,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:53,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:53,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:53,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:53,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:54,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:34:55,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:55,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:55,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:55,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:55,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:55,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:55,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:55,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:55,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:55,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:55,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:55,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:34:56,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:34:58,546 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:34:58,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:35:08,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:35:08,472 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:35:08,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:35:12,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:35:16,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:35:20,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:35:23,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:35:23,976 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:35:24,883 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:35:28,620 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:35:28,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:35:32,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:35:36,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:35:38,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:35:38,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:35:38,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:35:38,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:35:38,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:35:38,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:35:38,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:35:38,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:35:38,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:35:38,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:35:38,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:35:38,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:35:38,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:35:38,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:35:38,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:35:38,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:35:38,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:35:39,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:35:39,199 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:35:42,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:35:44,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:35:48,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:35:50,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:35:54,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:35:54,560 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:35:54,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:35:56,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:35:58,693 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:35:58,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:36:02,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:36:04,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:36:06,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:36:08,900 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:36:08,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:08,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:09,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:09,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:09,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:09,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:09,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:09,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:09,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:09,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:09,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:09,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:09,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:09,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:09,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:09,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:09,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:36:09,802 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:36:12,902 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:36:14,902 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:36:16,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:36:18,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:36:20,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:36:22,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:36:24,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:24,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:24,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:24,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:24,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:24,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:24,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:24,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:24,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:24,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:24,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:24,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:24,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:24,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:24,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:24,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:25,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:36:25,023 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:36:25,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:25,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:25,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:25,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:25,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:25,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:25,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:25,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:25,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:25,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:25,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:25,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:25,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:25,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:25,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:25,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:25,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:36:26,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:26,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:26,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:26,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:26,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:26,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:26,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:26,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:26,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:26,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:26,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:26,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:26,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:26,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:26,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:26,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:27,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:36:28,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:28,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:28,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:28,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:28,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:28,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:28,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:28,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:28,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:28,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:28,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:28,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:28,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:28,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:28,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:28,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:28,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:28,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:28,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:28,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:28,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:28,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:28,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:28,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:28,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:28,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:28,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:28,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:28,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:28,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:28,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:28,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:28,760 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:36:29,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:36:30,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:30,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:30,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:30,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:30,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:30,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:30,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:30,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:30,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:30,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:30,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:30,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:30,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:30,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:30,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:30,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:31,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:31,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:31,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:31,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:31,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:31,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:31,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:31,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:31,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:31,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:31,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:31,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:31,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:31,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:31,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:31,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:31,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:31,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:31,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:31,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:31,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:31,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:31,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:31,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:31,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:31,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:31,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:31,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:31,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:31,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:31,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:31,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:31,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:36:32,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:32,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:32,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:32,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:32,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:32,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:32,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:32,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:32,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:32,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:32,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:32,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:32,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:32,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:32,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:32,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:32,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:32,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:32,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:32,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:32,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:32,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:32,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:32,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:32,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:32,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:32,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:32,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:32,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:32,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:32,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:32,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:33,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:33,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:33,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:33,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:33,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:33,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:33,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:33,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:33,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:33,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:33,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:33,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:33,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:33,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:33,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:33,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:33,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:36:34,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:34,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:34,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:34,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:34,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:34,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:34,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:34,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:34,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:34,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:34,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:34,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:34,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:34,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:34,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:34,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:35,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:35,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:35,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:35,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:35,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:35,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:35,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:35,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:35,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:35,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:35,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:35,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:35,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:35,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:35,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:35,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:35,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:36:37,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:37,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:37,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:37,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:37,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:37,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:37,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:37,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:37,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:37,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:37,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:37,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:37,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:37,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:37,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:37,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:37,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:36:38,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:38,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:38,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:38,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:38,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:38,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:38,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:38,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:38,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:38,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:38,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:38,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:38,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:38,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:38,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:38,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:39,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:39,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:39,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:39,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:39,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:39,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:39,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:39,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:39,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:39,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:39,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:39,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:39,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:39,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:39,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:39,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:39,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:36:40,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:36:40,250 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:36:40,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:40,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:41,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:41,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:41,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:41,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:41,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:41,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:36:42,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:42,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:42,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:42,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:42,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:42,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:42,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:42,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:42,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:42,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:42,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:42,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:42,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:42,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:42,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:42,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:43,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:36:45,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:36:46,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:46,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:46,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:46,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:46,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:46,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:46,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:46,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:46,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:46,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:46,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:46,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:46,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:46,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:46,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:46,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:47,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:47,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:47,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:47,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:47,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:47,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:47,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:47,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:47,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:47,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:47,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:47,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:47,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:47,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:47,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:47,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:47,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:36:48,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:48,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:48,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:48,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:48,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:48,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:48,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:48,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:48,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:48,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:48,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:48,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:48,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:48,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:48,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:48,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:49,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:36:50,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:50,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:50,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:50,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:50,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:50,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:50,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:50,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:50,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:50,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:50,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:50,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:50,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:50,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:50,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:50,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:50,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:50,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:50,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:50,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:50,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:50,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:50,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:50,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:50,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:50,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:50,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:50,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:50,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:50,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:50,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:50,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:51,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:51,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:51,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:51,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:51,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:51,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:51,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:51,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:51,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:51,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:51,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:51,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:51,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:51,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:51,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:51,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:51,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:51,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:51,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:51,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:51,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:51,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:51,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:51,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:51,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:51,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:51,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:51,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:51,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:51,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:51,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:51,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:51,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:36:52,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:52,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:53,916 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:36:54,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:54,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:54,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:54,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:54,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:54,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:54,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:54,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:54,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:54,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:54,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:54,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:54,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:54,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:54,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:54,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:54,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:54,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:54,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:54,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:54,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:54,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:54,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:54,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:54,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:54,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:54,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:54,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:54,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:54,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:54,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:54,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:55,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:36:55,531 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:36:55,916 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:36:56,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:56,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:56,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:56,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:56,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:56,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:56,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:56,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:56,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:56,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:56,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:56,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:56,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:56,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:56,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:56,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:56,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:56,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:56,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:56,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:56,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:56,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:56,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:56,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:56,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:56,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:56,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:56,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:56,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:36:56,690 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 16:36:56,909 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 16:36:56,991 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 16:36:57,990 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 16:36:57,990 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:36:58,990 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:36:58,997 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:37:05,993 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:37:10,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:37:10,842 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:37:11,995 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:37:15,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:37:19,998 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:37:24,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:37:26,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:37:26,191 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:37:28,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:37:29,070 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:37:32,003 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:37:34,004 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:37:38,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:37:41,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:37:41,494 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:37:42,008 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:37:42,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:37:42,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:37:42,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:37:42,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:37:42,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:37:42,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:37:42,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:37:42,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:37:42,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:37:42,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:37:42,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:37:42,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:37:42,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:37:42,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:37:42,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:37:42,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:37:44,009 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:37:48,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:37:50,012 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:37:54,013 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:37:56,014 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:37:56,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:37:56,831 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:37:59,190 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:38:00,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:38:03,017 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:38:05,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:38:07,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:38:11,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:38:12,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:38:12,062 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:38:12,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:12,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:12,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:12,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:12,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:12,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:12,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:12,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:12,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:12,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:12,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:12,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:12,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:12,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:12,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:12,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:13,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:38:15,021 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:38:17,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:38:19,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:38:21,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:38:23,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:38:25,025 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:38:27,025 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:38:27,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:27,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:27,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:27,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:27,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:27,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:27,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:27,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:27,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:27,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:27,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:27,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:27,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:27,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:27,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:27,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:27,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:38:27,295 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:38:28,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:28,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:28,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:28,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:28,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:28,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:28,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:28,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:28,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:28,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:28,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:28,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:28,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:28,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:28,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:28,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:29,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:38:29,218 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:38:30,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:30,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:30,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:30,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:30,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:30,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:30,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:30,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:30,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:30,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:30,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:30,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:30,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:30,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:30,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:30,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:31,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:38:32,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:32,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:32,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:32,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:32,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:32,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:32,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:32,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:32,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:32,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:32,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:32,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:32,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:32,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:32,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:32,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:33,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:38:33,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:33,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:33,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:33,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:33,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:33,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:33,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:33,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:33,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:33,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:33,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:33,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:33,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:33,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:33,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:33,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:33,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:33,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:33,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:33,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:33,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:33,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:33,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:33,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:33,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:33,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:33,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:33,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:33,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:33,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:33,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:33,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:34,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:34,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:34,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:34,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:34,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:34,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:34,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:34,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:34,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:34,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:34,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:34,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:34,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:34,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:34,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:34,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:34,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:34,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:34,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:34,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:34,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:34,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:34,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:34,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:34,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:34,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:34,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:34,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:34,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:34,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:34,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:34,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:35,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:38:36,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:36,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:37,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:38:37,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:37,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:37,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:37,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:37,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:37,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:37,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:37,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:37,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:37,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:37,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:37,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:37,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:37,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:37,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:37,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:38,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:38,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:38,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:38,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:38,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:38,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:38,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:38,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:38,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:38,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:38,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:38,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:38,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:38,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:38,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:38,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:39,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:38:40,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:40,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:41,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:38:41,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:41,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:41,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:41,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:41,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:41,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:41,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:41,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:41,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:41,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:41,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:41,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:41,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:41,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:41,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:41,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:42,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:38:42,702 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:38:43,032 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:38:43,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:43,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:43,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:43,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:43,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:43,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:43,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:43,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:43,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:43,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:43,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:43,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:43,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:43,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:43,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:43,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:44,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:38:45,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:45,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:46,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:47,034 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:38:47,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:47,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:47,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:47,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:47,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:47,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:47,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:47,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:47,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:47,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:47,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:47,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:47,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:47,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:47,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:47,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:48,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:48,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:48,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:48,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:48,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:48,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:48,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:48,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:48,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:48,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:48,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:48,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:48,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:48,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:48,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:48,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:49,034 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:38:50,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:50,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:50,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:50,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:50,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:50,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:50,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:50,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:50,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:50,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:50,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:50,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:50,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:50,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:50,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:50,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:38:51,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:51,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:52,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:53,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:38:53,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:53,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:53,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:53,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:53,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:53,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:53,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:53,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:53,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:53,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:53,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:53,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:53,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:53,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:53,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:53,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:54,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:55,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:38:55,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:55,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:55,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:55,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:55,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:55,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:55,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:55,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:55,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:55,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:55,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:55,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:55,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:55,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:55,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:55,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:55,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:55,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:55,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:55,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:55,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:55,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:55,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:55,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:55,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:55,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:55,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:55,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:55,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:55,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:55,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:55,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:55,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:55,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:55,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:55,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:56,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:56,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:56,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:56,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:56,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:56,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:56,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:56,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:38:57,038 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:38:57,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:38:57,935 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:38:59,292 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:39:01,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:01,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:01,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:01,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:01,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:01,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:01,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:01,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:01,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:01,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:01,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:01,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:01,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:01,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:01,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:01,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:07,041 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:39:12,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:12,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:12,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:12,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:12,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:12,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:12,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:12,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:12,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:12,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:12,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:12,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:12,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:12,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:12,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:12,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:13,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:39:13,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:39:13,355 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:39:17,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:39:21,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:39:25,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:39:28,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:39:28,771 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:39:29,049 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:39:29,365 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:39:31,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:39:35,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:39:39,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:39:41,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:39:44,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:39:44,063 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:39:46,056 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:39:48,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:39:52,059 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:39:52,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:52,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:52,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:52,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:52,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:52,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:52,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:52,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:52,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:52,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:52,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:52,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:52,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:52,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:52,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:52,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:39:54,060 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:39:58,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:39:59,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:39:59,355 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:39:59,652 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:40:00,063 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:40:02,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:40:04,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:40:08,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:40:10,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:40:12,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:40:13,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:13,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:13,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:13,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:13,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:13,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:13,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:13,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:13,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:13,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:13,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:13,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:13,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:13,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:13,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:13,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:14,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:40:14,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:40:14,654 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:40:18,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:40:20,071 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:40:22,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:40:24,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:40:26,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:40:28,074 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:40:29,514 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:40:29,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:40:29,977 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:40:30,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:40:31,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:31,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:31,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:31,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:31,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:31,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:31,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:31,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:31,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:31,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:31,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:31,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:31,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:31,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:31,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:31,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:32,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:40:34,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:40:36,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:40:36,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:36,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:36,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:36,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:36,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:36,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:36,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:36,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:36,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:36,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:36,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:36,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:36,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:36,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:36,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:36,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:36,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:36,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:36,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:36,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:36,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:36,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:36,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:36,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:36,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:36,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:36,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:36,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:36,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:36,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:36,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:36,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:37,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:37,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:37,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:37,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:37,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:37,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:37,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:37,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:37,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:37,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:37,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:37,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:37,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:37,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:37,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:37,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:37,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:37,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:37,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:37,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:37,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:37,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:37,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:37,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:37,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:37,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:37,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:37,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:37,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:37,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:37,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:37,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:38,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:40:38,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:38,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:38,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:38,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:38,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:38,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:38,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:38,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:38,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:38,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:38,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:38,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:38,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:38,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:38,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:38,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:38,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:38,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:38,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:38,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:38,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:38,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:38,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:38,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:38,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:38,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:38,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:38,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:38,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:38,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:38,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:38,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:39,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:39,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:39,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:39,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:39,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:39,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:39,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:39,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:39,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:39,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:39,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:39,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:39,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:39,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:39,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:39,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:40,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:40:41,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:41,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:41,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:41,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:41,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:41,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:41,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:41,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:41,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:41,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:41,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:41,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:41,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:41,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:41,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:41,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:40:42,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:42,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:44,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:40:44,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:44,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:44,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:44,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:44,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:44,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:44,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:44,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:44,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:44,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:44,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:44,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:44,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:44,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:44,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:44,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:44,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:44,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:44,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:44,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:44,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:44,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:44,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:44,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:44,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:44,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:44,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:44,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:44,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:44,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:44,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:44,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:45,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:40:45,226 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:40:45,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:45,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:45,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:45,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:45,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:45,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:45,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:45,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:45,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:45,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:45,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:45,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:45,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:45,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:45,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:45,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:46,081 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:40:46,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:46,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:46,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:46,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:46,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:46,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:46,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:46,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:46,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:46,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:46,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:46,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:46,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:46,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:46,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:46,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:47,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:47,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:47,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:47,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:47,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:47,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:47,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:47,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:47,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:47,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:47,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:47,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:47,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:47,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:47,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:47,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:40:48,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:48,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:49,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:49,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:49,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:49,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:49,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:49,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:49,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:49,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:49,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:49,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:49,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:49,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:49,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:49,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:49,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:49,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:49,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:49,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:49,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:49,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:49,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:49,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:49,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:49,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:49,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:49,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:49,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:49,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:49,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:49,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:49,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:49,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:40:50,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:50,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:52,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:40:53,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:53,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:53,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:53,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:53,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:53,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:53,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:53,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:53,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:53,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:53,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:53,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:53,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:53,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:53,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:53,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:40:54,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:54,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:55,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:40:56,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:56,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:40:57,450 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 16:40:57,643 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 16:40:57,718 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 16:40:58,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 16:40:59,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:40:59,725 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:41:00,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:41:00,456 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:41:03,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:03,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:03,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:03,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:03,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:03,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:03,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:03,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:03,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:03,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:03,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:03,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:03,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:03,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:03,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:03,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:05,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:05,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:05,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:05,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:05,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:05,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:05,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:05,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:05,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:05,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:05,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:05,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:05,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:05,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:05,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:05,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:09,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:41:11,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:11,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:11,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:11,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:11,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:11,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:11,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:11,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:11,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:11,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:11,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:11,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:11,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:11,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:11,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:11,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:15,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:41:15,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:41:15,772 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:41:19,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:41:23,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:41:24,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:24,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:24,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:24,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:24,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:24,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:24,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:24,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:24,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:24,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:24,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:24,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:24,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:24,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:24,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:24,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:41:25,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:41:29,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:41:29,802 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:41:31,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:41:31,008 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:41:33,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:41:37,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:41:41,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:41:43,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:41:46,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:41:46,299 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:41:47,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:41:49,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:41:54,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:41:56,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:41:59,878 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:42:00,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:42:01,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:42:01,521 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:42:02,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:42:04,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:42:04,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:04,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:04,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:04,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:04,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:04,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:04,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:04,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:04,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:04,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:04,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:04,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:04,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:04,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:04,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:04,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:08,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:42:10,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:42:12,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:42:14,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:42:16,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:42:16,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:42:16,744 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:42:18,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:42:22,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:42:22,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:22,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:22,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:22,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:22,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:22,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:22,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:22,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:22,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:22,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:22,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:22,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:22,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:22,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:22,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:22,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:24,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:42:26,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:42:28,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:42:29,955 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:42:30,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:42:32,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:42:32,122 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:42:32,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:42:34,128 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:42:36,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:42:38,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:42:39,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:39,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:39,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:39,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:39,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:39,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:39,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:39,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:39,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:39,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:39,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:39,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:39,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:39,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:39,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:39,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:42:40,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:40,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:41,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:42,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:42:43,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:43,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:44,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:42:45,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:45,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:46,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:46,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:46,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:46,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:46,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:46,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:46,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:46,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:46,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:46,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:46,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:46,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:46,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:46,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:46,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:46,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:46,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:46,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:46,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:46,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:46,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:46,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:46,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:46,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:46,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:46,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:46,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:46,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:46,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:46,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:46,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:46,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:46,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:42:47,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:42:47,397 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:42:47,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:47,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:48,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:48,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:48,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:48,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:48,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:48,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:48,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:48,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:48,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:48,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:48,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:48,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:48,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:48,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:48,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:42:49,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:49,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:49,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:49,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:49,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:49,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:49,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:49,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:49,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:49,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:49,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:49,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:49,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:49,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:49,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:49,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:50,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:42:50,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:50,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:50,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:50,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:50,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:50,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:50,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:50,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:50,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:50,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:50,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:50,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:50,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:50,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:50,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:50,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:50,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:50,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:50,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:50,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:50,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:50,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:50,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:50,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:50,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:50,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:50,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:50,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:50,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:50,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:50,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:50,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:51,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:51,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:51,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:51,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:51,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:51,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:51,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:51,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:51,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:51,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:51,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:51,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:51,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:51,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:51,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:51,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:42:52,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:52,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:53,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:54,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:54,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:54,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:54,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:54,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:54,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:54,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:54,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:54,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:54,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:54,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:54,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:54,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:54,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:54,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:54,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:54,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:42:54,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:54,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:54,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:54,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:54,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:54,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:54,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:54,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:54,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:54,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:54,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:54,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:54,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:54,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:54,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:54,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:55,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:55,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:55,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:55,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:55,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:55,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:55,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:55,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:55,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:55,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:55,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:55,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:55,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:55,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:55,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:55,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:42:56,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:56,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:42:58,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:43:00,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:00,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:00,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:00,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:00,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:00,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:00,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:00,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:00,039 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:43:00,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:00,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:00,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:00,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:00,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:00,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:00,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:00,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:02,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:43:02,906 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:43:04,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:04,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:04,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:04,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:04,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:04,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:04,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:04,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:04,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:04,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:04,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:04,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:04,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:04,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:04,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:04,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:05,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:05,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:05,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:05,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:05,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:05,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:05,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:05,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:05,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:05,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:05,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:05,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:05,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:05,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:05,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:05,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:07,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:07,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:07,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:07,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:07,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:07,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:07,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:07,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:07,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:07,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:07,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:07,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:07,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:07,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:07,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:07,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:07,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:07,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:07,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:07,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:07,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:07,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:07,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:07,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:07,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:07,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:07,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:07,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:07,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:07,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:07,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:07,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:08,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:43:09,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:09,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:09,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:09,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:09,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:09,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:09,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:09,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:09,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:09,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:09,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:09,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:09,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:09,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:09,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:09,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:10,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:10,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:10,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:10,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:10,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:10,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:10,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:10,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:10,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:10,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:10,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:10,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:10,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:10,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:10,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:10,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:12,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:12,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:12,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:12,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:12,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:12,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:12,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:12,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:12,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:12,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:12,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:12,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:12,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:12,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:12,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:12,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:12,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:43:12,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:12,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:12,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:12,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:12,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:12,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:12,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:12,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:12,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:12,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:12,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:12,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:12,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:12,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:12,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:12,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:15,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:15,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:15,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:15,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:15,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:15,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:15,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:15,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:15,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:15,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:15,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:15,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:15,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:15,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:15,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:15,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:16,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:43:17,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:17,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:17,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:17,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:17,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:17,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:17,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:17,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:17,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:17,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:17,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:17,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:17,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:17,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:17,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:17,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:18,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:43:18,272 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:43:20,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:43:24,150 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:43:28,152 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:43:30,111 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:43:30,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:30,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:30,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:30,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:30,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:30,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:30,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:30,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:30,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:30,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:30,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:30,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:30,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:30,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:30,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:30,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:43:32,153 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:43:33,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:43:33,522 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:43:36,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:43:38,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:43:42,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:43:44,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:43:48,160 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:43:48,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:43:48,745 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:43:50,160 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:43:54,162 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:43:56,162 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:43:58,163 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:44:00,184 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:44:01,164 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:44:04,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:44:04,003 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:44:05,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:44:07,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:44:07,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:07,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:07,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:07,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:07,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:07,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:07,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:07,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:07,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:07,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:07,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:07,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:07,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:07,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:07,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:07,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:09,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:44:11,168 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:44:13,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:44:15,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:44:17,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:44:19,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:44:19,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:44:19,258 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:44:21,172 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:44:23,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:44:24,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:24,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:24,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:24,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:24,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:24,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:24,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:24,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:24,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:24,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:24,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:24,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:24,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:24,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:24,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:24,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:25,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:44:27,175 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:44:29,176 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:44:30,257 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:44:31,176 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:44:33,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:44:34,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:44:34,480 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:44:35,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:44:37,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:44:39,179 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:44:39,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:39,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:39,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:39,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:39,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:39,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:39,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:39,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:39,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:39,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:39,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:39,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:39,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:39,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:39,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:39,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:40,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:41,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:44:41,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:41,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:41,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:41,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:41,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:41,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:41,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:41,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:41,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:41,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:41,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:41,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:41,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:41,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:41,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:41,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:42,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:43,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:44:44,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:44,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:45,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:44:45,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:45,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:45,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:45,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:45,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:45,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:45,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:45,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:45,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:45,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:45,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:45,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:45,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:45,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:45,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:45,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:46,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:46,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:46,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:46,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:46,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:46,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:46,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:46,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:46,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:46,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:46,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:46,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:46,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:46,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:46,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:46,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:47,182 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:44:47,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:47,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:47,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:47,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:47,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:47,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:47,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:47,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:47,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:47,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:47,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:47,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:47,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:47,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:47,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:47,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:49,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:44:49,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:49,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:49,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:49,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:49,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:49,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:49,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:49,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:49,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:49,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:49,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:49,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:49,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:49,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:49,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:49,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:49,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:44:49,768 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:44:49,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:49,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:49,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:49,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:49,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:49,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:49,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:49,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:49,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:49,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:49,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:49,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:49,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:49,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:49,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:49,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:50,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:51,184 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:44:51,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:51,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:51,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:51,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:51,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:51,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:51,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:51,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:51,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:51,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:51,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:51,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:51,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:51,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:51,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:51,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:52,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,184 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:44:53,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:53,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:54,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:44:54,200 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 16:44:54,424 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 16:44:54,501 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 16:44:55,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 16:44:55,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:45:00,516 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:45:05,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:45:05,175 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:45:05,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:45:06,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:06,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:06,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:06,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:06,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:06,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:06,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:06,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:06,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:06,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:06,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:06,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:06,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:06,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:06,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:06,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:06,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:06,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:06,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:06,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:06,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:06,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:06,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:06,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:06,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:06,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:06,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:06,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:06,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:06,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:06,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:06,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:07,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:07,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:07,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:07,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:07,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:07,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:07,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:07,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:07,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:07,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:07,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:07,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:07,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:07,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:07,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:07,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:09,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:09,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:09,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:09,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:09,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:09,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:09,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:09,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:09,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:09,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:09,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:09,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:09,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:09,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:09,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:09,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:11,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:45:12,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:12,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:12,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:12,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:12,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:12,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:12,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:12,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:12,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:12,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:12,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:12,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:12,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:12,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:12,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:12,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:14,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:14,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:14,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:14,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:14,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:14,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:14,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:14,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:14,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:14,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:14,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:14,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:14,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:14,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:14,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:14,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:14,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:14,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:14,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:14,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:14,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:14,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:14,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:14,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:14,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:14,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:14,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:14,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:14,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:14,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:14,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:14,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:16,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:17,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:45:19,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:19,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:19,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:19,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:19,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:19,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:19,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:19,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:19,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:19,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:19,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:19,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:19,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:19,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:19,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:19,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:19,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:19,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:19,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:19,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:19,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:19,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:19,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:19,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:19,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:19,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:19,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:19,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:19,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:19,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:19,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:19,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:20,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:45:20,403 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:45:20,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:20,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:20,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:20,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:20,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:20,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:20,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:20,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:20,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:20,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:20,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:20,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:20,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:20,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:20,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:20,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:20,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:20,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:20,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:20,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:20,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:20,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:20,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:20,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:20,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:20,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:20,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:20,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:20,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:20,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:20,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:20,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:22,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:45:25,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:25,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:25,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:25,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:25,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:25,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:25,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:25,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:25,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:25,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:25,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:25,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:25,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:25,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:25,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:25,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:26,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:45:30,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:45:30,591 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:45:32,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:45:35,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:35,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:35,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:35,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:35,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:35,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:35,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:35,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:35,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:35,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:35,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:35,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:35,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:35,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:35,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:35,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:45:35,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:45:35,938 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:45:36,346 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:45:38,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:45:42,348 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:45:44,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:45:48,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:45:50,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:45:51,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:45:51,165 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:45:54,354 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:45:56,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:45:58,356 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:46:00,665 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:46:02,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:46:04,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:46:06,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:46:06,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:46:06,393 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:46:08,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:46:10,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:46:12,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:46:12,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:12,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:12,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:12,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:12,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:12,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:12,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:12,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:12,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:12,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:12,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:12,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:12,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:12,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:12,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:12,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:16,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:46:18,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:46:21,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:46:21,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:46:21,619 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:46:23,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:46:25,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:46:27,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:46:27,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:27,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:27,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:27,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:27,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:27,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:27,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:27,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:27,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:27,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:27,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:27,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:27,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:27,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:27,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:27,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:29,371 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:46:30,741 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:46:31,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:46:33,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:46:35,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:46:36,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:46:36,844 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:46:37,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:46:39,376 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:46:41,377 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:46:42,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:42,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:43,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:43,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:43,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:43,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:43,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:43,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:43,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:43,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:43,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:43,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:43,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:43,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:43,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:43,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:43,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:43,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:43,377 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:46:44,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:44,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:44,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:44,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:44,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:44,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:44,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:44,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:44,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:44,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:44,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:44,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:44,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:44,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:44,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:44,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,379 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:46:45,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:45,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,381 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:46:47,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:47,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:48,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:48,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:48,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:48,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:48,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:48,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:48,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:48,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:48,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:48,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:48,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:48,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:48,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:48,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:48,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:48,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:49,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:49,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:49,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:49,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:49,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:49,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:49,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:49,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:49,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:49,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:49,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:49,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:49,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:49,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:49,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:49,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:49,381 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:46:49,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:49,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:49,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:49,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:49,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:49,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:49,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:49,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:49,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:49,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:49,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:49,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:49,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:49,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:49,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:49,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:50,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:50,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:50,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:50,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:50,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:50,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:50,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:50,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:50,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:50,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:50,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:50,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:50,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:50,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:50,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:50,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:51,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:51,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:51,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:51,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:51,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:51,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:51,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:51,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:51,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:51,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:51,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:51,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:51,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:51,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:51,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:51,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:51,382 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:46:52,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:46:52,118 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:46:52,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:52,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:53,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:53,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:53,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:53,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:53,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:53,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:53,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:53,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:53,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:53,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:53,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:53,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:53,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:53,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:53,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:53,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:53,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:46:53,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:53,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:53,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:53,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:53,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:53,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:53,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:53,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:53,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:53,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:53,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:53,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:53,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:53,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:53,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:53,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:54,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:54,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:54,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:54,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:54,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:54,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:54,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:54,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:54,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:54,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:54,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:54,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:55,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:46:57,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:57,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:57,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:57,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:57,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:57,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:57,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:57,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:57,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:57,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:57,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:57,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:57,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:57,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:57,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:57,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:59,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:59,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:59,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:59,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:59,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:59,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:59,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:59,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:59,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:59,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:59,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:59,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:59,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:59,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:59,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:59,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:59,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:59,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:59,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:59,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:59,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:59,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:59,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:59,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:59,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:59,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:59,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:59,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:59,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:59,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:59,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:46:59,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:00,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:00,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:00,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:00,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:00,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:00,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:00,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:00,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:00,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:00,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:00,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:00,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:00,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:00,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:00,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:00,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:00,814 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:47:01,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:01,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:01,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:01,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:01,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:01,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:01,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:01,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:01,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:01,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:01,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:01,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:01,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:01,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:01,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:01,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:06,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:06,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:06,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:06,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:06,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:06,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:06,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:06,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:06,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:06,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:06,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:06,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:06,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:06,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:06,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:06,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:07,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:47:07,354 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:47:07,395 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:47:09,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:09,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:09,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:09,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:09,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:09,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:09,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:09,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:09,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:09,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:09,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:09,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:09,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:09,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:09,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:09,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:09,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:09,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:09,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:09,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:09,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:09,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:09,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:09,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:09,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:09,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:09,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:09,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:09,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:09,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:09,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:09,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:11,396 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:47:11,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:11,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:11,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:11,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:11,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:11,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:11,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:11,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:11,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:11,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:11,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:11,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:11,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:11,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:11,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:11,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:15,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:47:18,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:18,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:18,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:18,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:18,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:18,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:18,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:18,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:18,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:18,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:18,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:18,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:18,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:18,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:18,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:18,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:18,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:18,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:18,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:18,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:18,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:18,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:18,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:18,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:18,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:18,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:18,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:18,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:18,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:18,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:18,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:18,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:19,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:47:19,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:19,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:19,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:19,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:19,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:19,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:19,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:19,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:19,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:19,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:19,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:19,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:19,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:19,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:19,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:19,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:19,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:19,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:19,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:19,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:19,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:19,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:19,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:19,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:19,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:19,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:19,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:19,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:19,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:19,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:19,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:19,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:20,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:20,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:20,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:20,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:20,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:20,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:20,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:20,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:20,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:20,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:20,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:20,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:20,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:20,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:20,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:20,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:21,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:21,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:21,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:21,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:21,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:21,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:21,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:21,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:21,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:21,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:21,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:21,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:21,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:21,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:21,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:21,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:22,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:22,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:22,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:22,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:22,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:22,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:22,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:22,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:22,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:22,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:22,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:22,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:22,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:22,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:22,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:22,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:22,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:47:22,911 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:47:23,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:47:24,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:24,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:24,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:24,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:24,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:24,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:24,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:24,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:24,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:24,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:24,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:24,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:24,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:24,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:24,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:24,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:25,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:25,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:25,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:25,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:25,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:25,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:25,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:25,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:25,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:25,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:25,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:25,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:25,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:25,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:25,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:25,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:26,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:26,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:26,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:26,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:26,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:26,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:26,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:26,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:26,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:26,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:26,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:26,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:26,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:26,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:26,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:26,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:27,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:27,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:27,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:27,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:27,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:27,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:27,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:27,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:27,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:47:27,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:27,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:27,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:27,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:27,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:27,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:27,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:27,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:27,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:27,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:27,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:27,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:27,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:27,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:27,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:27,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:27,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:27,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:27,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:27,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:27,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:27,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:27,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:27,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:30,889 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:47:31,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:47:33,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:33,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:33,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:33,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:33,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:33,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:33,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:33,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:33,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:33,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:33,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:33,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:33,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:33,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:33,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:33,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:33,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:33,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:33,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:33,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:33,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:33,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:33,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:33,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:33,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:33,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:33,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:33,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:33,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:33,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:33,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:33,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:35,407 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:47:37,407 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:47:38,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:47:38,136 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:47:41,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:41,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:41,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:41,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:41,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:41,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:41,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:41,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:41,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:41,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:41,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:41,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:41,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:41,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:41,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:41,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:47:41,409 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:47:45,411 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:47:47,412 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:47:51,414 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:47:53,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:47:53,629 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:47:54,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:47:56,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:48:00,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:48:00,958 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:48:02,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:48:04,419 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:48:06,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:48:08,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:48:08,955 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:48:10,421 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:48:12,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:48:14,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:48:16,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:48:16,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:16,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:16,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:16,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:16,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:16,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:16,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:16,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:16,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:16,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:16,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:16,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:16,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:16,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:16,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:16,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:18,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:48:20,425 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:48:22,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:48:24,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:48:24,274 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:48:24,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:48:26,427 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:48:28,428 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:48:29,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:29,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:29,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:29,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:29,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:29,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:29,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:29,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:29,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:29,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:29,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:29,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:29,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:29,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:29,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:29,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:30,429 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:48:31,032 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:48:32,430 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:48:34,431 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:48:36,432 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:48:38,432 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:48:39,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:48:39,658 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:48:40,433 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:48:42,434 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:48:44,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:44,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:44,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:44,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:44,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:44,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:44,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:44,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:44,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:44,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:44,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:44,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:44,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:44,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:44,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:44,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:44,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:48:45,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:45,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:45,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:45,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:45,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:45,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:45,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:45,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:45,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:45,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:45,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:45,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:45,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:45,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:45,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:45,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:45,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:45,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:45,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:45,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:45,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:45,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:45,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:45,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:45,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:45,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:45,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:45,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:45,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:45,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:45,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:45,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:46,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:48:46,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:46,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:46,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:46,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:46,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:46,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:46,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:46,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:46,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:46,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:46,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:46,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:46,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:46,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:46,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:46,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:47,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:47,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:47,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:47,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:47,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:47,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:47,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:47,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:47,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:47,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:47,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:47,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:47,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:47,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:47,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:47,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:48,436 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:48:49,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:49,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:49,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:49,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:49,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:49,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:49,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:49,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:49,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:49,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:49,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:49,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:49,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:49,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:49,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:49,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:49,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:49,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:49,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:49,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:49,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:49,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:49,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:49,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:49,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:49,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:49,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:49,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:49,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:49,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:49,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:49,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:50,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:50,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:50,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:50,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:50,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:50,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:50,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:50,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:50,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:50,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:50,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:50,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:50,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:50,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:50,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:50,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:50,437 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:48:50,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:50,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:50,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:50,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:50,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:50,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:50,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:50,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:50,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:50,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:50,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:50,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:50,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:50,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:50,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:50,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:51,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:52,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:52,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:52,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:52,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:52,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:52,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:52,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:52,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:52,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:52,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:52,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:52,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:52,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:52,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:52,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:52,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:52,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:48:53,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:53,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:53,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:53,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:53,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:53,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:53,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:53,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:53,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:53,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:53,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:53,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:53,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:53,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:53,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:53,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:53,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:53,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:53,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:53,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:53,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:53,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:53,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:53,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:53,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:53,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:53,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:53,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:53,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:53,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:53,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:53,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:54,439 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:48:54,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:48:54,912 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:48:54,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:54,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:54,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:54,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:54,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:54,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:54,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:54,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:54,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:54,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:54,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:54,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:54,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:54,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:54,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:54,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:55,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:55,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:55,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:55,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:55,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:55,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:55,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:55,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:55,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:55,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:55,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:55,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:55,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:55,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:55,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:55,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:55,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:55,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:55,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:55,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:55,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:55,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:55,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:55,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:55,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:55,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:55,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:55,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:55,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 16:48:55,690 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 16:48:55,925 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 16:48:55,988 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 16:48:56,440 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 16:48:56,440 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:48:58,441 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:49:00,441 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:49:01,122 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:49:02,442 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:49:04,443 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:49:06,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:49:08,445 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:49:10,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:49:10,188 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:49:10,446 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:49:12,446 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:49:14,447 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:49:16,448 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:49:18,449 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:49:20,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:49:22,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:49:24,451 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:49:25,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:49:25,461 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:49:27,452 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:49:29,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:49:31,197 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:49:31,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:49:33,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:49:35,455 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:49:37,455 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:49:39,456 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:49:40,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:49:40,687 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:49:41,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:49:43,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:49:45,458 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:49:47,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:49:49,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:49:51,460 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:49:53,461 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:49:55,461 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:49:55,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:49:55,910 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:49:57,462 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:49:59,463 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:50:01,272 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:50:01,463 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:50:03,464 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:50:05,465 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:50:07,465 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:50:09,466 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:50:11,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:50:11,351 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:50:11,467 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:50:13,467 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:50:15,468 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:50:17,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:50:19,470 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:50:21,470 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:50:23,471 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:50:25,472 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:50:26,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:50:26,579 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:50:27,473 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:50:29,473 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:50:31,344 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:50:31,474 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:50:33,476 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:50:35,476 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:50:37,477 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:50:39,478 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:50:41,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:50:41,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:50:41,910 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:50:43,480 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:50:45,480 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:50:47,481 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:50:50,482 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:50:52,483 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:50:54,484 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:50:56,485 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:50:57,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:50:57,152 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:50:58,486 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:51:00,487 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:51:01,427 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:51:02,487 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:51:04,488 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:51:06,500 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:51:08,497 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:51:10,498 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:51:12,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:51:12,373 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:51:12,499 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:51:14,500 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:51:16,500 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:51:18,501 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:51:20,502 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:51:22,503 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:51:24,504 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:51:26,504 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:51:27,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:51:27,802 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:51:28,505 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:51:30,506 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:51:31,501 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:51:32,507 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:51:34,507 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:51:36,508 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:51:38,509 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:51:40,510 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:51:42,510 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:51:43,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:51:43,071 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:51:44,511 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:51:46,512 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:51:48,513 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:51:50,514 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:51:52,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:51:54,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:51:56,516 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:51:58,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:51:58,311 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:51:58,517 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:52:01,518 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:52:01,576 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:52:03,518 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:52:05,519 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:52:07,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:52:09,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:52:11,521 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:52:13,522 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:52:13,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:52:13,537 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:52:15,523 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:52:17,523 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:52:19,524 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:52:21,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:52:23,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:52:25,526 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:52:27,527 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:52:28,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:52:28,891 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:52:29,528 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:52:31,528 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:52:31,652 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:52:33,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:52:35,530 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:52:37,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:52:39,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:52:41,532 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:52:43,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:52:44,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:52:44,300 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:52:45,534 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:52:47,535 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:52:49,536 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:52:51,537 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:52:53,538 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:52:56,539 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:52:58,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:52:59,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:52:59,669 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:53:00,541 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:53:01,715 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:53:02,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:53:04,543 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:53:06,544 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:53:08,545 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:53:10,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:53:12,547 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:53:14,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:53:14,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:53:14,900 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:53:16,549 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:53:18,550 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:53:20,551 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:53:22,552 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:53:24,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:53:26,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:53:28,555 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:53:30,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:53:30,337 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:53:30,556 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:53:31,766 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:53:32,557 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:53:34,558 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:53:36,559 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:53:38,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:53:40,561 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:53:42,562 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:53:44,563 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:53:45,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:53:45,566 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:53:46,564 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:53:48,565 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:53:50,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:53:52,567 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:53:54,568 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:53:56,568 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:53:58,569 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:54:00,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:54:00,879 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:54:01,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:54:01,818 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:54:03,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:54:05,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:54:07,574 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:54:09,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:54:11,576 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:54:13,576 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:54:15,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:54:16,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:54:16,133 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:54:17,578 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:54:19,579 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:54:21,580 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:54:23,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:54:25,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:54:27,583 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:54:29,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:54:31,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:54:31,436 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:54:31,585 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:54:31,869 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:54:33,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:54:35,587 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:54:37,588 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:54:39,589 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:54:41,590 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:54:43,591 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:54:45,592 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:54:46,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:54:46,768 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:54:47,593 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:54:49,594 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:54:51,595 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:54:53,596 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:54:55,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:54:57,598 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:54:59,599 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:55:01,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:55:01,931 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:55:02,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:55:02,065 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:55:03,601 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:55:05,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:55:07,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:55:09,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:55:11,605 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:55:13,606 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:55:15,607 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:55:17,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:55:17,380 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:55:17,608 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:55:19,609 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:55:21,610 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:55:23,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:55:25,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:55:27,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:55:29,613 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:55:31,614 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:55:31,999 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:55:32,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:55:32,680 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:55:33,615 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:55:35,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:55:38,617 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:55:40,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:55:42,619 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:55:44,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:55:46,621 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:55:47,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:55:47,945 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:55:48,622 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:55:50,623 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:55:52,624 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:55:54,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:55:56,626 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:55:58,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:56:00,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:56:02,073 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:56:02,629 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:56:03,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:56:03,255 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:56:04,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:56:06,631 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:56:08,632 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:56:10,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:56:12,634 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:56:14,635 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:56:16,636 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:56:18,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:56:18,536 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:56:18,637 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:56:20,638 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:56:22,639 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:56:24,640 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:56:26,641 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:56:28,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:56:30,643 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:56:32,149 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:56:32,644 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:56:33,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:56:33,848 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:56:34,645 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:56:36,645 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:56:38,646 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:56:40,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:56:42,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:56:44,648 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:56:46,649 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:56:48,649 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:56:49,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:56:49,130 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:56:51,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:56:53,651 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:56:55,652 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:56:57,653 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:56:59,654 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:57:01,654 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:57:02,219 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:57:03,655 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:57:04,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:57:04,355 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:57:05,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:57:07,657 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:57:09,657 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:57:11,658 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:57:13,659 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:57:15,659 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:57:17,660 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:57:19,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:57:19,648 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:57:19,661 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:57:21,661 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:57:23,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:57:25,663 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:57:27,664 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:57:29,664 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:57:31,665 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:57:32,284 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:57:33,666 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:57:35,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:57:35,010 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:57:35,667 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:57:37,668 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:57:39,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:57:41,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:57:43,670 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:57:45,671 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:57:48,672 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:57:50,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:57:50,272 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:57:50,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:57:52,674 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:57:54,674 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:57:56,676 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:57:58,676 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:58:00,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:58:02,355 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:58:02,678 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:58:04,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:58:05,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:58:05,777 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:58:06,680 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:58:08,680 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:58:10,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:58:12,682 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:58:14,683 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:58:16,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:58:18,685 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:58:20,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:58:20,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:58:20,998 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:58:22,687 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:58:24,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:58:26,689 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:58:28,689 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:58:30,690 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:58:32,431 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:58:32,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:58:34,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:58:36,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:58:36,322 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:58:36,692 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:58:38,693 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:58:40,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:58:42,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:58:44,695 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:58:46,696 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:58:48,696 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:58:50,697 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:58:51,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:58:51,645 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:58:52,698 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:58:54,698 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:58:56,699 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:58:58,700 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:59:00,700 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:59:02,502 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:59:02,701 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:59:05,702 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:59:06,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:59:06,899 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:59:07,703 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:59:09,704 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:59:11,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:59:13,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:59:15,706 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:59:17,707 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:59:19,707 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:59:21,708 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:59:22,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:59:22,222 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:59:23,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:59:25,710 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:59:27,710 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:59:29,711 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:59:31,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:59:32,575 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 16:59:33,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:59:35,713 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:59:37,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:59:37,467 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:59:37,714 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:59:39,715 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:59:41,716 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:59:43,716 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:59:45,717 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:59:47,718 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:59:49,719 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:59:51,720 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:59:52,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 16:59:52,761 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 16:59:53,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:59:55,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:59:57,722 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 16:59:59,723 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:00:01,724 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:00:02,648 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:00:03,725 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:00:05,726 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:00:07,726 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:00:08,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:00:08,003 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:00:09,727 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:00:11,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:00:13,729 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:00:15,729 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:00:17,730 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:00:19,731 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:00:21,732 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:00:23,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:00:23,292 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:00:23,732 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:00:25,733 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:00:27,734 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:00:29,734 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:00:32,724 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:00:32,736 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:00:34,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:00:36,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:00:38,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:00:38,517 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:00:38,740 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:00:40,741 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:00:42,742 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:00:44,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:00:46,744 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:00:48,745 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:00:50,746 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:00:52,747 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:00:53,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:00:53,839 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:00:54,748 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:00:56,749 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:00:58,750 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:01:00,751 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:01:02,752 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:01:02,802 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:01:04,753 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:01:06,754 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:01:08,755 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:01:09,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:01:09,154 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:01:10,756 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:01:12,757 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:01:14,758 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:01:16,759 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:01:18,759 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:01:20,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:01:22,761 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:01:24,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:01:24,655 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:01:25,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:01:27,763 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:01:29,763 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:01:31,764 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:01:32,875 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:01:33,765 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:01:35,766 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:01:37,767 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:01:39,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:01:39,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:01:39,916 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:01:41,769 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:01:43,769 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:01:45,770 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:01:47,771 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:01:49,772 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:01:51,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:01:53,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:01:55,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:01:55,241 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:01:55,775 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:01:57,775 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:01:59,776 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:02:01,777 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:02:02,948 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:02:03,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:02:05,779 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:02:07,780 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:02:09,781 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:02:10,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:02:10,474 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:02:11,782 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:02:13,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:02:15,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:02:17,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:02:19,785 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:02:21,786 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:02:23,787 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:02:25,788 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:02:26,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:02:26,067 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:02:27,789 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:02:29,790 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:02:31,791 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:02:33,021 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:02:34,793 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:02:36,793 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:02:38,794 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:02:40,795 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:02:41,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:02:41,296 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:02:42,796 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:02:44,797 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:02:46,798 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:02:48,799 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:02:50,800 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:02:52,801 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:02:54,802 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:02:56,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:02:56,561 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:02:56,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:02:58,804 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:03:00,805 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:03:02,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:03:03,094 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:03:04,807 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:03:06,808 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:03:08,809 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:03:10,810 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:03:11,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:03:11,837 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:03:12,811 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:03:14,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:03:16,813 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:03:18,814 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:03:20,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:03:22,816 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:03:24,817 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:03:26,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:03:27,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:03:27,126 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:03:28,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:03:30,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:03:32,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:03:33,169 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:03:34,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:03:36,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:03:38,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:03:40,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:03:42,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:03:42,353 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:03:42,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:03:44,826 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:03:46,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:03:48,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:03:50,829 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:03:52,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:03:54,831 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:03:56,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:03:57,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:03:57,717 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:03:58,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:04:00,833 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:04:02,834 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:04:03,244 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:04:04,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:04:07,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:04:09,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:04:11,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:04:13,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:04:13,204 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:04:13,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:04:15,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:04:17,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:04:19,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:04:21,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:04:23,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:04:25,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:04:27,846 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:04:28,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:04:28,458 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:04:29,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:04:31,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:04:33,317 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:04:33,849 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:04:35,850 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:04:37,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:04:39,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:04:41,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:04:43,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:04:43,747 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:04:43,854 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:04:45,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:04:47,856 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:04:49,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:04:51,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:04:53,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:04:55,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:04:57,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:04:59,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:04:59,127 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:04:59,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:05:01,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:05:03,391 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:05:03,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:05:05,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:05:07,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:05:09,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:05:11,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:05:13,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:05:14,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:05:14,354 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:05:15,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:05:17,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:05:19,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:05:21,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:05:23,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:05:25,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:05:27,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:05:29,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:05:29,686 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:05:29,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:05:31,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:05:33,466 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:05:33,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:05:36,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:05:38,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:05:40,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:05:42,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:05:44,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:05:44,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:05:44,911 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:05:46,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:05:48,882 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:05:50,883 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:05:52,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:05:54,885 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:05:56,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:05:58,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:06:00,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:06:00,216 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:06:00,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:06:02,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:06:03,536 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:06:04,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:06:06,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:06:08,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:06:10,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:06:12,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:06:14,894 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:06:15,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:06:15,625 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:06:16,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:06:18,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:06:20,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:06:22,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:06:24,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:06:26,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:06:28,900 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:06:30,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:06:30,848 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:06:30,901 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:06:32,902 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:06:33,609 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:06:34,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:06:36,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:06:38,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:06:40,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:06:42,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:06:44,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:06:46,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:06:46,222 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:06:47,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:06:49,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:06:51,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:06:53,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:06:55,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:06:57,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:06:59,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:07:01,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:07:01,450 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:07:01,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:07:03,684 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:07:03,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:07:05,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:07:07,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:07:09,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:07:11,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:07:13,916 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:07:15,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:07:16,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:07:16,732 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:07:17,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:07:19,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:07:21,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:07:23,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:07:25,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:07:27,921 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:07:29,922 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:07:31,922 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:07:32,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:07:32,113 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:07:33,759 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:07:33,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:07:35,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:07:37,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:07:39,925 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:07:41,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:07:43,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:07:45,927 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:07:47,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:07:47,369 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:07:47,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:07:49,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:07:51,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:07:53,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:07:55,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:07:57,932 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:07:59,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:08:01,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:08:02,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:08:02,707 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:08:03,833 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:08:04,935 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:08:06,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:08:08,937 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:08:10,938 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:08:12,939 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:08:14,939 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:08:16,940 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:08:17,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:08:17,982 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:08:18,941 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:08:20,942 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:08:22,943 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:08:24,944 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:08:26,945 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:08:28,946 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:08:30,947 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:08:32,948 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:08:33,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:08:33,305 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:08:33,905 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:08:34,949 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:08:36,950 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:08:38,951 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:08:40,952 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:08:42,953 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:08:44,954 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:08:46,955 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:08:48,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:08:48,570 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:08:48,956 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:08:50,957 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:08:52,958 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:08:54,959 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:08:56,960 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:08:58,961 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:09:00,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:09:02,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:09:03,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:09:03,869 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:09:04,119 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:09:04,963 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:09:06,964 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:09:08,965 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:09:10,966 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:09:12,967 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:09:14,968 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:09:16,969 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:09:18,970 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:09:19,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:09:19,208 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:09:21,971 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:09:23,972 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:09:25,974 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:09:27,975 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:09:29,975 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:09:31,976 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:09:33,978 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:09:34,056 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:09:34,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:09:34,586 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:09:35,978 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:09:37,979 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:09:39,981 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:09:41,981 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:09:43,982 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:09:45,983 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:09:47,984 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:09:49,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:09:49,962 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:09:49,985 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:09:51,986 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:09:53,987 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:09:55,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:09:57,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:09:59,989 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:10:01,990 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:10:03,991 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:10:04,129 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:10:05,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:10:05,188 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:10:05,992 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:10:07,992 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:10:09,993 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:10:12,994 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:10:14,995 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:10:16,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:10:18,997 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:10:20,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:10:20,478 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:10:20,998 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:10:22,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:10:24,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:10:27,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:10:29,001 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:10:31,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:10:33,003 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:10:34,206 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:10:35,004 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:10:35,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:10:35,703 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:10:37,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:10:39,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:10:41,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:10:43,007 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:10:45,008 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:10:47,009 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:10:49,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:10:50,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:10:50,928 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:10:51,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:10:53,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:10:55,012 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:10:57,013 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:10:59,014 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:11:01,014 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:11:03,015 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:11:04,272 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:11:05,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:11:06,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:11:06,155 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:11:07,017 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:11:09,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:11:11,019 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:11:13,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:11:15,021 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:11:17,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:11:19,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:11:21,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:11:21,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:11:21,382 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:11:23,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:11:25,025 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:11:27,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:11:30,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:11:32,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:11:34,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:11:34,336 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:11:36,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:11:36,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:11:36,691 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:11:38,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:11:40,031 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:11:42,032 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:11:44,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:11:46,034 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:11:48,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:11:50,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:11:51,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:11:51,956 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:11:52,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:11:54,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:11:56,038 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:11:58,039 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:12:00,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:12:02,041 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:12:04,042 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:12:04,408 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:12:06,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:12:07,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:12:07,229 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:12:08,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:12:10,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:12:12,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:12:14,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:12:16,047 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:12:18,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:12:20,049 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:12:22,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:12:22,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:12:22,527 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:12:24,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:12:26,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:12:28,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:12:30,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:12:32,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:12:34,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:12:34,480 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:12:37,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:12:37,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:12:37,795 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:12:39,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:12:41,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:12:43,059 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:12:45,060 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:12:47,061 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:12:49,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:12:51,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:12:53,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:12:53,018 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:12:53,063 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:12:55,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:12:57,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:12:59,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:13:01,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:13:03,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:13:04,547 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:13:05,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:13:07,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:13:08,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:13:08,351 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:13:09,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:13:11,071 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:13:13,071 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:13:15,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:13:17,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:13:19,074 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:13:21,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:13:23,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:13:23,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:13:23,641 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:13:25,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:13:27,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:13:29,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:13:31,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:13:33,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:13:34,622 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:13:35,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:13:37,081 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:13:39,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:13:39,067 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:13:39,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:13:41,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:13:43,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:13:45,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:13:47,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:13:49,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:13:51,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:13:53,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:13:54,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:13:54,297 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:13:55,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:13:57,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:13:59,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:14:01,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:14:03,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:14:04,697 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:14:05,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:14:07,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:14:09,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:14:09,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:14:09,763 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:14:11,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:14:13,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:14:15,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:14:17,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:14:19,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:14:21,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:14:23,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:14:24,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:14:24,989 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:14:25,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:14:27,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:14:30,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:14:32,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:14:34,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:14:34,763 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:14:36,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:14:38,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:14:40,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:14:40,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:14:40,209 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:14:42,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:14:44,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:14:46,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:14:48,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:14:50,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:14:52,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:14:54,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:14:55,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:14:55,431 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:14:56,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:14:58,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:15:00,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:15:02,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:15:04,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:15:04,836 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:15:06,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:15:08,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:15:10,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:15:10,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:15:10,668 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:15:12,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:15:14,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:15:16,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:15:18,121 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:15:20,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:15:22,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:15:24,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:15:25,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:15:25,896 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:15:26,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:15:28,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:15:30,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:15:32,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:15:34,128 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:15:34,908 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:15:36,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:15:38,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:15:40,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:15:41,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:15:41,123 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:15:42,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:15:44,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:15:46,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:15:48,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:15:50,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:15:52,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:15:54,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:15:56,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:15:56,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:15:56,420 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:15:58,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:16:00,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:16:02,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:16:04,140 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:16:04,980 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:16:06,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:16:08,142 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:16:10,142 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:16:11,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:16:11,749 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:16:12,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:16:15,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:16:17,145 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:16:19,146 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:16:21,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:16:23,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:16:25,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:16:27,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:16:27,067 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:16:27,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:16:29,150 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:16:31,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:16:33,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:16:35,054 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:16:35,152 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:16:37,153 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:16:39,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:16:41,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:16:42,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:16:42,331 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:16:43,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:16:45,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:16:47,157 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:16:49,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:16:51,159 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:16:53,160 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:16:55,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:16:57,162 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:16:57,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:16:57,675 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:16:59,163 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:17:01,164 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:17:03,165 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:17:05,126 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:17:05,165 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:17:07,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:17:09,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:17:11,168 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:17:13,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:17:13,000 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:17:13,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:17:15,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:17:17,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:17:19,172 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:17:21,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:17:23,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:17:25,175 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:17:27,176 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:17:28,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:17:28,225 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:17:29,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:17:31,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:17:33,179 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:17:35,179 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:17:35,199 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:17:37,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:17:39,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:17:41,182 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:17:43,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:17:43,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:17:43,447 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:17:45,184 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:17:47,185 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:17:49,186 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:17:51,187 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:17:53,188 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:17:55,188 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:17:58,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:17:58,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:17:58,738 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:18:00,191 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:18:02,192 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:18:04,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:18:05,266 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:18:06,194 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:18:08,195 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:18:10,196 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:18:12,197 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:18:14,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:18:14,097 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:18:14,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:18:16,199 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:18:18,200 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:18:20,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:18:22,202 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:18:24,203 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:18:26,204 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:18:28,205 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:18:29,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:18:29,370 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:18:30,206 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:18:32,206 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:18:34,207 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:18:35,316 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:18:36,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:18:38,209 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:18:40,212 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:18:42,213 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:18:44,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:18:44,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:18:44,596 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:18:46,220 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:18:48,221 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:18:50,222 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:18:52,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:18:54,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:18:57,225 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:18:59,226 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:18:59,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:18:59,824 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:19:01,227 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:19:03,228 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:19:05,228 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:19:05,384 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:19:07,229 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:19:09,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:19:11,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:19:13,231 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:19:15,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:19:15,189 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:19:15,232 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:19:17,233 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:19:19,234 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:19:21,235 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:19:23,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:19:25,237 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:19:27,238 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:19:29,239 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:19:30,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:19:30,525 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:19:31,240 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:19:33,241 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:19:35,242 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:19:35,453 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:19:37,243 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:19:39,244 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:19:41,245 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:19:43,245 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:19:45,246 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:19:45,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:19:45,805 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:19:47,247 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:19:49,248 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:19:51,249 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:19:53,250 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:19:55,251 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:19:57,252 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:20:00,254 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:20:01,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:20:01,031 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:20:02,255 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:20:04,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:20:05,526 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:20:06,257 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:20:08,258 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:20:10,258 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:20:12,259 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:20:15,261 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:20:16,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:20:16,262 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:20:17,262 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:20:19,263 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:20:21,264 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:20:23,265 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:20:25,266 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:20:27,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:20:29,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:20:31,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:20:31,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:20:31,546 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:20:33,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:20:35,270 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:20:35,599 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:20:37,271 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:20:39,272 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:20:41,273 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:20:43,274 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:20:45,275 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:20:46,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:20:46,843 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:20:47,276 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:20:49,277 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:20:51,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:20:53,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:20:55,279 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:20:57,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:20:59,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:21:01,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:21:02,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:21:02,079 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:21:03,283 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:21:05,674 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:21:06,285 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:21:08,286 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:21:10,286 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:21:12,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:21:14,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:21:16,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:21:17,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:21:17,455 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:21:18,290 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:21:20,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:21:22,292 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:21:24,293 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:21:26,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:21:28,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:21:30,296 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:21:32,297 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:21:32,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:21:32,681 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:21:34,298 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:21:35,749 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:21:36,299 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:21:38,300 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:21:40,301 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:21:42,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:21:44,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:21:46,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:21:47,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:21:47,916 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:21:48,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:21:50,306 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:21:52,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:21:54,308 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:21:56,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:21:58,310 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:22:00,310 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:22:02,311 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:22:03,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:22:03,141 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:22:04,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:22:05,825 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:22:06,313 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:22:08,314 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:22:10,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:22:12,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:22:14,316 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:22:16,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:22:18,318 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:22:18,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:22:18,450 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:22:20,319 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:22:22,319 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:22:25,321 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:22:27,321 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:22:29,322 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:22:31,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:22:33,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:22:33,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:22:33,709 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:22:35,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:22:35,901 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:22:37,326 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:22:39,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:22:41,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:22:43,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:22:45,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:22:47,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:22:48,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:22:48,965 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:22:49,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:22:51,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:22:53,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:22:55,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:22:57,335 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:22:59,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:23:01,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:23:03,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:23:04,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:23:04,270 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:23:05,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:23:05,973 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:23:07,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:23:09,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:23:11,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:23:13,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:23:15,342 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:23:17,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:23:19,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:23:19,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:23:19,540 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:23:21,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:23:23,346 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:23:25,346 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:23:27,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:23:29,348 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:23:31,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:23:33,350 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:23:34,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:23:34,858 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:23:35,350 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:23:36,045 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:23:37,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:23:39,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:23:41,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:23:43,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:23:45,354 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:23:47,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:23:49,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:23:50,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:23:50,198 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:23:51,356 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:23:53,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:23:55,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:23:57,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:23:59,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:24:01,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:24:03,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:24:05,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:24:05,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:24:05,451 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:24:06,120 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:24:07,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:24:09,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:24:12,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:24:14,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:24:16,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:24:18,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:24:20,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:24:20,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:24:20,756 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:24:22,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:24:24,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:24:26,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:24:28,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:24:30,371 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:24:32,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:24:34,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:24:36,194 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:24:36,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:24:36,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:24:36,628 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:24:38,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:24:40,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:24:42,376 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:24:44,377 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:24:46,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:24:48,379 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:24:50,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:24:51,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:24:51,909 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:24:52,381 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:24:54,382 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:24:56,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:24:58,384 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:25:00,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:25:02,386 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:25:05,387 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:25:06,267 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:25:07,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:25:07,194 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:25:07,388 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:25:09,389 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:25:11,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:25:13,391 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:25:15,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:25:17,393 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:25:19,393 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:25:21,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:25:22,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:25:22,776 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:25:23,395 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:25:25,396 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:25:27,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:25:29,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:25:31,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:25:33,399 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:25:35,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:25:36,341 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:25:37,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:25:38,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:25:38,048 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:25:39,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:25:41,402 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:25:43,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:25:45,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:25:47,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:25:49,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:25:51,406 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:25:53,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:25:53,270 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:25:53,407 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:25:55,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:25:57,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:25:59,409 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:26:01,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:26:03,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:26:05,411 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:26:06,416 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:26:07,412 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:26:08,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:26:08,496 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:26:09,413 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:26:11,414 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:26:14,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:26:16,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:26:18,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:26:20,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:26:22,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:26:23,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:26:23,803 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:26:24,419 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:26:26,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:26:28,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:26:30,421 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:26:32,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:26:34,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:26:36,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:26:36,490 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:26:38,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:26:39,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:26:39,182 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:26:40,425 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:26:42,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:26:44,427 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:26:46,428 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:26:48,428 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:26:50,429 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:26:52,430 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:26:54,431 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:26:54,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:26:54,448 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:26:56,432 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:26:58,433 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:27:00,434 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:27:02,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:27:04,436 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:27:06,437 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:27:06,564 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:27:08,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:27:09,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:27:09,885 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:27:10,439 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:27:12,440 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:27:14,441 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:27:16,442 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:27:18,443 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:27:20,446 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:27:23,448 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:27:25,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:27:25,154 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:27:25,449 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:27:27,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:27:29,451 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:27:31,452 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:27:33,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:27:35,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:27:36,636 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:27:37,455 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:27:39,455 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:27:40,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:27:40,381 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:27:41,456 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:27:43,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:27:45,458 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:27:47,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:27:49,460 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:27:51,461 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:27:53,461 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:27:55,462 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:27:55,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:27:55,606 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:27:57,463 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:27:59,464 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:28:01,465 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:28:03,466 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:28:05,466 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:28:06,710 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:28:07,467 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:28:09,468 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:28:10,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:28:10,948 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:28:11,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:28:13,470 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:28:15,470 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:28:17,471 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:28:19,472 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:28:21,473 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:28:23,474 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:28:25,475 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:28:26,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:28:26,238 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:28:27,475 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:28:29,476 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:28:32,477 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:28:34,478 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:28:36,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:28:36,780 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:28:38,480 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:28:40,481 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:28:41,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:28:41,767 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:28:42,482 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:28:44,482 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:28:46,483 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:28:48,484 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:28:50,485 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:28:52,486 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:28:54,486 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:28:56,487 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:28:56,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:28:56,989 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:28:58,488 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:29:00,489 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:29:02,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:29:04,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:29:06,491 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:29:06,854 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:29:08,492 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:29:10,493 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:29:12,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:29:12,346 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:29:12,494 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:29:14,495 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:29:16,496 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:29:18,497 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:29:20,497 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:29:22,498 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:29:24,499 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:29:26,500 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:29:27,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:29:27,694 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:29:28,501 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:29:30,502 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:29:32,502 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:29:34,503 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:29:36,504 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:29:36,929 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:29:38,505 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:29:40,505 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:29:42,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:29:42,913 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:29:43,506 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:29:45,507 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:29:47,508 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:29:49,509 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:29:51,510 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:29:53,510 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:29:55,511 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:29:57,512 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:29:58,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:29:58,285 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:29:59,513 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:30:01,514 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:30:03,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:30:05,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:30:07,000 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:30:07,516 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:30:09,517 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:30:11,518 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:30:13,519 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:30:13,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:30:13,539 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:30:15,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:30:17,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:30:19,521 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:30:21,522 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:30:23,523 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:30:25,524 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:30:27,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:30:28,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:30:28,763 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:30:29,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:30:31,526 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:30:33,527 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:30:35,528 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:30:37,073 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:30:37,528 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:30:39,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:30:41,530 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:30:43,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:30:44,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:30:44,039 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:30:45,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:30:47,532 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:30:50,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:30:52,534 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:30:54,535 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:30:56,536 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:30:58,537 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:30:59,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:30:59,303 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:31:00,538 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:31:02,539 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:31:04,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:31:06,541 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:31:07,150 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:31:08,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:31:10,543 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:31:12,544 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:31:14,545 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:31:14,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:31:14,624 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:31:16,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:31:18,547 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:31:20,547 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:31:22,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:31:24,549 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:31:26,550 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:31:28,551 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:31:29,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:31:29,881 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:31:30,551 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:31:32,552 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:31:34,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:31:36,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:31:37,222 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:31:38,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:31:40,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:31:42,555 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:31:44,556 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:31:45,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:31:45,174 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:31:46,557 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:31:48,558 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:31:50,559 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:31:52,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:31:54,561 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:31:57,562 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:31:59,563 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:32:00,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:32:00,404 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:32:01,564 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:32:03,565 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:32:05,565 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:32:07,292 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:32:07,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:32:09,567 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:32:11,568 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:32:13,569 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:32:15,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:32:15,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:32:15,707 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:32:17,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:32:19,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:32:21,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:32:23,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:32:25,574 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:32:27,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:32:29,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:32:30,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:32:30,990 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:32:31,576 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:32:33,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:32:35,578 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:32:37,388 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:32:37,578 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:32:39,579 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:32:41,580 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:32:43,580 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:32:45,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:32:46,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:32:46,345 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:32:47,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:32:49,583 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:32:51,583 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:32:53,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:32:55,585 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:32:57,585 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:32:59,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:33:01,587 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:33:01,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:33:01,613 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:33:03,588 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:33:05,589 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:33:07,439 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:33:16,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:33:16,896 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:33:32,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:33:32,180 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:33:37,514 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:33:47,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:33:47,486 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:34:02,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:34:02,748 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:34:05,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:34:05,376 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 17:34:05,430 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 17:34:05,510 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 17:34:05,610 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 17:34:06,610 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:34:07,617 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:34:08,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:34:14,613 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:34:18,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:34:18,032 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:34:33,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:34:33,325 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:34:34,622 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:34:37,698 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:34:48,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:34:48,575 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:35:03,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:35:03,800 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:35:07,771 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:35:19,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:35:19,213 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:35:34,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:35:34,438 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:35:37,853 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:35:49,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:35:49,665 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:36:04,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:36:04,953 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:36:07,928 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:36:20,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:36:20,177 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:36:35,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:36:35,408 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:36:38,005 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:36:50,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:36:50,663 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:37:05,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:37:05,890 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:37:08,083 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:37:21,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:37:21,169 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:37:36,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:37:36,395 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:37:38,162 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:37:51,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:37:51,620 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:38:06,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:38:06,846 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:38:08,237 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:38:22,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:38:22,141 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:38:26,726 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:38:28,727 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:38:31,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:31,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:31,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:31,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:31,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:31,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:31,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:31,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:31,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:31,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:31,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:31,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:31,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:31,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:31,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:31,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:31,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:31,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:31,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:31,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:31,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:31,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:31,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:31,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:31,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:31,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:31,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:31,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:31,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:31,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:31,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:31,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:37,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:38:37,611 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:38:38,311 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:38:38,730 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:38:41,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:41,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:41,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:41,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:41,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:41,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:41,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:41,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:41,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:41,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:41,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:41,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:41,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:41,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:41,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:41,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:42,732 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:38:43,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:43,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:45,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:46,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:46,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:46,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:46,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:46,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:46,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:46,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:46,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:46,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:46,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:46,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:46,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:46,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:46,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:46,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:46,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:47,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:47,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:47,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:47,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:47,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:47,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:47,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:47,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:47,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:47,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:47,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:47,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:47,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:47,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:47,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:47,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:48,734 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:38:50,735 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:38:51,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:51,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:51,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:51,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:51,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:51,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:51,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:51,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:51,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:51,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:51,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:51,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:51,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:51,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:51,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:51,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:52,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:38:52,882 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:38:54,736 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:38:57,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:57,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:59,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:59,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:59,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:59,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:59,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:59,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:59,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:59,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:59,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:59,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:59,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:59,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:59,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:59,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:59,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:59,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:38:59,739 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:39:00,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:00,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:02,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:02,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:02,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:02,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:02,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:02,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:02,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:02,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:02,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:02,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:02,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:02,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:02,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:02,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:02,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:02,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:03,740 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:39:04,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:04,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:04,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:04,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:04,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:04,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:04,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:04,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:04,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:04,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:04,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:04,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:04,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:04,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:04,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:04,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:04,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:04,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:04,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:04,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:04,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:04,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:04,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:04,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:04,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:04,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:04,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:04,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:04,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:04,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:04,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:04,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:05,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:05,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:05,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:05,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:05,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:05,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:05,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:05,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:05,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:05,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:05,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:05,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:05,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:05,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:05,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:05,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:06,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:06,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:06,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:06,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:06,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:06,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:06,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:06,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:06,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:06,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:06,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:06,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:06,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:06,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:06,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:06,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:07,742 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:39:07,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:07,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:07,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:07,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:07,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:07,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:07,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:07,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:07,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:07,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:07,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:07,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:07,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:07,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:07,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:07,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:08,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:39:08,102 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:39:09,141 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:39:09,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:09,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:09,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:09,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:09,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:09,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:09,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:09,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:09,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:09,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:09,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:09,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:09,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:09,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:09,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:09,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:09,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:39:13,744 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:39:15,745 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:39:19,746 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:39:21,747 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:39:23,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:23,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:23,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:23,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:23,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:23,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:23,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:23,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:23,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:23,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:23,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:23,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:23,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:23,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:23,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:23,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:24,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:39:24,143 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:39:25,749 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:39:27,749 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:39:29,750 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:39:33,752 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:39:35,752 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:39:37,753 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:39:38,448 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:39:39,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:39:39,371 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:39:39,754 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:39:43,755 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:39:45,756 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:39:47,757 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:39:49,758 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:39:51,759 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:39:53,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:39:54,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:54,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:54,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:54,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:54,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:54,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:54,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:54,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:54,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:54,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:54,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:54,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:54,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:54,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:54,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:54,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:39:54,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:39:54,588 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:39:55,761 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:39:57,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:39:59,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:40:01,763 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:40:03,764 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:40:04,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:04,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:04,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:04,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:04,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:04,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:04,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:04,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:04,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:04,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:04,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:04,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:04,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:04,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:04,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:04,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:05,765 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:40:07,766 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:40:08,514 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:40:09,766 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:40:09,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:40:09,924 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:40:11,767 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:40:13,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:40:15,769 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:40:17,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:17,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:17,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:17,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:17,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:17,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:17,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:17,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:17,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:17,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:17,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:17,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:17,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:17,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:17,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:17,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:17,770 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:40:19,770 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:40:19,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:19,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:19,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:19,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:19,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:19,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:19,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:19,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:19,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:19,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:19,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:19,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:19,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:19,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:19,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:19,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:20,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:20,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:20,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:20,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:20,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:20,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:20,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:20,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:20,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:20,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:20,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:20,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:20,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:20,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:20,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:20,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:21,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:21,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:21,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:21,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:21,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:21,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:21,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:21,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:21,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:21,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:21,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:21,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:21,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:21,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:21,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:21,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:21,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:21,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:21,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:21,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:21,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:21,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:21,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:21,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:21,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:21,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:21,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:21,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:21,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:21,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:21,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:21,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:21,771 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:40:22,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:22,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:22,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:22,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:22,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:22,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:22,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:22,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:22,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:22,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:22,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:22,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:22,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:22,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:22,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:22,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:23,772 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:40:24,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:24,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:24,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:24,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:24,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:24,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:24,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:24,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:24,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:24,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:24,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:24,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:24,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:24,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:24,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:24,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:24,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:24,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:24,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:24,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:24,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:24,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:24,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:24,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:24,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:24,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:24,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:24,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:24,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:24,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:24,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:24,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:25,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:40:25,188 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:40:25,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:25,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:25,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:25,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:25,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:25,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:25,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:25,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:25,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:25,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:25,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:25,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:25,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:25,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:25,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:25,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:25,772 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:40:26,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:26,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:27,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:40:29,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:40:38,581 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:40:39,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:40:39,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:39,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:39,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:39,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:39,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:39,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:39,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:39,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:39,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:39,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:39,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:39,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:39,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:39,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:39,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:39,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:40,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:40:40,411 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:40:43,779 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:40:47,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:47,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:47,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:47,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:47,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:47,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:47,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:47,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:47,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:47,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:47,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:47,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:47,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:47,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:47,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:47,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:47,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:47,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:47,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:47,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:47,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:47,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:47,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:47,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:47,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:47,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:47,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:47,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:47,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:47,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:47,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:47,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:49,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:49,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:49,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:49,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:49,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:49,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:49,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:49,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:49,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:49,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:49,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:49,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:49,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:49,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:49,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:49,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:50,782 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:40:52,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:52,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:52,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:52,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:52,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:52,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:52,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:52,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:52,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:52,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:52,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:52,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:52,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:52,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:52,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:52,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:54,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:40:55,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:40:55,634 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:40:57,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:57,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:57,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:57,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:57,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:57,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:57,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:57,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:57,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:57,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:57,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:57,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:57,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:57,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:57,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:57,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:58,785 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:40:59,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:40:59,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:01,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:01,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:01,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:01,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:01,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:01,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:01,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:01,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:01,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:01,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:01,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:01,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:01,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:01,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:01,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:01,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:02,787 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:41:06,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:06,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:06,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:06,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:06,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:06,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:06,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:06,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:06,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:06,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:06,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:06,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:06,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:06,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:06,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:06,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:06,789 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:41:08,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:08,651 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:41:08,790 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:41:09,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:09,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:10,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:10,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:10,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:10,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:10,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:10,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:10,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:10,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:10,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:10,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:10,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:10,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:10,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:10,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:10,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:41:10,860 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:41:11,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:11,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:12,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:12,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:12,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:12,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:12,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:12,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:12,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:12,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:12,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:12,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:12,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:12,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:12,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:12,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:12,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:12,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:12,791 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:41:13,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:13,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:13,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:13,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:13,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:13,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:13,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:13,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:13,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:13,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:13,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:13,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:13,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:13,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:13,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:13,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:14,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:14,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:14,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:14,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:14,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:14,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:14,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:14,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:14,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:14,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:14,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:14,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:14,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:14,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:14,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:14,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:14,792 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:41:16,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:16,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:16,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:16,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:16,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:16,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:16,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:16,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:16,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:16,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:16,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:16,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:16,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:16,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:16,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:16,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:16,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:16,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:16,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:16,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:16,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:16,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:16,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:16,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:16,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:16,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:16,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:16,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:16,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:16,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:16,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:16,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:17,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:17,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:17,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:17,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:17,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:17,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:17,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:17,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:17,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:17,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:17,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:17,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:17,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:17,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:17,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:17,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:18,794 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:41:22,795 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:41:24,796 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:41:26,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:41:26,077 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:41:26,797 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:41:30,799 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:41:31,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:31,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:31,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:31,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:31,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:31,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:31,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:31,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:31,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:31,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:31,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:31,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:31,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:31,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:31,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:31,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:41:32,799 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:41:34,800 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:41:38,721 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:41:38,802 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:41:40,802 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:41:41,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:41:41,301 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:41:42,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:41:44,804 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:41:46,805 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:41:48,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:41:50,807 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:41:52,808 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:41:54,808 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:41:56,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:41:56,526 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:41:56,809 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:41:58,810 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:42:00,811 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:42:01,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:01,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:01,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:01,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:01,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:01,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:01,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:01,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:01,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:01,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:01,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:01,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:01,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:01,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:01,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:01,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:02,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:42:04,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:42:06,813 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:42:06,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:06,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:06,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:06,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:06,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:06,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:06,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:06,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:06,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:06,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:06,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:06,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:06,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:06,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:06,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:06,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:08,789 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:42:08,814 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:42:10,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:42:11,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:42:11,859 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:42:12,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:42:14,816 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:42:16,817 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:42:18,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:42:19,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:19,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:19,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:19,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:19,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:19,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:19,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:19,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:19,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:19,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:19,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:19,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:19,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:19,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:19,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:19,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:20,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:42:22,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:22,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:42:24,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:24,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:24,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:24,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:24,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:24,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:24,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:24,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:24,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:24,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:24,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:24,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:24,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:24,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:24,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:24,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:24,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:24,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:24,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:24,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:24,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:24,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:24,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:24,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:24,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:24,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:24,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:24,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:24,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:24,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:24,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:24,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:24,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:42:26,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:42:26,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:26,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:27,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:27,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:27,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:27,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:27,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:27,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:27,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:27,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:27,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:42:27,089 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:42:27,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:27,397 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 17:42:27,475 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 17:42:27,532 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 17:42:27,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 17:42:28,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:42:29,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:42:29,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:29,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:29,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:29,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:29,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:29,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:30,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:30,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:30,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:30,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:30,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:30,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:30,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:30,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:30,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:30,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:36,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:42:37,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:37,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:37,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:37,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:37,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:37,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:37,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:37,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:37,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:37,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:37,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:37,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:37,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:37,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:37,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:37,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:37,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:37,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:37,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:37,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:37,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:37,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:37,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:37,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:37,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:37,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:37,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:37,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:37,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:37,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:37,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:37,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:38,902 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:42:39,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:39,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:39,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:39,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:39,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:39,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:39,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:39,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:39,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:39,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:39,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:39,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:39,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:39,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:39,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:39,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:40,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:40,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:40,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:40,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:40,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:40,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:40,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:40,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:40,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:40,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:40,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:40,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:40,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:40,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:40,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:40,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:42,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:42:42,583 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:42:42,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:42:43,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:43,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:43,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:43,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:43,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:43,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:43,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:43,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:44,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:44,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:44,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:44,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:44,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:44,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:44,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:44,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:46,829 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:42:46,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:46,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:46,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:46,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:46,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:46,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:46,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:46,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:46,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:46,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:46,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:46,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:46,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:46,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:46,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:46,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:48,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:48,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:48,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:48,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:48,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:48,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:48,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:48,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:48,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:48,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:48,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:48,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:48,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:48,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:48,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:48,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:48,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:48,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:48,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:48,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:48,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:48,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:48,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:48,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:48,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:48,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:48,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:48,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:48,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:48,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:48,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:48,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:50,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:42:52,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:52,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:52,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:52,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:52,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:52,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:52,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:52,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:52,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:52,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:52,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:52,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:52,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:52,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:52,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:52,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:52,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:52,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:52,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:52,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:52,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:52,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:52,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:52,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:52,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:52,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:52,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:52,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:52,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:52,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:52,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:52,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:54,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:54,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:54,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:54,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:54,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:54,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:54,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:54,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:54,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:54,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:54,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:54,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:54,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:54,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:54,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:54,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:54,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:42:57,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:42:57,857 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:42:58,834 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:42:59,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:59,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:59,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:59,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:59,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:59,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:59,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:59,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:59,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:59,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:59,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:59,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:59,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:59,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:59,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:59,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:59,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:59,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:59,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:59,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:59,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:59,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:59,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:59,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:59,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:59,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:59,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:59,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:59,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:59,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:59,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:42:59,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:00,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:43:01,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:01,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:01,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:01,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:01,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:01,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:01,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:01,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:01,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:01,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:01,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:01,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:01,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:01,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:01,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:01,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:03,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:03,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:03,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:03,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:03,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:03,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:03,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:03,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:03,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:03,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:03,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:03,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:03,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:03,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:03,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:03,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:04,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:04,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:04,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:04,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:04,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:04,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:04,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:04,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:04,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:04,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:04,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:04,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:04,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:04,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:04,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:04,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:04,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:43:06,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:06,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:06,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:06,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:06,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:06,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:06,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:06,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:06,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:06,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:06,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:06,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:06,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:06,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:06,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:06,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:08,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:43:08,975 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:43:10,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:10,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:10,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:10,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:10,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:10,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:10,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:10,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:10,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:10,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:10,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:10,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:10,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:10,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:10,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:10,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:12,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:43:13,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:43:13,085 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:43:13,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:13,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:43:14,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:14,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:15,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:15,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:15,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:15,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:15,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:15,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:15,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:15,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:15,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:15,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:15,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:15,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:15,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:15,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:15,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:15,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:16,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:16,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:16,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:16,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:16,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:16,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:16,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:16,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:16,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:16,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:16,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:16,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:16,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:16,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:16,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:16,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:16,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:16,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:16,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:16,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:16,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:16,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:16,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:16,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:16,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:16,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:16,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:16,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:16,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:16,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:16,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:16,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:18,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:43:19,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:19,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:20,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:43:25,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:43:27,846 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:43:28,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:43:28,491 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:43:29,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:43:33,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:43:35,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:35,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:35,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:35,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:35,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:35,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:35,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:35,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:35,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:35,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:35,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:35,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:35,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:35,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:35,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:35,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:43:35,849 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:43:37,850 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:43:39,043 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:43:39,850 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:43:43,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:43:43,767 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:43:43,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:43:45,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:43:47,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:43:49,854 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:43:51,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:43:53,856 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:43:55,856 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:43:57,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:43:59,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:43:59,027 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:43:59,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:44:01,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:44:03,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:03,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:03,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:03,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:03,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:03,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:03,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:03,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:03,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:03,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:03,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:03,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:03,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:03,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:03,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:03,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:03,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:44:05,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:44:07,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:44:09,113 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:44:09,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:44:11,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:44:11,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:11,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:11,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:11,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:11,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:12,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:12,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:12,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:12,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:12,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:12,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:12,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:12,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:12,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:12,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:12,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:13,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:44:14,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:44:14,252 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:44:15,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:44:17,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:44:19,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:44:21,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:44:23,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:44:24,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:24,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:25,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:25,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:25,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:25,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:25,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:25,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:25,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:25,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:25,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:25,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:25,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:25,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:25,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:25,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:25,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:25,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:25,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:44:26,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:26,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:27,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:27,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:27,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:27,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:27,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:27,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:27,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:27,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:27,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:44:29,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:44:29,512 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:44:30,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:30,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:30,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:30,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:30,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:30,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:30,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:30,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:30,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:30,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:30,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:30,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:30,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:30,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:30,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:30,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:37,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:44:39,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:39,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:39,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:39,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:39,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:39,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:39,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:39,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:39,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:39,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:39,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:39,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:39,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:39,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:39,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:39,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:39,182 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:44:43,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:44:44,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:44:44,806 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:44:45,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:45,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:45,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:45,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:45,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:45,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:45,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:45,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:45,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:45,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:45,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:45,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:45,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:45,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:45,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:45,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:46,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:46,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:46,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:46,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:46,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:46,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:46,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:46,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:46,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:46,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:46,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:46,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:46,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:46,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:46,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:46,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:47,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:47,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:47,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:47,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:47,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:47,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:47,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:47,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:47,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:47,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:47,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:47,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:47,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:47,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:47,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:47,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:47,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:47,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:47,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:47,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:47,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:47,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:47,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:47,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:47,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:47,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:47,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:47,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:47,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:47,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:47,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:47,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:47,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:44:49,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:49,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:49,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:49,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:49,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:49,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:49,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:49,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:49,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:49,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:49,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:49,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:49,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:49,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:49,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:49,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:51,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:44:53,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:53,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:53,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:53,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:53,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:53,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:53,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:53,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:53,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:53,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:53,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:53,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:53,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:53,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:53,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:53,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:54,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:54,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:54,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:54,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:54,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:54,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:54,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:54,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:54,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:54,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:54,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:54,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:54,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:54,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:54,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:54,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:55,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:55,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:55,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:55,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:55,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:55,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:55,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:55,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:55,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:55,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:55,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:55,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:55,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:55,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:55,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:55,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:55,882 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:44:59,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:44:59,883 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:45:00,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:45:00,090 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:45:01,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:01,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:01,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:01,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:01,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:01,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:01,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:01,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:01,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:01,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:01,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:01,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:01,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:01,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:01,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:01,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:04,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:04,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:04,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:04,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:04,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:04,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:04,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:04,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:04,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:04,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:04,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:04,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:04,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:04,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:04,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:04,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:04,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:04,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:04,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:04,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:04,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:04,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:04,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:04,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:04,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:04,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:04,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:04,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:04,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:04,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:04,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:04,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:04,885 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:45:06,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:45:09,253 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:45:10,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:45:11,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:11,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:11,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:11,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:11,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:11,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:11,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:11,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:11,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:11,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:11,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:11,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:11,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:11,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:11,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:11,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:11,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:11,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:11,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:11,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:11,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:11,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:11,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:11,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:11,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:11,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:11,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:11,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:11,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:11,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:11,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:11,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:12,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:12,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:12,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:12,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:12,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:12,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:12,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:12,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:12,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:12,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:12,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:12,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:12,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:12,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:12,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:12,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:12,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:45:13,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:13,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:13,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:13,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:13,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:13,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:13,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:13,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:13,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:13,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:13,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:13,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:13,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:13,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:13,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:13,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:14,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:15,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:45:15,433 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:45:16,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:45:19,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:19,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:19,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:19,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:19,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:19,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:19,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:19,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:19,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:19,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:19,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:19,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:19,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:19,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:19,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:19,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:45:20,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:20,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:21,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:21,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:21,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:21,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:21,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:21,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:21,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:21,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:21,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:21,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:21,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:21,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:21,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:21,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:21,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:21,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:22,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:22,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:22,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:22,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:22,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:22,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:22,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:22,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:22,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:22,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:22,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:22,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:22,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:22,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:22,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:22,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:22,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:22,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:22,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:22,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:22,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:22,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:22,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:22,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:22,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:22,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:22,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:22,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:22,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:22,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:22,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:22,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:22,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:45:23,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:23,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:23,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:23,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:23,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:23,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:23,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:23,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:23,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:23,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:23,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:23,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:23,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:23,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:23,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:23,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:23,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:23,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:23,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:23,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:23,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:23,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:23,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:23,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:23,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:23,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:23,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:23,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:23,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:23,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:23,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:23,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:24,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:45:24,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:24,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:24,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:24,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:24,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:24,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:24,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:24,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:24,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:24,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:24,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:24,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:25,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:25,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:25,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:25,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:25,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:25,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:25,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:25,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:25,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:25,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:25,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:25,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:25,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:25,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:25,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:25,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:25,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:25,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:25,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:25,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:26,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:26,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:26,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:26,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:26,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:26,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:26,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:26,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:26,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:26,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:26,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:26,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:26,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:26,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:26,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:26,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:26,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:26,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:26,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:26,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:26,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:26,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:26,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:26,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:26,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:26,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:26,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:26,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:26,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:26,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:26,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:26,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:28,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:45:30,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:45:30,807 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:45:30,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:45:34,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:45:36,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:45:38,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:45:39,327 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:45:40,900 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:45:44,902 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:45:46,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:45:46,035 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:45:46,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:46,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:46,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:46,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:46,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:46,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:46,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:46,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:46,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:46,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:46,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:46,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:46,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:46,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:46,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:46,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:45:46,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:45:48,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:45:50,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:45:52,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:45:54,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:45:56,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:45:58,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:46:00,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:46:01,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:46:01,265 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:46:02,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:46:04,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:46:06,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:06,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:06,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:06,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:06,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:06,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:06,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:06,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:06,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:06,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:06,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:06,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:06,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:06,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:06,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:06,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:06,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:46:08,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:46:09,399 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:46:10,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:46:12,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:46:14,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:14,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:14,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:14,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:14,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:14,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:14,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:14,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:14,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:14,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:14,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:14,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:14,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:14,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:14,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:14,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:14,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:46:16,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:46:16,492 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:46:16,916 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:46:18,916 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:46:20,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:46:22,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:46:24,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:46:26,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:26,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:26,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:26,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:26,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:26,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:26,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:26,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:26,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:26,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:26,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:26,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:26,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:26,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:26,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:26,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:26,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:46:26,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:26,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:26,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:26,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:26,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:26,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:26,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:26,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:26,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:26,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:26,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:26,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:26,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:26,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:26,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:26,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:26,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:26,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:26,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:26,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:27,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:27,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:27,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:27,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:27,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:27,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:27,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:27,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:27,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:27,356 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 17:46:27,579 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 17:46:27,656 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 17:46:27,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 17:46:28,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:46:30,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:30,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:30,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:30,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:30,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:30,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:30,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:30,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:30,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:30,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:30,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:30,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:30,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:30,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:30,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:30,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:31,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:31,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:31,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:31,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:31,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:31,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:31,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:31,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:31,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:31,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:31,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:31,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:31,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:31,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:31,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:31,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:31,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:46:31,760 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:46:34,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:34,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:34,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:34,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:34,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:34,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:34,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:34,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:34,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:34,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:34,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:34,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:34,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:34,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:34,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:34,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:38,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:38,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:38,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:38,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:38,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:38,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:38,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:38,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:38,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:38,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:38,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:38,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:38,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:38,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:38,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:38,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:38,925 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:46:39,687 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:46:40,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:40,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:40,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:40,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:40,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:40,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:40,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:40,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:40,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:40,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:40,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:40,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:40,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:40,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:40,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:40,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:41,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:41,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:41,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:41,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:41,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:41,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:41,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:41,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:41,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:41,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:41,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:41,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:41,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:41,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:41,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:41,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:42,927 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:46:46,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:46:47,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:46:47,013 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:46:51,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:51,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:51,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:51,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:51,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:51,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:51,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:51,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:51,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:51,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:51,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:51,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:51,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:51,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:51,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:51,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:52,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:52,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:52,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:52,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:52,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:52,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:52,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:52,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:52,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:52,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:52,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:52,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:52,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:52,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:52,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:52,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:53,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:46:54,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:54,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:54,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:54,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:54,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:54,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:54,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:54,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:54,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:54,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:54,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:54,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:54,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:54,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:54,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:54,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:57,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:46:58,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:58,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:58,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:58,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:58,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:58,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:58,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:58,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:58,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:58,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:58,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:58,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:58,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:58,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:58,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:58,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:46:59,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:47:01,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:01,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:01,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:01,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:01,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:01,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:01,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:01,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:01,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:01,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:01,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:01,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:01,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:01,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:01,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:01,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:02,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:47:02,392 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:47:03,937 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:47:04,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:04,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:04,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:04,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:04,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:04,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:04,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:04,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:04,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:04,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:04,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:04,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:04,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:04,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:04,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:04,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:06,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:07,938 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:47:08,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:08,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:08,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:08,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:08,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:08,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:08,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:08,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:08,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:08,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:08,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:08,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:08,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:08,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:08,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:08,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:08,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:08,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:08,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:08,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:08,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:08,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:08,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:08,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:08,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:08,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:08,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:08,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:08,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:08,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:08,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:08,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:09,781 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:47:11,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:11,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:11,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:11,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:11,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:11,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:11,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:11,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:11,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:11,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:11,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:11,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:11,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:11,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:11,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:11,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:11,940 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:47:13,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:13,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:13,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:13,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:13,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:13,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:13,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:13,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:13,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:13,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:13,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:13,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:13,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:13,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:13,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:13,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:13,941 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:47:14,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:14,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:14,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:14,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:14,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:14,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:14,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:14,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:14,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:14,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:14,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:14,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:14,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:14,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:14,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:14,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:17,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:17,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:17,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:17,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:17,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:17,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:17,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:17,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:17,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:17,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:17,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:17,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:17,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:17,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:17,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:17,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:17,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:17,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:17,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:17,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:17,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:17,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:17,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:17,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:17,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:17,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:17,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:17,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:17,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:17,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:17,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:17,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:17,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:47:17,688 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:47:17,943 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:47:19,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:19,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:19,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:19,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:19,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:19,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:19,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:19,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:19,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:19,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:19,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:19,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:19,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:19,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:19,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:19,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:19,944 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:47:21,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:21,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:21,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:21,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:21,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:21,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:21,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:21,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:21,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:21,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:21,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:21,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:21,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:21,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:21,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:21,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:21,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:21,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:21,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:21,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:21,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:21,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:21,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:21,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:21,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:21,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:21,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:21,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:21,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:21,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:21,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:21,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:22,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:22,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:22,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:22,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:22,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:22,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:22,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:22,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:22,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:22,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:22,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:22,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:22,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:22,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:22,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:22,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:23,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:23,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:23,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:23,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:23,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:23,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:23,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:23,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:23,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:23,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:23,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:23,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:23,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:23,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:23,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:23,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:23,945 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:47:25,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:25,946 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:47:26,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:26,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:26,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:26,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:26,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:26,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:26,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:26,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:26,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:26,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:26,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:26,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:26,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:26,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:26,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:26,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:28,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:28,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:28,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:28,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:28,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:28,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:28,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:28,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:28,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:28,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:28,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:28,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:28,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:28,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:28,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:28,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:28,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:28,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:28,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:28,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:28,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:28,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:28,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:28,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:28,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:28,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:28,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:28,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:28,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:28,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:28,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:28,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:29,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:29,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:29,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:29,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:29,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:29,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:29,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:29,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:29,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:29,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:29,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:29,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:29,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:29,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:29,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:29,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:29,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:29,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:29,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:29,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:29,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:29,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:29,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:29,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:29,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:29,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:29,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:29,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:29,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:29,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:29,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:29,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:29,948 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:47:31,949 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:47:32,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:32,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:32,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:32,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:32,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:32,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:32,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:32,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:32,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:32,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:32,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:32,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:32,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:32,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:32,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:32,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:32,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:32,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:32,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:32,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:32,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:32,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:32,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:32,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:32,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:32,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:32,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:32,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:32,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:32,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:32,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:32,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:33,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:47:33,012 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:47:33,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:33,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:33,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:33,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:33,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:33,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:33,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:33,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:33,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:33,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:33,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:33,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:33,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:33,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:33,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:33,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:34,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:34,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:34,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:34,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:34,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:34,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:34,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:34,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:34,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:34,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:34,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:34,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:34,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:34,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:34,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:34,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:35,957 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:47:36,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:36,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:36,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:36,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:36,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:36,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:36,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:36,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:36,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:36,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:36,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:36,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:36,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:36,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:36,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:36,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:37,958 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:47:39,854 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:47:39,959 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:47:41,960 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:47:45,961 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:47:47,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:47,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:47,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:47,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:47,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:47,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:47,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:47,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:47,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:47,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:47,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:47,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:47,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:47,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:47,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:47,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:47:47,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:47:48,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:47:48,269 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:47:49,963 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:47:51,964 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:47:53,965 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:47:55,966 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:47:57,967 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:47:59,968 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:48:01,968 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:48:03,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:48:03,494 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:48:03,969 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:48:05,970 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:48:07,971 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:48:09,927 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:48:09,971 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:48:11,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:11,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:11,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:11,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:11,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:11,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:11,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:11,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:11,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:11,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:11,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:11,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:11,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:11,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:11,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:11,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:11,972 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:48:13,973 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:48:15,974 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:48:17,975 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:48:18,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:18,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:18,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:18,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:18,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:18,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:18,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:18,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:18,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:18,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:18,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:18,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:18,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:18,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:18,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:18,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:18,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:48:18,730 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:48:19,976 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:48:21,976 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:48:23,977 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:48:25,978 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:48:27,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:27,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:27,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:27,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:27,979 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:48:28,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:28,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:28,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:28,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:28,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:28,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:28,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:28,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:29,980 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:48:34,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:48:34,246 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:48:37,982 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:48:39,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:39,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:39,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:39,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:39,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:39,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:39,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:39,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:39,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:39,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:39,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:39,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:39,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:39,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:39,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:39,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:40,001 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:48:41,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:41,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:41,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:41,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:41,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:41,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:41,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:41,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:41,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:41,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:41,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:41,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:41,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:41,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:41,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:41,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:43,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:43,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:43,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:43,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:43,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:43,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:43,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:43,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:43,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:43,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:43,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:43,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:43,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:43,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:43,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:43,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:43,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:43,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:43,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:43,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:43,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:43,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:43,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:43,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:43,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:43,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:43,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:43,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:43,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:43,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:43,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:43,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:43,984 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:48:44,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:44,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:44,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:44,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:44,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:44,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:44,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:44,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:44,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:44,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:44,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:44,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:44,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:44,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:44,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:44,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:46,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:46,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:46,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:46,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:46,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:46,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:46,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:46,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:46,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:46,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:46,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:46,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:46,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:46,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:46,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:46,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:47,986 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:48:49,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:48:49,615 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:48:51,987 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:48:52,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:52,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:52,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:52,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:52,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:52,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:52,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:52,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:52,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:52,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:52,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:52,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:52,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:52,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:52,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:52,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:55,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:48:59,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:59,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:59,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:59,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:59,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:59,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:59,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:59,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:59,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:59,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:59,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:59,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:59,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:59,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:59,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:59,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:48:59,990 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:49:00,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:00,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:00,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:00,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:00,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:00,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:00,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:00,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:00,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:00,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:00,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:00,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:00,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:00,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:00,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:00,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:01,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:03,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:03,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:03,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:03,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:03,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:03,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:03,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:03,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:03,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:03,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:03,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:03,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:03,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:03,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:03,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:03,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:03,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:03,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:03,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:03,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:03,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:03,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:03,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:03,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:03,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:03,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:03,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:03,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:03,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:03,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:03,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:03,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:03,991 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:49:04,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:49:04,948 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:49:05,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:05,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:05,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:05,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:05,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:05,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:05,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:05,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:05,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:05,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:05,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:05,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:05,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:05,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:05,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:05,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:07,993 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:49:09,994 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:49:10,075 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:49:10,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:10,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:13,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:13,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:13,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:13,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:13,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:13,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:13,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:13,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:13,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:13,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:13,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:13,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:13,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:13,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:13,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:13,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:13,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:13,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:13,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:13,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:13,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:13,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:13,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:13,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:13,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:13,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:13,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:13,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:13,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:13,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:13,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:13,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:14,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:49:16,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:16,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:16,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:16,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:16,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:16,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:16,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:16,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:16,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:16,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:16,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:16,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:16,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:16,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:16,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:16,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:16,997 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:49:17,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:17,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:17,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:17,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:17,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:17,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:17,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:17,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:17,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:17,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:17,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:17,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:17,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:17,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:17,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:17,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:17,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:17,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:17,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:17,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:17,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:17,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:17,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:17,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:17,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:17,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:17,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:17,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:17,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:17,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:17,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:17,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:19,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:19,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:19,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:19,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:19,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:19,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:19,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:19,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:19,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:19,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:19,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:19,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:19,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:19,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:19,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:19,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:20,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:49:20,192 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:49:20,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:20,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:20,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:20,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:20,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:20,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:20,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:20,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:20,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:20,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:20,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:20,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:20,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:20,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:20,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:20,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:20,998 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:49:22,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:49:23,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:23,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:27,001 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:49:27,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:27,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:27,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:27,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:27,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:27,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:27,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:27,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:27,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:27,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:27,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:27,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:27,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:27,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:27,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:27,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:27,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:27,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:27,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:27,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:27,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:27,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:27,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:27,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:27,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:27,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:27,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:27,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:27,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:27,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:27,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:27,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:28,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:28,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:28,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:28,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:28,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:28,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:28,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:28,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:28,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:28,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:28,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:28,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:28,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:28,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:28,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:28,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:29,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:49:30,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:30,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:30,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:30,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:30,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:30,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:30,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:30,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:30,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:30,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:30,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:30,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:30,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:30,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:30,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:30,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:30,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:30,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:30,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:30,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:30,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:30,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:30,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:30,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:30,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:30,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:30,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:30,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:30,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:30,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:30,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:30,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:31,003 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:49:32,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:32,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:32,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:32,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:32,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:32,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:32,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:32,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:32,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:32,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:32,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:32,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:32,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:32,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:32,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:32,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:33,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:33,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:33,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:33,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:33,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:33,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:33,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:33,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:33,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:33,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:33,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:33,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:33,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:33,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:33,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:33,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:34,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:35,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:49:35,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:49:35,417 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:49:35,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:35,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:35,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:35,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:35,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:35,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:35,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:35,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:35,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:35,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:35,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:35,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:35,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:35,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:35,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:35,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:35,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:35,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:35,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:35,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:35,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:35,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:35,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:35,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:35,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:35,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:35,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:35,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:35,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:35,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:35,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:35,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:37,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:49:38,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:38,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:38,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:38,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:38,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:38,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:38,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:38,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:38,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:38,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:38,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:38,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:38,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:38,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:38,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:38,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:39,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:49:39,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:39,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:39,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:39,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:39,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:39,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:39,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:39,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:39,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:39,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:39,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:39,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:39,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:39,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:39,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:39,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:40,148 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:49:40,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:40,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:40,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:40,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:40,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:40,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:40,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:40,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:40,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:40,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:40,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:40,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:40,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:40,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:40,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:40,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:41,007 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:49:42,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:42,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:42,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:42,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:42,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:42,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:42,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:42,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:42,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:42,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:42,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:42,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:42,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:42,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:42,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:42,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:43,008 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:49:47,009 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:49:49,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:49:50,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:49:50,643 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:49:51,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:49:51,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:51,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:51,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:51,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:51,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:51,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:51,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:51,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:51,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:51,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:51,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:51,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:51,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:51,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:51,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:51,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:49:53,012 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:49:55,013 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:49:57,014 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:49:59,015 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:50:01,015 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:50:03,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:50:05,017 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:50:05,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:50:05,956 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:50:07,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:50:09,019 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:50:10,218 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:50:11,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:50:13,021 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:50:13,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:13,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:13,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:13,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:13,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:13,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:13,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:13,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:13,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:13,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:13,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:13,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:13,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:13,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:13,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:13,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:15,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:50:17,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:50:18,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:18,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:18,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:18,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:18,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:18,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:18,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:18,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:18,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:18,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:18,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:18,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:18,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:18,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:18,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:18,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:19,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:50:21,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:50:21,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:50:21,229 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:50:23,025 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:50:25,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:50:25,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:25,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:25,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:25,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:25,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:25,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:25,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:25,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:25,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:25,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:25,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:25,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:25,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:25,658 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 17:50:25,836 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 17:50:25,911 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 17:50:26,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 17:50:26,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:50:27,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:50:35,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:50:36,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:50:36,697 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:50:39,032 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:50:40,345 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:50:46,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:50:48,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:48,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:48,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:48,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:48,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:48,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:48,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:48,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:48,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:48,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:48,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:48,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:48,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:48,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:48,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:48,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:48,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:48,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:48,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:48,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:48,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:48,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:48,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:48,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:48,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:48,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:48,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:48,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:48,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:48,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:48,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:48,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:50,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:50:50,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:50,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:50,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:50,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:50,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:50,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:50,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:50,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:50,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:50,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:50,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:50,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:50,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:50,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:50,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:50,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:51,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:51,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:51,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:51,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:51,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:51,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:51,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:51,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:51,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:51,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:51,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:51,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:51,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:51,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:51,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:51,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:51,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:50:51,924 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:50:52,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:50:55,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:55,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:55,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:55,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:55,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:55,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:55,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:55,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:55,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:55,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:55,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:55,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:55,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:55,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:55,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:55,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:56,039 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:50:58,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:58,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:58,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:58,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:58,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:58,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:58,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:58,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:58,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:58,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:58,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:58,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:58,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:58,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:58,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:58,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:58,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:58,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:58,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:58,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:58,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:58,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:58,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:58,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:58,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:58,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:58,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:58,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:58,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:58,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:58,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:50:58,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:00,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:51:00,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:00,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:00,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:00,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:00,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:00,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:00,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:00,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:00,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:00,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:00,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:00,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:00,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:00,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:00,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:00,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:02,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:02,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:02,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:02,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:02,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:02,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:02,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:02,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:02,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:02,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:02,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:02,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:02,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:02,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:02,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:02,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:02,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:02,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:02,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:02,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:02,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:02,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:02,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:02,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:02,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:02,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:02,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:02,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:02,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:02,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:02,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:02,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:04,042 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:51:05,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:05,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:05,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:05,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:05,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:05,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:05,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:05,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:05,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:05,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:05,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:05,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:05,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:05,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:05,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:05,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:05,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:05,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:05,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:05,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:05,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:05,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:05,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:05,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:05,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:05,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:05,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:05,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:05,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:05,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:05,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:05,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:06,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:51:06,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:06,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:06,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:06,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:06,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:06,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:06,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:06,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:06,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:06,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:06,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:06,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:06,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:06,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:06,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:06,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:07,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:07,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:07,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:07,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:07,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:07,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:07,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:07,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:07,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:07,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:07,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:07,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:07,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:07,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:07,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:07,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:07,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:51:07,148 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:51:08,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:08,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:08,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:08,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:08,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:08,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:08,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:08,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:08,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:08,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:08,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:08,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:08,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:08,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:08,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:08,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:08,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:08,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:08,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:08,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:08,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:08,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:08,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:08,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:08,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:08,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:08,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:08,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:08,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:08,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:08,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:08,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:10,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:51:10,418 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:51:10,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:10,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:10,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:10,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:10,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:10,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:10,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:10,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:10,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:10,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:10,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:10,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:10,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:10,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:10,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:10,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:12,047 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:51:13,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:13,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:13,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:13,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:13,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:13,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:13,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:13,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:13,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:13,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:13,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:13,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:13,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:13,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:13,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:13,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:14,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:14,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:14,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:14,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:14,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:14,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:14,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:14,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:14,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:14,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:14,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:14,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:14,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:14,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:14,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:14,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:16,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:51:18,049 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:51:18,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:18,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:18,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:18,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:18,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:18,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:18,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:18,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:18,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:18,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:18,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:18,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:18,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:18,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:18,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:18,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:20,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:21,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:21,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:21,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:21,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:21,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:21,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:21,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:21,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:21,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:21,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:21,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:21,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:21,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:21,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:21,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:21,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:21,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:21,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:21,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:21,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:21,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:21,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:21,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:21,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:21,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:21,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:21,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:21,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:21,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:21,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:21,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:21,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:22,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:51:22,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:51:22,490 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:51:23,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:23,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:23,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:23,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:23,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:23,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:23,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:23,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:23,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:23,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:23,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:23,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:23,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:23,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:23,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:23,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:24,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:51:25,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:25,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:25,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:25,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:25,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:25,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:25,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:25,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:25,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:25,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:25,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:25,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:25,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:25,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:25,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:25,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:26,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:51:27,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:27,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:27,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:27,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:27,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:27,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:27,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:27,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:27,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:27,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:27,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:27,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:27,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:27,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:27,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:27,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:29,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:29,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:29,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:29,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:29,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:29,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:29,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:29,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:29,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:29,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:29,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:29,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:29,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:29,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:29,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:29,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:30,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:51:31,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:31,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:31,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:31,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:31,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:31,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:31,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:31,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:31,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:31,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:31,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:31,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:31,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:31,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:31,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:31,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:31,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:31,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:31,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:31,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:31,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:31,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:31,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:31,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:31,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:31,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:31,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:31,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:31,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:31,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:31,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:31,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:51:32,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:32,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:33,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:34,056 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:51:34,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:34,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:34,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:34,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:34,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:34,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:34,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:34,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:34,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:34,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:34,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:34,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:34,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:34,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:34,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:34,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:36,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:51:37,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:37,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:37,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:37,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:37,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:37,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:37,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:37,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:37,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:37,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:37,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:37,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:37,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:37,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:37,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:37,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:37,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:51:37,868 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:51:38,059 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:51:39,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:39,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:39,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:39,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:39,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:39,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:39,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:39,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:39,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:39,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:39,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:39,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:39,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:39,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:39,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:39,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:40,490 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:51:40,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:40,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:40,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:40,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:40,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:40,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:40,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:40,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:40,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:40,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:40,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:40,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:40,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:40,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:40,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:40,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:41,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:42,061 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:51:44,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:51:46,063 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:51:48,063 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:51:50,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:51:51,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:51,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:51,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:51,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:51,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:51,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:51,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:51,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:51,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:51,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:51,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:51,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:51,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:51,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:51,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:51,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:51:52,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:51:53,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:51:53,092 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:51:54,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:51:56,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:51:58,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:52:00,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:52:02,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:52:04,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:52:06,071 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:52:08,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:52:08,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:52:08,364 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:52:10,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:52:10,562 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:52:12,074 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:52:12,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:12,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:12,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:12,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:12,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:12,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:12,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:12,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:12,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:12,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:12,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:12,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:12,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:12,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:12,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:12,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:14,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:52:15,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:15,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:15,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:15,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:15,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:15,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:15,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:15,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:15,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:15,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:15,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:15,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:15,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:15,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:15,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:15,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:16,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:52:18,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:52:20,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:52:22,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:52:22,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:22,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:22,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:22,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:22,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:22,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:22,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:22,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:22,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:22,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:22,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:22,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:23,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:52:23,740 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:52:24,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:52:34,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:52:39,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:52:39,027 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:52:40,637 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:52:41,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:52:45,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:52:49,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:52:53,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:52:54,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:52:54,426 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:52:56,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:56,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:56,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:56,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:56,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:56,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:56,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:56,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:56,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:56,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:56,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:56,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:56,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:56,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:56,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:56,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:57,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:57,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:57,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:57,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:57,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:57,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:57,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:57,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:57,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:57,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:57,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:57,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:57,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:57,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:57,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:57,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:57,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:57,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:57,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:57,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:57,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:57,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:57,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:57,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:57,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:57,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:57,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:57,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:57,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:57,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:57,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:57,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:52:57,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:52:59,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:53:00,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:00,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:00,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:00,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:00,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:00,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:00,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:00,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:00,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:00,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:00,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:00,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:00,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:00,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:00,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:00,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:03,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:53:03,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:03,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:03,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:03,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:03,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:03,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:03,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:03,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:03,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:03,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:03,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:03,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:03,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:03,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:03,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:03,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:03,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:03,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:03,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:03,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:03,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:03,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:03,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:03,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:03,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:03,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:03,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:03,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:03,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:03,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:03,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:03,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:05,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:05,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:05,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:05,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:05,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:05,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:05,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:05,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:05,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:05,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:05,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:05,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:05,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:05,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:05,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:05,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:06,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:06,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:06,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:06,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:06,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:06,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:06,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:06,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:06,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:06,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:06,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:06,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:06,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:06,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:06,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:06,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:06,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:06,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:06,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:06,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:06,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:06,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:06,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:06,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:06,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:06,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:07,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:07,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:07,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:07,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:07,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:07,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:07,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:53:08,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:08,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:09,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:53:09,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:53:09,653 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:53:09,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:09,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:09,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:09,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:09,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:09,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:09,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:09,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:09,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:09,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:09,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:09,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:09,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:09,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:09,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:09,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:10,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:10,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:10,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:10,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:10,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:10,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:10,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:10,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:10,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:10,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:10,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:10,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:10,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:10,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:10,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:10,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:10,713 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:53:12,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:12,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:13,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:53:15,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:53:17,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:17,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:17,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:17,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:17,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:17,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:17,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:17,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:17,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:17,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:17,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:17,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:17,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:17,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:17,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:17,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:19,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:53:21,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:53:22,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:22,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:22,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:22,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:22,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:22,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:22,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:22,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:22,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:22,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:22,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:22,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:22,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:22,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:22,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:22,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:22,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:22,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:22,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:22,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:22,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:22,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:22,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:22,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:22,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:22,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:22,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:22,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:22,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:22,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:22,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:22,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:23,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:53:24,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:24,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:24,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:24,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:24,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:24,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:24,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:24,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:24,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:24,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:24,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:24,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:24,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:24,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:24,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:24,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:24,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:53:24,895 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:53:25,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:25,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:25,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:25,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:25,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:25,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:25,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:25,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:25,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:25,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:25,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:25,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:25,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:25,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:25,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:25,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:26,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:26,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:26,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:26,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:26,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:26,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:26,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:26,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:26,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:26,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:26,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:26,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:26,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:26,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:26,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:26,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:27,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:53:29,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:53:29,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:29,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:31,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:53:33,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:33,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:34,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:34,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:34,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:34,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:34,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:34,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:34,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:34,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:34,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:34,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:34,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:34,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:34,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:34,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:34,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:34,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:34,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:34,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:34,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:34,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:34,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:34,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:34,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:34,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:34,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:34,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:34,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:34,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:34,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:34,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:34,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:34,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:35,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:53:35,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:35,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:35,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:35,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:35,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:35,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:35,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:35,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:35,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:35,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:35,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:35,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:35,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:35,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:35,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:35,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:35,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:35,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:35,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:35,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:35,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:35,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:35,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:35,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:35,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:35,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:35,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:35,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:35,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:35,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:35,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:35,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:36,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:36,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:36,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:36,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:36,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:36,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:36,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:36,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:36,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:36,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:36,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:36,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:36,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:36,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:36,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:36,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:37,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:53:38,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:38,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:39,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:53:40,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:53:40,122 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:53:40,790 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:53:41,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:41,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:41,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:41,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:41,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:41,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:41,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:41,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:41,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:41,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:41,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:41,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:41,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:41,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:41,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:41,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:41,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:53:43,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:53:43,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:43,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:43,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:43,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:43,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:43,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:43,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:43,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:43,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:43,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:43,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:43,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:43,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:43,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:43,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:43,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:44,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:44,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:44,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:44,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:44,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:44,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:44,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:44,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:44,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:44,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:44,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:44,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:44,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:44,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:44,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:44,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:45,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:53:45,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:45,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:45,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:45,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:45,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:45,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:45,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:45,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:45,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:45,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:45,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:45,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:45,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:45,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:45,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:45,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:46,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:46,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:46,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:46,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:46,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:46,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:46,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:46,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:46,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:46,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:46,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:46,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:46,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:46,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:46,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:46,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:46,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:46,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:46,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:46,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:46,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:46,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:46,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:46,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:46,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:46,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:46,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:46,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:46,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:46,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:46,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:46,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:47,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:53:49,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:53:49,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:49,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:49,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:49,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:49,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:49,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:49,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:49,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:49,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:49,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:49,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:49,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:49,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:49,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:49,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:49,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:51,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:53:53,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:53:55,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:53:55,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:53:55,530 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:53:55,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:55,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:55,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:55,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:55,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:55,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:55,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:55,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:55,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:55,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:55,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:55,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:55,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:55,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:55,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:55,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:53:57,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:53:59,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:54:01,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:54:03,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:54:05,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:54:07,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:54:09,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:54:10,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:54:10,789 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:54:11,014 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:54:11,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:54:13,121 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:54:15,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:54:15,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:15,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:15,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:15,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:15,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:15,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:15,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:15,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:15,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:15,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:15,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:15,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:15,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:15,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:15,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:15,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:17,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:54:17,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:17,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:17,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:17,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:17,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:17,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:17,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:17,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:17,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:17,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:17,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:17,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:17,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:17,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:17,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:17,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:19,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:54:21,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:54:21,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:21,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:21,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:21,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:21,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:21,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:21,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:21,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:21,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:21,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:21,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:21,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:21,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:21,746 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 17:54:21,979 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 17:54:22,048 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 17:54:22,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 17:54:23,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:54:26,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:54:26,018 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:54:33,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:54:39,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:54:41,008 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:54:41,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:54:41,304 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:54:43,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:54:45,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:54:50,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:54:54,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:54:54,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:54,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:54,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:54,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:54,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:54,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:54,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:54,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:54,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:54,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:54,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:54,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:54,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:54,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:54,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:54,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:54:56,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:54:56,531 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:54:58,140 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:55:00,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:55:02,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:02,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:02,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:02,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:02,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:02,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:02,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:02,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:02,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:02,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:02,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:02,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:02,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:02,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:02,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:02,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:02,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:02,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:02,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:02,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:02,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:02,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:02,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:02,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:02,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:02,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:02,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:02,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:02,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:02,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:02,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:02,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:03,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:03,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:03,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:03,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:03,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:03,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:03,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:03,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:03,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:03,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:03,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:03,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:03,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:03,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:03,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:03,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:04,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:55:06,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:55:06,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:06,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:06,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:06,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:06,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:06,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:06,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:06,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:06,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:06,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:06,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:06,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:06,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:06,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:06,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:06,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:06,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:06,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:06,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:06,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:06,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:06,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:06,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:06,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:06,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:06,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:06,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:06,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:06,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:06,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:06,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:06,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:07,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:07,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:07,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:07,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:07,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:07,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:07,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:07,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:07,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:07,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:07,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:07,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:07,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:07,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:07,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:07,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:09,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:10,145 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:55:11,083 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:55:11,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:55:11,801 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:55:13,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:13,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:13,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:13,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:13,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:13,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:13,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:13,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:13,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:13,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:13,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:13,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:13,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:13,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:13,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:13,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:14,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:55:14,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:14,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:14,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:14,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:14,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:14,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:14,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:14,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:14,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:14,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:14,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:14,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:14,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:14,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:14,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:14,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:14,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:14,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:14,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:14,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:14,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:14,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:14,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:14,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:14,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:14,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:14,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:14,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:14,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:14,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:14,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:14,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:15,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:15,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:15,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:15,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:15,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:15,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:15,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:15,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:15,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:15,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:15,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:15,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:15,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:15,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:15,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:15,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:16,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:55:16,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:16,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:16,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:16,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:16,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:16,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:16,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:16,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:16,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:16,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:16,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:16,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:16,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:16,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:16,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:16,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:17,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:17,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:17,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:17,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:17,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:17,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:17,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:17,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:17,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:17,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:17,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:17,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:17,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:17,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:17,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:17,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:17,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:17,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:17,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:17,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:17,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:17,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:17,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:17,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:17,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:17,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:17,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:17,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:17,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:17,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:17,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:17,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:18,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:55:20,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:55:24,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:24,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:24,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:24,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:24,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:24,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:24,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:24,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:24,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:24,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:24,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:24,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:24,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:24,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:24,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:24,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:24,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:55:25,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:25,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:25,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:25,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:25,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:25,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:25,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:25,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:25,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:25,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:25,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:25,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:25,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:25,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:25,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:25,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:26,152 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:55:27,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:55:27,035 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:55:27,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:27,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:27,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:27,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:27,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:27,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:27,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:27,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:27,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:27,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:27,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:27,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:27,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:27,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:27,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:27,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:28,153 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:55:29,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:29,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:29,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:29,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:29,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:29,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:29,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:29,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:29,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:29,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:29,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:29,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:29,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:29,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:29,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:29,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:30,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:55:30,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:30,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:30,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:30,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:30,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:30,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:30,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:30,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:30,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:30,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:30,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:30,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:30,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:30,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:30,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:30,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:30,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:30,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:30,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:30,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:30,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:30,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:30,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:30,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:30,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:30,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:30,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:30,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:30,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:30,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:30,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:30,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:31,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:31,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:31,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:31,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:31,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:31,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:31,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:31,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:31,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:31,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:31,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:31,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:31,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:31,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:31,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:31,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:31,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:31,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:31,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:31,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:31,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:31,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:31,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:31,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:31,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:31,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:31,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:31,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:31,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:31,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:31,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:31,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:32,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:32,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:32,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:32,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:32,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:32,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:32,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:32,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:32,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:32,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:32,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:32,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:32,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:32,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:32,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:32,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:33,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:33,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:33,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:33,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:33,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:33,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:33,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:33,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:33,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:33,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:33,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:33,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:33,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:33,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:33,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:33,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:34,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:55:35,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:35,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:35,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:35,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:35,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:35,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:35,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:35,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:35,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:35,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:35,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:35,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:35,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:35,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:35,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:35,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:35,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:35,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:35,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:35,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:35,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:35,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:35,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:35,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:35,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:35,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:35,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:35,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:35,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:35,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:35,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:35,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:36,157 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:55:37,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:37,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:38,157 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:55:38,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:38,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:38,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:38,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:38,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:38,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:38,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:38,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:38,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:38,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:38,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:38,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:38,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:38,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:38,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:38,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:39,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:39,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:39,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:39,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:39,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:39,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:39,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:39,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:39,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:39,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:39,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:39,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:39,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:39,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:39,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:39,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:39,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:39,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:39,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:39,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:39,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:39,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:39,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:39,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:39,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:39,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:39,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:39,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:39,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:39,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:39,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:39,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:40,159 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:55:40,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:40,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:40,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:40,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:40,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:40,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:40,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:40,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:40,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:40,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:40,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:40,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:40,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:40,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:40,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:40,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:40,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:40,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:40,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:40,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:40,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:40,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:40,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:40,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:40,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:40,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:40,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:40,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:40,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:40,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:40,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:40,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:41,156 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:55:41,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:41,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:41,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:41,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:41,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:41,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:41,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:41,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:41,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:41,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:41,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:41,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:41,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:41,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:41,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:41,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:42,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:42,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:42,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:42,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:42,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:42,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:42,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:42,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:42,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:42,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:42,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:42,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:42,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:42,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:42,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:42,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:42,160 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:55:42,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:55:42,357 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:55:42,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:42,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:42,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:42,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:42,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:42,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:42,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:42,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:42,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:42,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:42,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:42,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:42,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:42,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:42,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:42,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:44,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:55:44,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:44,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:44,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:44,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:44,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:44,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:44,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:44,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:44,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:44,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:44,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:44,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:44,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:44,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:44,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:44,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:46,162 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:55:46,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:46,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:46,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:46,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:46,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:46,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:46,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:46,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:46,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:46,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:46,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:46,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:46,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:46,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:46,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:46,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:47,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:47,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:47,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:47,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:47,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:47,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:47,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:47,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:47,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:47,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:47,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:47,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:47,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:47,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:47,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:47,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:48,162 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:55:48,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:48,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:48,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:48,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:48,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:48,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:48,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:48,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:48,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:48,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:48,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:48,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:48,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:48,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:48,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:48,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:50,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:50,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:50,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:50,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:50,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:50,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:50,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:50,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:50,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:50,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:50,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:50,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:50,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:50,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:50,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:50,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:50,163 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:55:52,164 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:55:54,165 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:55:54,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:54,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:54,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:54,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:54,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:54,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:54,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:54,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:54,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:54,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:54,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:54,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:54,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:54,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:54,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:54,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:55:56,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:55:57,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:55:57,582 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:55:58,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:56:00,168 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:56:02,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:56:04,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:56:06,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:56:08,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:56:10,172 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:56:11,236 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:56:12,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:56:12,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:56:12,821 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:56:13,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:13,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:13,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:13,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:13,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:13,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:13,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:13,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:13,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:13,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:13,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:13,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:13,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:13,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:13,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:13,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:14,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:56:16,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:56:16,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:16,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:16,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:16,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:16,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:16,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:16,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:16,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:16,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:16,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:16,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:16,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:16,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:16,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:16,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:16,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:17,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:17,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:17,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:17,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:18,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:18,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:18,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:18,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:18,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:18,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:18,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:18,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:18,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:56:20,175 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:56:28,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:56:28,106 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:56:30,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:56:35,182 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:56:39,184 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:56:41,306 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:56:43,185 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:56:43,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:56:43,456 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:56:47,187 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:56:51,188 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:56:55,189 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:56:57,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:57,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:57,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:57,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:57,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:57,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:57,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:57,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:57,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:57,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:57,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:57,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:57,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:57,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:57,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:57,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:56:57,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:56:58,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:56:58,779 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:57:01,191 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:57:05,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:57:06,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:06,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:06,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:06,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:06,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:06,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:06,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:06,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:06,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:06,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:06,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:06,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:06,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:06,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:06,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:06,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:57:07,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:07,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:10,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:10,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:10,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:10,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:10,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:10,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:10,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:10,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:10,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:10,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:10,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:10,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:10,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:10,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:10,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:10,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:10,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:10,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:10,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:10,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:10,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:10,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:10,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:10,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:10,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:10,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:10,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:10,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:10,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:10,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:10,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:10,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:11,194 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:57:11,381 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:57:13,195 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:57:13,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:13,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:13,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:13,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:13,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:13,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:13,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:13,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:13,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:13,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:13,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:13,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:13,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:13,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:13,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:13,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:13,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:13,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:13,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:13,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:13,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:13,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:13,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:13,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:13,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:13,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:13,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:13,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:13,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:13,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:13,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:13,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:14,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:57:14,055 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:57:14,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:14,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:14,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:14,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:14,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:14,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:14,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:14,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:14,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:14,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:14,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:14,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:14,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:14,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:14,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:14,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:15,196 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:57:15,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:15,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:15,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:15,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:15,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:15,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:15,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:15,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:15,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:15,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:15,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:15,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:15,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:15,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:15,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:15,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:17,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:17,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:17,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:17,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:17,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:17,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:17,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:17,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:17,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:17,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:17,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:17,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:17,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:17,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:17,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:17,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:17,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:17,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:17,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:17,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:17,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:17,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:17,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:17,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:17,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:17,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:17,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:17,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:17,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:17,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:17,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:17,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:19,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:57:19,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:19,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:19,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:19,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:19,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:19,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:19,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:19,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:19,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:19,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:19,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:19,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:19,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:19,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:19,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:19,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:20,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:20,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:20,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:20,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:20,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:20,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:20,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:20,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:20,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:20,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:20,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:20,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:20,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:20,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:20,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:20,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:21,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:21,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:21,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:21,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:21,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:21,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:21,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:21,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:21,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:21,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:21,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:21,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:21,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:21,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:21,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:21,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:21,199 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:57:23,199 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:57:23,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:23,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:23,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:23,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:23,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:23,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:23,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:23,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:23,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:23,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:23,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:23,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:23,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:23,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:23,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:23,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:25,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:25,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:25,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:25,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:25,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:25,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:25,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:25,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:25,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:25,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:25,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:25,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:25,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:25,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:25,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:25,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:25,200 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:57:27,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:27,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:27,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:27,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:27,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:27,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:27,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:27,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:27,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:27,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:27,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:27,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:27,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:27,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:27,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:27,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:27,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:27,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:27,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:27,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:27,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:27,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:27,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:27,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:27,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:27,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:27,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:27,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:27,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:27,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:27,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:27,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,202 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:57:29,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:57:29,298 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:57:29,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:29,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:31,203 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:57:33,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:33,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:33,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:33,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:33,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:33,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:33,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:33,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:33,204 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:57:33,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:33,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:33,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:33,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:33,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:33,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:33,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:33,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:35,204 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:57:35,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:35,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:35,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:35,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:35,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:35,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:35,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:35,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:35,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:35,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:35,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:35,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:35,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:35,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:35,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:35,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:35,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:35,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:35,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:35,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:35,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:35,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:35,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:35,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:35,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:35,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:35,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:35,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:35,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:35,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:35,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:35,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:37,205 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:57:38,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:38,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,206 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:57:39,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:39,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:40,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:40,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:40,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:40,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:40,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:40,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:40,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:40,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:40,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:40,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:40,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:40,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:40,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:40,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:40,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:40,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:41,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:41,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:41,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:41,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:41,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:41,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:41,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:41,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:41,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:41,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:41,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:41,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:41,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:41,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:41,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:41,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:41,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:41,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:41,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:41,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:41,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:41,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:41,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:41,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:41,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:41,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:41,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:41,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:41,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:41,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:41,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:41,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:41,207 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:57:41,453 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:57:43,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:57:43,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:43,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:43,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:43,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:43,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:43,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:43,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:43,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:43,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:43,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:43,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:43,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:43,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:43,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:43,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:43,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:44,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:57:44,540 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:57:44,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:44,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:44,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:44,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:44,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:44,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:44,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:44,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:44,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:44,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:44,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:45,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:45,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:45,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:45,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:45,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:45,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:45,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:45,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:45,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:45,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:45,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:45,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:45,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:45,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:45,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:45,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:45,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:45,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:45,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:45,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:45,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:45,209 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:57:45,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:45,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:45,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:45,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:45,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:45,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:45,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:45,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:45,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:45,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:45,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:45,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:45,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:45,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:45,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:45,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:46,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:46,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:46,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:46,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:46,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:46,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:46,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:46,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:46,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:46,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:46,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:46,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:46,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:46,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:46,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:46,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:47,210 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:57:47,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:47,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:47,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:47,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:47,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:47,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:47,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:47,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:47,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:47,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:47,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:47,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:47,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:47,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:47,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:47,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:47,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:47,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:47,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:47,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:47,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:47,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:47,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:47,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:47,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:47,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:47,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:47,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:47,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:47,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:47,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:47,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:49,211 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:57:49,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:49,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:49,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:49,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:49,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:49,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:49,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:49,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:49,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:49,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:49,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:49,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:49,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:49,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:49,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:49,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:51,212 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:57:52,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:52,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:52,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:52,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:52,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:52,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:52,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:52,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:52,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:52,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:52,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:52,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:52,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:52,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:52,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:52,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:53,213 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:57:55,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:57:56,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:56,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:56,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:56,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:56,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:56,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:56,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:56,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:56,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:56,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:56,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:56,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:56,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:56,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:56,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:56,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:57:57,215 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:57:59,216 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:57:59,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:57:59,763 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:58:01,216 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:58:03,217 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:58:05,218 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:58:07,219 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:58:09,220 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:58:11,221 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:58:11,527 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:58:13,222 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:58:14,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:58:14,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:58:14,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:58:14,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:58:14,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:58:14,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:58:14,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:58:14,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:58:14,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:58:14,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:58:14,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:58:14,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:58:14,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:58:14,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:58:14,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:58:14,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:58:14,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:58:14,998 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:58:15,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:58:15,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:58:15,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:58:15,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:58:15,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:58:15,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:58:15,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:58:15,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:58:15,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:58:15,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:58:15,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:58:15,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:58:15,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:58:15,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 17:58:15,551 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 17:58:15,676 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 17:58:15,737 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 17:58:16,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 17:58:16,224 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:58:17,224 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:58:19,225 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:58:21,226 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:58:23,226 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:58:26,228 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:58:28,229 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:58:30,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:58:30,231 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:58:30,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:58:32,237 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:58:34,238 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:58:36,239 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:58:38,240 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:58:40,241 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:58:41,804 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:58:42,242 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:58:44,243 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:58:45,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:58:45,460 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:58:46,244 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:58:48,245 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:58:50,246 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:58:52,247 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:58:54,248 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:58:56,249 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:58:58,250 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:59:00,250 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:59:00,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:59:00,716 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:59:02,251 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:59:04,252 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:59:06,253 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:59:08,254 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:59:10,255 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:59:11,880 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:59:12,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:59:14,257 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:59:16,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:59:16,030 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:59:16,258 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:59:18,259 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:59:20,259 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:59:22,260 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:59:24,261 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:59:26,262 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:59:28,263 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:59:30,264 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:59:31,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:59:31,297 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:59:32,265 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:59:34,266 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:59:36,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:59:38,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:59:40,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:59:41,955 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 17:59:42,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:59:45,271 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:59:46,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 17:59:46,711 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 17:59:47,272 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:59:49,273 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:59:51,274 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:59:53,275 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:59:55,276 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:59:57,277 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 17:59:59,279 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:00:01,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:00:02,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:00:02,028 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:00:03,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:00:05,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:00:07,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:00:09,283 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:00:11,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:00:12,032 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:00:13,285 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:00:15,286 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:00:17,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:00:17,265 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:00:17,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:00:19,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:00:21,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:00:23,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:00:25,290 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:00:27,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:00:29,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:00:31,292 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:00:32,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:00:32,541 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:00:33,293 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:00:35,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:00:37,296 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:00:40,297 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:00:42,104 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:00:42,298 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:00:44,300 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:00:46,301 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:00:47,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:00:47,908 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:00:48,301 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:00:50,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:00:52,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:00:54,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:00:56,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:00:58,306 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:01:00,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:01:02,308 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:01:03,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:01:03,283 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:01:04,308 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:01:06,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:01:08,310 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:01:10,311 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:01:12,178 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:01:12,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:01:14,313 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:01:16,314 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:01:18,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:01:18,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:01:18,786 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:01:20,316 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:01:22,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:01:24,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:01:27,319 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:01:29,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:01:31,321 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:01:33,321 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:01:34,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:01:34,073 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:01:35,322 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:01:37,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:01:39,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:01:41,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:01:42,254 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:01:43,326 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:01:45,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:01:47,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:01:49,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:01:49,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:01:49,346 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:01:51,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:01:53,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:01:55,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:01:57,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:01:59,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:02:01,335 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:02:03,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:02:04,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:02:04,717 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:02:05,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:02:07,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:02:09,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:02:11,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:02:12,331 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:02:13,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:02:15,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:02:17,342 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:02:19,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:02:20,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:02:20,023 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:02:21,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:02:23,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:02:25,346 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:02:27,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:02:29,348 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:02:31,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:02:33,350 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:02:35,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:02:35,250 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:02:35,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:02:37,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:02:39,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:02:41,354 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:02:42,407 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:02:43,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:02:45,356 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:02:47,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:02:49,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:02:50,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:02:50,596 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:02:51,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:02:53,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:02:55,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:02:58,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:03:00,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:03:02,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:03:04,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:03:05,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:03:05,890 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:03:06,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:03:08,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:03:10,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:03:12,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:03:12,480 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:03:14,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:03:16,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:03:18,371 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:03:20,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:03:21,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:03:21,117 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:03:22,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:03:24,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:03:26,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:03:28,376 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:03:30,377 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:03:32,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:03:34,379 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:03:36,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:03:36,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:03:36,591 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:03:38,381 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:03:40,382 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:03:42,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:03:42,551 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:03:44,384 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:03:46,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:03:48,386 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:03:50,386 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:03:51,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:03:51,988 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:03:52,387 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:03:54,388 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:03:56,389 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:03:58,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:04:01,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:04:03,393 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:04:05,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:04:07,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:04:07,377 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:04:07,395 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:04:09,396 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:04:11,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:04:12,609 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:04:13,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:04:15,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:04:17,399 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:04:19,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:04:21,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:04:22,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:04:22,636 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:04:23,402 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:04:25,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:04:27,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:04:29,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:04:31,406 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:04:33,407 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:04:35,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:04:37,409 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:04:37,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:04:37,949 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:04:39,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:04:41,411 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:04:42,682 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:04:43,412 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:04:45,413 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:04:47,414 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:04:49,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:04:51,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:04:53,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:04:53,187 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:04:53,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:04:55,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:04:57,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:04:59,419 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:05:01,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:05:03,421 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:05:05,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:05:07,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:05:08,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:05:08,409 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:05:09,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:05:11,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:05:12,758 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:05:13,425 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:05:15,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:05:17,427 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:05:19,427 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:05:21,428 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:05:23,429 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:05:23,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:05:23,703 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:05:25,430 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:05:27,431 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:05:29,431 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:05:31,432 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:05:33,433 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:05:35,434 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:05:38,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:05:39,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:05:39,090 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:05:40,436 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:05:42,437 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:05:42,829 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:05:44,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:05:46,439 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:05:48,440 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:05:50,441 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:05:52,442 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:05:54,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:05:54,396 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:05:54,443 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:05:56,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:05:58,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:06:00,445 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:06:02,446 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:06:04,447 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:06:06,448 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:06:08,449 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:06:09,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:06:09,621 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:06:10,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:06:12,451 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:06:12,897 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:06:14,452 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:06:16,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:06:18,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:06:20,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:06:22,455 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:06:24,456 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:06:24,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:06:24,857 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:06:26,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:06:28,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:06:30,458 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:06:32,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:06:34,460 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:06:36,461 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:06:38,462 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:06:40,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:06:40,142 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:06:40,462 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:06:42,463 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:06:42,965 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:06:44,464 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:06:46,465 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:06:48,466 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:06:50,466 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:06:52,467 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:06:54,468 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:06:55,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:06:55,399 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:06:56,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:06:58,470 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:07:00,471 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:07:02,471 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:07:04,472 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:07:06,473 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:07:08,474 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:07:10,475 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:07:10,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:07:10,735 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:07:12,476 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:07:13,034 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:07:14,476 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:07:16,477 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:07:19,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:07:21,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:07:23,480 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:07:25,481 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:07:26,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:07:26,026 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:07:27,482 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:07:29,483 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:07:31,484 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:07:33,485 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:07:35,486 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:07:37,488 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:07:39,488 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:07:41,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:07:41,294 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:07:41,489 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:07:43,119 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:07:43,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:07:45,491 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:07:47,492 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:07:49,493 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:07:51,494 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:07:53,495 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:07:55,496 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:07:56,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:07:56,522 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:07:57,497 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:07:59,498 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:08:01,499 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:08:03,500 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:08:05,501 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:08:08,502 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:08:10,503 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:08:11,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:08:11,752 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:08:12,504 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:08:13,195 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:08:14,505 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:08:16,506 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:08:18,507 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:08:20,508 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:08:22,509 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:08:24,510 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:08:26,511 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:08:27,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:08:27,036 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:08:28,513 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:08:30,513 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:08:32,514 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:08:34,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:08:36,516 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:08:38,517 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:08:40,518 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:08:42,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:08:42,349 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:08:42,519 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:08:43,276 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:08:44,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:08:46,521 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:08:48,522 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:08:50,523 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:08:52,524 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:08:54,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:08:56,526 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:08:57,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:08:57,572 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:08:58,527 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:09:00,528 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:09:02,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:09:04,530 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:09:06,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:09:08,532 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:09:10,532 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:09:12,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:09:12,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:09:12,949 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:09:13,352 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:09:14,534 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:09:16,535 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:09:18,536 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:09:21,537 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:09:23,538 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:09:25,539 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:09:27,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:09:28,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:09:28,208 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:09:29,541 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:09:31,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:09:33,543 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:09:35,544 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:09:37,545 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:09:39,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:09:41,547 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:09:43,425 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:09:43,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:09:43,544 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:09:43,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:09:45,549 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:09:47,549 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:09:49,550 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:09:51,551 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:09:53,552 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:09:55,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:09:57,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:09:58,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:09:58,835 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:09:59,555 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:10:01,556 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:10:03,557 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:10:05,557 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:10:07,558 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:10:09,559 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:10:11,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:10:13,499 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:10:13,561 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:10:14,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:10:14,154 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:10:15,562 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:10:17,563 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:10:19,564 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:10:21,565 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:10:24,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:10:26,567 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:10:28,568 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:10:30,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:10:30,381 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:10:30,569 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:10:32,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:10:34,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:10:36,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:10:38,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:10:40,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:10:42,574 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:10:43,573 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:10:44,576 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:10:45,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:10:45,608 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:10:46,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:10:48,578 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:10:50,579 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:10:52,580 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:10:54,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:10:56,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:10:58,583 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:11:00,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:11:00,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:11:00,866 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:11:02,585 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:11:04,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:11:06,587 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:11:08,587 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:11:10,588 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:11:12,589 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:11:13,646 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:11:14,590 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:11:16,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:11:16,095 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:11:16,591 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:11:19,593 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:11:21,594 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:11:23,595 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:11:25,596 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:11:27,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:11:29,598 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:11:31,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:11:31,444 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:11:31,599 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:11:33,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:11:35,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:11:37,601 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:11:39,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:11:41,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:11:43,603 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:11:43,720 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:11:45,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:11:46,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:11:46,670 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:11:47,605 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:11:49,605 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:11:51,606 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:11:53,607 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:11:55,608 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:11:57,609 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:11:59,610 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:12:01,610 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:12:01,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:12:01,896 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:12:03,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:12:05,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:12:07,613 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:12:09,614 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:12:12,615 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:12:13,793 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:12:14,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:12:16,617 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:12:17,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:12:17,121 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:12:18,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:12:20,619 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:12:22,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:12:24,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:12:26,621 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:12:28,622 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:12:30,623 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:12:32,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:12:32,340 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:12:32,624 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:12:34,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:12:36,626 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:12:38,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:12:40,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:12:42,629 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:12:43,865 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:12:44,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:12:46,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:12:47,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:12:47,596 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:12:48,631 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:12:50,632 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:12:52,632 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:12:54,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:12:56,634 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:12:58,635 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:13:00,636 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:13:02,636 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:13:02,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:13:02,896 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:13:04,637 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:13:06,638 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:13:08,638 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:13:10,639 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:13:12,640 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:13:13,939 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:13:15,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:13:17,643 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:13:18,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:13:18,145 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:13:19,644 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:13:21,645 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:13:23,646 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:13:25,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:13:27,648 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:13:29,648 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:13:31,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:13:33,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:13:33,517 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:13:33,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:13:35,652 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:13:37,653 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:13:39,654 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:13:41,655 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:13:43,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:13:44,013 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:13:45,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:13:47,657 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:13:48,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:13:48,776 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:13:49,658 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:13:51,659 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:13:53,660 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:13:55,661 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:13:57,661 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:13:59,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:14:01,663 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:14:03,663 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:14:04,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:14:04,032 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:14:05,664 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:14:07,665 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:14:09,666 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:14:11,666 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:14:13,667 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:14:14,088 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:14:15,668 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:14:17,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:14:19,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:14:19,263 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:14:19,670 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:14:21,671 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:14:23,671 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:14:25,672 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:14:27,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:14:29,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:14:31,674 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:14:33,675 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:14:34,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:14:34,524 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:14:35,675 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:14:37,676 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:14:39,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:14:41,678 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:14:44,169 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:14:44,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:14:46,680 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:14:48,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:14:49,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:14:49,970 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:14:50,682 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:14:52,683 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:14:54,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:14:56,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:14:58,685 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:15:00,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:15:02,687 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:15:04,687 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:15:05,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:15:05,195 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:15:06,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:15:08,689 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:15:10,690 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:15:12,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:15:14,224 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:15:14,692 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:15:16,693 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:15:18,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:15:20,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:15:20,643 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:15:20,695 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:15:22,695 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:15:24,696 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:15:26,697 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:15:28,698 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:15:30,699 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:15:32,700 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:15:34,700 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:15:35,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:15:35,942 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:15:36,701 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:15:38,702 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:15:40,703 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:15:42,704 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:15:44,287 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:15:44,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:15:47,706 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:15:49,707 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:15:51,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:15:51,255 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:15:51,708 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:15:53,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:15:55,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:15:57,710 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:15:59,711 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:16:01,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:16:03,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:16:05,713 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:16:06,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:16:06,618 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:16:07,714 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:16:09,715 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:16:11,716 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:16:13,717 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:16:14,363 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:16:15,717 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:16:17,718 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:16:19,719 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:16:21,720 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:16:21,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:16:21,841 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:16:23,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:16:25,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:16:27,722 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:16:29,723 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:16:31,724 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:16:33,725 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:16:35,726 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:16:37,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:16:37,078 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:16:37,727 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:16:39,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:16:41,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:16:43,729 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:16:44,440 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:16:45,730 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:16:48,731 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:16:50,732 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:16:52,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:16:52,629 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:16:52,733 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:16:54,734 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:16:56,735 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:16:58,736 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:17:00,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:17:02,738 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:17:04,739 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:17:06,740 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:17:07,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:17:07,853 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:17:08,741 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:17:10,742 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:17:12,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:17:14,514 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:17:14,744 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:17:16,745 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:17:18,745 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:17:20,746 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:17:22,747 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:17:23,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:17:23,076 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:17:24,748 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:17:26,750 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:17:28,750 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:17:30,751 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:17:32,752 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:17:34,753 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:17:36,754 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:17:38,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:17:38,301 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:17:38,755 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:17:40,756 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:17:42,757 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:17:44,589 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:17:44,758 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:17:46,759 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:17:48,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:17:50,761 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:17:52,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:17:53,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:17:53,630 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:17:54,763 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:17:57,764 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:17:59,765 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:18:01,766 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:18:03,767 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:18:05,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:18:07,769 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:18:09,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:18:09,038 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:18:09,770 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:18:11,771 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:18:13,771 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:18:14,662 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:18:15,772 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:18:17,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:18:19,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:18:21,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:18:23,775 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:18:24,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:18:24,296 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:18:25,776 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:18:27,777 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:18:29,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:18:31,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:18:33,779 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:18:35,780 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:18:37,781 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:18:39,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:18:39,758 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:18:39,782 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:18:41,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:18:43,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:18:44,738 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:18:45,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:18:47,785 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:18:49,786 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:18:51,787 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:18:53,788 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:18:55,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:18:55,020 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:18:55,789 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:18:57,790 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:18:59,791 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:19:01,791 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:19:03,792 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:19:05,793 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:19:07,794 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:19:09,795 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:19:10,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:19:10,316 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:19:11,795 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:19:13,796 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:19:14,813 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:19:15,797 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:19:17,798 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:19:19,799 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:19:21,799 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:19:24,801 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:19:25,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:19:25,634 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:19:26,802 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:19:28,802 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:19:30,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:19:32,804 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:19:34,805 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:19:36,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:19:38,807 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:19:40,807 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:19:40,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:19:40,933 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:19:42,808 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:19:44,809 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:19:44,889 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:19:46,810 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:19:48,811 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:19:50,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:19:52,813 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:19:54,814 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:19:56,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:19:56,157 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:19:56,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:19:58,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:20:00,816 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:20:02,817 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:20:04,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:20:06,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:20:08,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:20:10,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:20:11,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:20:11,613 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:20:12,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:20:14,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:20:14,963 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:20:16,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:20:18,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:20:20,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:20:22,826 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:20:24,826 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:20:26,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:20:26,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:20:26,836 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:20:28,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:20:30,829 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:20:33,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:20:35,831 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:20:37,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:20:39,833 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:20:41,834 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:20:42,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:20:42,147 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:20:43,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:20:45,046 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:20:45,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:20:47,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:20:49,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:20:51,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:20:53,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:20:55,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:20:57,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:20:57,421 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:20:57,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:20:59,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:21:01,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:21:03,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:21:05,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:21:07,846 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:21:09,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:21:11,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:21:12,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:21:12,742 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:21:13,849 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:21:15,120 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:21:15,850 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:21:17,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:21:19,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:21:21,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:21:23,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:21:25,854 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:21:28,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:21:28,045 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:21:28,856 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:21:30,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:21:32,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:21:34,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:21:36,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:21:38,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:21:40,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:21:42,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:21:43,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:21:43,429 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:21:44,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:21:45,235 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:21:46,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:21:48,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:21:50,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:21:52,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:21:54,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:21:56,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:21:58,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:21:58,652 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:21:58,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:22:00,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:22:02,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:22:04,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:22:06,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:22:08,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:22:10,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:22:12,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:22:13,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:22:13,995 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:22:14,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:22:15,307 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:22:16,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:22:18,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:22:20,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:22:22,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:22:24,882 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:22:26,883 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:22:28,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:22:29,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:22:29,336 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:22:30,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:22:32,885 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:22:34,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:22:36,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:22:38,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:22:40,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:22:42,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:22:44,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:22:44,623 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:22:44,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:22:45,382 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:22:46,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:22:48,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:22:50,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:22:52,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:22:54,894 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:22:56,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:22:58,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:22:59,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:22:59,855 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:23:00,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:23:02,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:23:04,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:23:06,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:23:08,900 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:23:10,901 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:23:12,902 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:23:14,902 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:23:15,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:23:15,201 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:23:15,456 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:23:16,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:23:18,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:23:21,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:23:23,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:23:25,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:23:27,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:23:29,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:23:30,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:23:30,436 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:23:31,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:23:33,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:23:35,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:23:37,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:23:39,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:23:41,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:23:43,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:23:45,531 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:23:45,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:23:45,665 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:23:45,916 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:23:47,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:23:49,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:23:51,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:23:53,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:23:55,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:23:57,921 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:23:59,922 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:24:00,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:24:00,984 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:24:01,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:24:03,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:24:05,925 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:24:07,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:24:09,927 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:24:11,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:24:13,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:24:15,605 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:24:15,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:24:16,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:24:16,318 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:24:17,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:24:19,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:24:21,932 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:24:23,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:24:25,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:24:27,935 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:24:29,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:24:31,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:24:31,601 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:24:31,937 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:24:33,938 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:24:36,939 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:24:38,940 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:24:40,941 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:24:42,942 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:24:44,943 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:24:45,681 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:24:46,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:24:46,887 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:24:46,944 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:24:48,944 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:24:50,945 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:24:52,946 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:24:54,947 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:24:56,948 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:24:58,948 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:25:00,949 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:25:02,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:25:02,165 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:25:02,950 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:25:04,951 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:25:06,952 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:25:08,952 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:25:10,953 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:25:12,954 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:25:14,954 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:25:15,757 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:25:16,955 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:25:17,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:25:17,413 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:25:18,956 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:25:20,957 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:25:22,957 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:25:24,958 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:25:26,959 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:25:28,960 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:25:31,961 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:25:32,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:25:32,707 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:25:33,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:25:35,963 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:25:37,964 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:25:39,965 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:25:41,966 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:25:43,967 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:25:45,836 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:25:45,968 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:25:47,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:25:47,933 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:25:47,968 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:25:49,969 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:25:51,970 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:25:53,971 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:25:55,972 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:25:57,973 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:25:59,973 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:26:01,974 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:26:03,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:26:03,297 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:26:03,975 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:26:05,976 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:26:07,977 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:26:09,977 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:26:11,978 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:26:13,979 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:26:15,909 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:26:15,980 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:26:17,980 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:26:18,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:26:18,536 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:26:19,981 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:26:21,982 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:26:23,983 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:26:25,984 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:26:27,985 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:26:29,986 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:26:31,987 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:26:33,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:26:33,947 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:26:33,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:26:35,989 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:26:37,990 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:26:39,991 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:26:41,992 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:26:43,993 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:26:45,985 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:26:45,994 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:26:47,994 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:26:49,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:26:49,209 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:26:49,995 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:26:51,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:26:53,997 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:26:55,998 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:26:57,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:27:00,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:27:02,001 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:27:04,001 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:27:04,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:27:04,503 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:27:06,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:27:08,003 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:27:10,004 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:27:12,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:27:14,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:27:16,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:27:16,061 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:27:18,007 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:27:19,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:27:19,738 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:27:21,008 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:27:23,009 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:27:25,009 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:27:27,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:27:29,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:27:31,012 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:27:33,012 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:27:35,013 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:27:35,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:27:35,027 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:27:37,014 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:27:39,015 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:27:41,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:27:43,017 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:27:45,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:27:46,139 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:27:47,019 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:27:49,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:27:50,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:27:50,253 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:27:51,021 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:27:53,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:27:55,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:27:57,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:27:59,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:28:01,025 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:28:03,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:28:05,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:28:05,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:28:05,607 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:28:07,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:28:09,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:28:11,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:28:13,031 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:28:15,032 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:28:16,218 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:28:17,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:28:19,034 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:28:20,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:28:20,862 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:28:21,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:28:23,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:28:26,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:28:28,038 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:28:30,039 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:28:32,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:28:34,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:28:36,041 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:28:36,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:28:36,088 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:28:38,042 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:28:40,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:28:42,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:28:44,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:28:46,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:28:46,295 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:28:48,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:28:50,047 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:28:51,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:28:51,356 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:28:52,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:28:54,049 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:28:56,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:28:58,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:29:00,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:29:02,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:29:04,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:29:06,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:29:06,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:29:06,786 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:29:08,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:29:10,056 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:29:12,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:29:14,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:29:16,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:29:16,369 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:29:18,059 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:29:20,060 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:29:22,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:29:22,059 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:29:22,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:29:24,063 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:29:26,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:29:28,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:29:30,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:29:32,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:29:34,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:29:37,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:29:37,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:29:37,311 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:29:39,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:29:41,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:29:43,071 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:29:45,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:29:46,443 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:29:47,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:29:49,074 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:29:51,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:29:52,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:29:52,630 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:29:53,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:29:55,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:29:57,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:29:59,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:30:01,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:30:03,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:30:05,081 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:30:07,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:30:07,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:30:07,894 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:30:09,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:30:11,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:30:13,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:30:15,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:30:16,517 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:30:17,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:30:19,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:30:21,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:30:23,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:30:23,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:30:23,112 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:30:25,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:30:27,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:30:29,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:30:31,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:30:33,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:30:35,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:30:37,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:30:38,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:30:38,404 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:30:39,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:30:41,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:30:43,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:30:45,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:30:46,593 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:30:47,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:30:49,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:30:51,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:30:53,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:30:53,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:30:53,647 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:30:56,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:30:58,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:31:00,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:31:02,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:31:04,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:31:06,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:31:08,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:31:09,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:31:09,032 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:31:10,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:31:12,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:31:14,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:31:16,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:31:16,666 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:31:18,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:31:20,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:31:22,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:31:24,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:31:24,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:31:24,351 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:31:26,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:31:28,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:31:30,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:31:32,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:31:34,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:31:36,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:31:38,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:31:39,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:31:39,638 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:31:40,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:31:42,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:31:44,121 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:31:46,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:31:46,740 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:31:48,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:31:50,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:31:52,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:31:54,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:31:55,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:31:55,060 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:31:56,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:31:58,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:32:00,128 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:32:02,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:32:04,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:32:06,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:32:08,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:32:10,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:32:10,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:32:10,286 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:32:12,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:32:14,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:32:16,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:32:16,813 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:32:19,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:32:21,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:32:23,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:32:25,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:32:25,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:32:25,574 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:32:27,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:32:29,140 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:32:31,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:32:33,142 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:32:35,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:32:37,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:32:39,145 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:32:40,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:32:40,796 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:32:41,146 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:32:43,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:32:45,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:32:46,890 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:32:47,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:32:49,150 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:32:51,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:32:53,152 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:32:55,153 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:32:56,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:32:56,195 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:32:57,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:32:59,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:33:01,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:33:03,157 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:33:05,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:33:07,159 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:33:09,160 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:33:11,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:33:11,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:33:11,548 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:33:13,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:33:15,162 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:33:16,967 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:33:17,163 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:33:20,165 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:33:22,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:33:24,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:33:26,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:33:26,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:33:26,786 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:33:28,168 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:33:30,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:33:32,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:33:34,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:33:36,172 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:33:38,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:33:40,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:33:42,175 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:33:42,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:33:42,236 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:33:44,176 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:33:46,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:33:47,042 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:33:48,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:33:50,179 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:33:52,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:33:54,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:33:56,182 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:33:57,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:33:57,464 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:33:58,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:34:00,184 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:34:02,185 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:34:04,186 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:34:06,187 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:34:08,188 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:34:10,189 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:34:12,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:34:12,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:34:12,826 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:34:14,191 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:34:16,192 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:34:17,119 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:34:18,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:34:20,194 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:34:22,195 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:34:24,196 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:34:26,196 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:34:28,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:34:28,162 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:34:28,197 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:34:30,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:34:33,200 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:34:35,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:34:37,202 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:34:39,203 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:34:41,204 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:34:43,204 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:34:43,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:34:43,452 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:34:45,205 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:34:47,195 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:34:47,206 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:34:49,207 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:34:51,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:34:53,209 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:34:55,210 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:34:57,211 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:34:58,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:34:58,711 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:34:59,212 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:35:01,213 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:35:03,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:35:05,215 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:35:07,216 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:35:09,217 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:35:11,218 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:35:13,219 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:35:13,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:35:13,993 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:35:15,220 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:35:17,221 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:35:17,271 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:35:19,222 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:35:21,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:35:23,224 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:35:25,224 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:35:27,225 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:35:29,226 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:35:29,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:35:29,303 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:35:31,227 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:35:33,228 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:35:35,229 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:35:37,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:35:39,231 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:35:41,231 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:35:43,232 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:35:44,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:35:44,530 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:35:45,233 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:35:47,234 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:35:47,345 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:35:49,235 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:35:51,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:35:54,238 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:35:56,238 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:35:58,239 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:35:59,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:35:59,884 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:36:00,240 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:36:02,241 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:36:04,242 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:36:06,244 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:36:08,245 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:36:10,245 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:36:12,246 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:36:14,247 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:36:15,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:36:15,109 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:36:16,248 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:36:17,422 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:36:18,249 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:36:20,250 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:36:22,251 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:36:24,252 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:36:26,253 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:36:28,254 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:36:30,255 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:36:30,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:36:30,426 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:36:32,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:36:34,257 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:36:36,258 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:36:38,259 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:36:40,260 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:36:42,261 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:36:44,262 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:36:45,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:36:45,704 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:36:46,262 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:36:47,495 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:36:48,263 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:36:50,264 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:36:52,265 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:36:54,266 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:36:56,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:36:58,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:37:00,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:37:00,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:37:00,976 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:37:02,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:37:04,270 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:37:07,272 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:37:09,272 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:37:11,273 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:37:13,274 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:37:15,274 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:37:16,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:37:16,414 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:37:17,275 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:37:17,570 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:37:19,276 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:37:21,277 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:37:23,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:37:25,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:37:27,279 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:37:29,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:37:31,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:37:31,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:37:31,648 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:37:33,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:37:35,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:37:37,283 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:37:39,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:37:41,285 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:37:43,285 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:37:45,286 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:37:46,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:37:46,877 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:37:47,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:37:47,638 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:37:49,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:37:51,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:37:53,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:37:55,290 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:37:57,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:37:59,292 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:38:01,293 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:38:02,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:38:02,106 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:38:03,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:38:05,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:38:07,296 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:38:09,297 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:38:11,298 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:38:13,299 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:38:15,300 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:38:17,301 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:38:17,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:38:17,340 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:38:17,712 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:38:19,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:38:21,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:38:23,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:38:25,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:38:27,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:38:29,306 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:38:32,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:38:32,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:38:32,682 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:38:34,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:38:36,308 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:38:38,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:38:40,310 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:38:42,311 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:38:44,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:38:46,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:38:47,786 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:38:48,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:38:48,088 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:38:48,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:38:50,318 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:38:52,319 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:38:54,322 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:38:56,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:38:58,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:39:00,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:39:02,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:39:03,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:39:03,319 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:39:04,326 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:39:06,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:39:08,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:39:10,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:39:12,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:39:14,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:39:16,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:39:17,853 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:39:18,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:39:18,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:39:18,548 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:39:20,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:39:22,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:39:24,335 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:39:26,335 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:39:28,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:39:30,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:39:32,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:39:33,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:39:33,881 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:39:34,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:39:36,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:39:38,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:39:40,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:39:42,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:39:44,342 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:39:46,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:39:47,928 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:39:48,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:39:49,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:39:49,210 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:39:50,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:39:52,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:39:54,346 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:39:57,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:39:59,348 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:40:01,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:40:03,350 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:40:04,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:40:04,468 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:40:05,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:40:07,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:40:09,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:40:11,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:40:13,354 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:40:15,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:40:17,356 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:40:18,005 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:40:19,356 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:40:19,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:40:19,695 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:40:21,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:40:23,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:40:25,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:40:27,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:40:29,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:40:31,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:40:33,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:40:34,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:40:34,918 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:40:35,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:40:37,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:40:39,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:40:41,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:40:43,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:40:45,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:40:47,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:40:48,078 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:40:49,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:40:50,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:40:50,147 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:40:51,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:40:53,371 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:40:55,371 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:40:57,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:40:59,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:41:01,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:41:03,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:41:05,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:41:05,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:41:05,479 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:41:07,376 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:41:09,377 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:41:11,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:41:13,379 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:41:15,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:41:17,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:41:18,150 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:41:19,381 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:41:21,382 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:41:21,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:41:21,471 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:41:23,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:41:25,384 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:41:27,384 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:41:29,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:41:31,386 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:41:33,387 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:41:35,388 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:41:36,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:41:36,794 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:41:37,388 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:41:39,389 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:41:41,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:41:43,391 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:41:45,391 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:41:48,224 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:41:48,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:41:50,393 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:41:52,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:41:52,125 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:41:52,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:41:54,395 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:41:56,395 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:41:58,396 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:42:00,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:42:02,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:42:04,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:42:06,399 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:42:07,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:42:07,427 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:42:08,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:42:10,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:42:12,402 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:42:14,402 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:42:16,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:42:18,300 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:42:18,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:42:20,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:42:22,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:42:22,649 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:42:37,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:42:37,906 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:42:48,377 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:42:53,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:42:53,207 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:43:08,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:43:08,528 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:43:18,450 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:43:19,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:43:19,614 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 18:43:19,670 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 18:43:19,751 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 18:43:20,429 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 18:43:20,429 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:43:23,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:43:23,778 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:43:28,433 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:43:39,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:43:39,024 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:43:48,537 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:43:50,442 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:43:54,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:43:54,261 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:44:09,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:44:09,489 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:44:18,614 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:44:24,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:44:24,719 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:44:39,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:44:39,947 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:44:48,694 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:44:55,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:44:55,170 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:45:10,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:45:10,403 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:45:18,772 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:45:25,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:45:25,631 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:45:40,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:45:40,856 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:45:48,848 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:45:56,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:45:56,080 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:46:11,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:46:11,355 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:46:18,925 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:46:26,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:46:26,587 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:46:41,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:46:41,836 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:46:49,002 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:46:57,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:46:57,060 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:47:12,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:47:12,285 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:47:19,079 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:47:27,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:47:27,512 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:47:42,543 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:47:42,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:47:42,737 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:47:43,544 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:47:45,544 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:47:49,159 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:47:50,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:47:50,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:47:50,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:47:50,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:47:50,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:47:50,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:47:50,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:47:50,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:47:50,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:47:50,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:47:50,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:47:50,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:47:50,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:47:50,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:47:50,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:47:50,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:47:53,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:47:58,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:47:58,379 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:47:59,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:48:03,549 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:48:07,550 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:48:11,552 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:48:13,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:48:13,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:48:13,602 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:48:17,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:48:19,237 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:48:21,556 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:48:23,556 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:48:27,558 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:48:28,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:48:28,914 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:48:29,558 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:48:29,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:29,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:29,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:29,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:29,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:29,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:29,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:29,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:29,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:29,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:29,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:29,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:29,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:29,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:29,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:29,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:33,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:48:35,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:35,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:35,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:35,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:35,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:35,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:35,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:35,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:35,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:35,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:35,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:35,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:35,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:35,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:35,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:35,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:35,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:35,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:35,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:35,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:35,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:35,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:35,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:35,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:35,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:35,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:35,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:35,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:35,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:35,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:35,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:35,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:35,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:48:37,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:37,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:37,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:37,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:37,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:37,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:37,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:37,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:37,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:37,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:37,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:37,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:37,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:37,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:37,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:37,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:39,562 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:48:39,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:39,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:39,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:39,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:39,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:39,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:39,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:39,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:39,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:39,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:39,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:39,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:39,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:39,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:39,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:39,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:41,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:41,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:41,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:41,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:41,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:41,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:41,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:41,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:41,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:41,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:41,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:41,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:41,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:41,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:41,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:41,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:41,563 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:48:42,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:42,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:42,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:42,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:42,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:42,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:42,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:42,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:42,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:42,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:42,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:42,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:42,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:42,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:42,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:42,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:43,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:43,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:43,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:43,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:43,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:43,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:43,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:43,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:43,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:43,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:43,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:43,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:43,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:43,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:43,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:43,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:43,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:43,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:43,563 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:48:43,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:43,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:43,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:43,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:43,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:43,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:43,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:43,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:43,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:43,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:43,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:43,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:43,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:43,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:44,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:48:44,254 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:48:44,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:44,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:44,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:44,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:44,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:44,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:44,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:44,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:44,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:44,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:44,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:44,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:44,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:44,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:44,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:44,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:44,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:44,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:44,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:44,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:44,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:44,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:44,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:44,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:44,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:44,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:44,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:44,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:44,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:44,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:44,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:44,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:47,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:47,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:47,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:47,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:47,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:47,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:47,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:47,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:47,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:47,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:47,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:47,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:47,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:47,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:47,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:47,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:47,565 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:48:48,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:48,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:48,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:48,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:48,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:48,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:48,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:48,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:48,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:48,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:48,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:48,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:48,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:48,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:48,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:48,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:49,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:49,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:49,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:49,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:49,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:49,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:49,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:49,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:49,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:49,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:49,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:49,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:49,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:49,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:49,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:49,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:49,311 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:48:49,565 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:48:49,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:49,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:49,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:49,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:49,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:49,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:49,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:49,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:49,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:49,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:49,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:49,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:49,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:49,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:49,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:49,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:51,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:48:52,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:52,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:52,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:52,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:52,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:52,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:52,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:52,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:52,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:52,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:52,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:52,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:52,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:52,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:52,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:52,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:52,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:52,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:52,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:52,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:52,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:52,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:52,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:52,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:52,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:52,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:52,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:52,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:52,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:52,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:52,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:52,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:53,567 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:48:54,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:54,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:54,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:54,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:54,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:54,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:54,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:54,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:54,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:54,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:54,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:54,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:54,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:54,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:54,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:54,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:56,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:56,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:56,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:56,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:56,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:56,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:56,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:56,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:56,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:56,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:56,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:56,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:56,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:56,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:56,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:56,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:56,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:56,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:56,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:56,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:56,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:56,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:56,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:56,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:56,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:56,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:56,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:56,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:56,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:56,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:56,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:56,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:56,568 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:48:57,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:57,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:57,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:57,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:57,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:57,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:57,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:57,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:57,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:57,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:57,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:57,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:57,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:57,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:57,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:57,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:59,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:48:59,478 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:48:59,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:59,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:59,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:59,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:59,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:59,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:59,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:59,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:59,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:59,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:59,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:59,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:59,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:59,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:59,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:48:59,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:00,569 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:49:01,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:01,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:01,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:01,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:01,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:01,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:01,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:01,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:01,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:01,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:01,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:01,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:01,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:01,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:01,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:01,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:02,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:49:02,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:02,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:02,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:02,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:02,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:02,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:02,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:02,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:02,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:02,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:02,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:02,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:02,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:02,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:02,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:02,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:03,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:03,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:03,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:03,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:03,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:03,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:03,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:03,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:03,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:03,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:03,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:03,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:03,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:03,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:03,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:03,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:03,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:03,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:03,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:03,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:03,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:03,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:03,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:03,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:03,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:03,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:03,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:03,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:03,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:03,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:03,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:03,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:04,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:49:05,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:05,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:05,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:05,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:05,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:05,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:05,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:05,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:05,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:05,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:05,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:05,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:05,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:05,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:05,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:05,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:05,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:05,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:05,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:05,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:05,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:05,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:05,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:05,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:05,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:05,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:05,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:05,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:05,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:05,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:05,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:05,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:06,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:49:06,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:06,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:06,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:06,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:06,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:06,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:06,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:06,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:06,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:06,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:06,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:06,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:06,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:06,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:06,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:06,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:07,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:08,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:49:09,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:09,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:10,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:10,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:10,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:10,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:10,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:10,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:10,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:10,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:10,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:10,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:10,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:10,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:10,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:10,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:10,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:10,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:10,574 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:49:12,574 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:49:12,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:12,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:12,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:12,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:12,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:12,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:12,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:12,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:12,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:12,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:12,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:12,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:12,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:12,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:12,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:12,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:13,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:13,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:13,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:13,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:13,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:13,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:13,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:13,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:13,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:13,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:13,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:13,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:13,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:13,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:13,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:13,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:13,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:13,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:13,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:13,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:13,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:13,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:13,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:13,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:13,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:13,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:13,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:13,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:13,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:13,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:13,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:13,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:14,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:49:14,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:49:14,706 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:49:14,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:14,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:14,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:14,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:14,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:14,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:14,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:14,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:14,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:14,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:14,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:14,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:14,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:14,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:14,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:14,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:15,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:15,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:15,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:15,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:15,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:15,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:15,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:15,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:15,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:15,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:15,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:15,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:15,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:15,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:15,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:15,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:16,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:16,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:16,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:16,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:16,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:16,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:16,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:16,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:16,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:16,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:16,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:16,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:16,576 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:49:16,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:16,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:16,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:16,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:16,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:16,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:16,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:16,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:16,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:16,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:16,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:16,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:16,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:16,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:16,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:16,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:16,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:16,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:16,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:16,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:17,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:17,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:17,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:17,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:17,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:17,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:17,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:17,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:17,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:17,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:17,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:17,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:17,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:17,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:17,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:17,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:18,576 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:49:19,387 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:49:20,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:49:22,578 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:49:23,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:23,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:23,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:23,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:23,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:23,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:23,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:23,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:23,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:23,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:23,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:23,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:23,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:23,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:23,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:23,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:23,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:23,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:23,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:23,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:23,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:23,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:23,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:23,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:23,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:23,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:23,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:23,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:23,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:23,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:23,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:23,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:24,579 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:49:26,580 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:49:28,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:49:29,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:49:29,933 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:49:30,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:49:32,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:49:34,583 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:49:36,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:49:38,585 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:49:39,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:39,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:39,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:39,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:40,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:40,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:40,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:40,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:40,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:40,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:40,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:40,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:40,585 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:49:42,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:49:45,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:49:45,303 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:49:49,464 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:49:50,588 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:49:56,591 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:49:57,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:57,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:57,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:57,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:57,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:57,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:57,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:57,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:57,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:57,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:57,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:57,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:57,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:57,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:57,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:49:57,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:00,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:00,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:00,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:00,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:00,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:00,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:00,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:00,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:00,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:00,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:00,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:00,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:00,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:00,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:00,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:00,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:00,592 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:50:00,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:50:00,764 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:50:04,594 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:50:10,596 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:50:12,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:50:16,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:50:16,195 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:50:16,598 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:50:19,541 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:50:20,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:50:24,601 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:50:26,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:50:30,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:50:31,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:50:31,453 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:50:32,605 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:50:34,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:34,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:34,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:34,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:34,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:34,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:34,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:34,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:34,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:34,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:34,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:34,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:34,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:34,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:34,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:34,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:37,606 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:50:38,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:38,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:38,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:38,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:38,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:38,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:38,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:38,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:38,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:38,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:38,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:38,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:38,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:38,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:38,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:38,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:39,607 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:50:41,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:41,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:41,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:41,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:41,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:41,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:41,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:41,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:41,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:41,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:41,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:41,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:41,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:41,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:41,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:41,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:43,609 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:50:44,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:44,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:44,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:44,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:44,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:44,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:44,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:44,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:44,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:44,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:44,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:44,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:44,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:44,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:44,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:44,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:44,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:44,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:44,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:44,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:44,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:44,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:44,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:44,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:44,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:44,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:44,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:44,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:44,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:44,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:44,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:44,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:45,609 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:50:45,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:45,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:45,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:45,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:45,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:45,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:45,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:45,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:45,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:45,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:45,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:45,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:45,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:45,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:45,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:45,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:46,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:50:46,679 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:50:46,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:46,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:46,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:46,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:46,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:46,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:46,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:46,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:46,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:46,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:46,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:46,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:46,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:46,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:46,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:46,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:47,610 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:50:49,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:49,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:49,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:49,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:49,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:49,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:49,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:49,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:49,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:49,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:49,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:49,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:49,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:49,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:49,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:49,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:49,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:49,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:49,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:49,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:49,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:49,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:49,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:49,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:49,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:49,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:49,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:49,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:49,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:49,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:49,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:49,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:49,614 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:50:50,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:50,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:50,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:50,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:50,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:50,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:50,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:50,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:50,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:50,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:50,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:50,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:50,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:50,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:50,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:50,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:50,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:50,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:50,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:50,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:50,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:50,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:50,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:50,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:50,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:50,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:50,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:50,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:50,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:50,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:50,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:50,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:51,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:50:51,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:51,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:51,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:51,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:51,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:51,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:51,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:51,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:51,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:51,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:51,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:51,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:51,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:51,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:51,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:51,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:53,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:53,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:53,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:53,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:53,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:53,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:53,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:53,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:53,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:53,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:53,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:53,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:53,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:53,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:53,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:53,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:53,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:50:54,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:54,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:54,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:54,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:54,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:54,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:54,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:54,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:54,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:54,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:54,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:54,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:54,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:54,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:54,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:54,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:55,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:55,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:55,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:55,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:55,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:55,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:55,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:55,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:55,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:55,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:55,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:55,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:55,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:55,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:55,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:55,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:55,613 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:50:56,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:56,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:56,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:56,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:56,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:56,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:56,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:56,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:56,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:56,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:56,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:56,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:56,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:56,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:56,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:56,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:56,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:56,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:56,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:56,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:56,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:56,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:56,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:56,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:56,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:56,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:56,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:56,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:56,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:56,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:56,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:56,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:57,614 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:50:59,615 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:50:59,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:59,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:59,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:59,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:59,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:59,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:59,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:59,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:59,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:59,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:59,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:59,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:59,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:59,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:59,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:59,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:59,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:59,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:59,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:59,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:59,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:59,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:59,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:59,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:59,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:59,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:59,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:59,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:59,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:59,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:59,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:50:59,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:01,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:51:01,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:01,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:01,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:01,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:01,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:01,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:01,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:01,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:01,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:01,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:01,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:01,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:01,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:01,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:01,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:01,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:01,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:51:01,908 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:51:03,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:03,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:03,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:03,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:03,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:03,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:03,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:03,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:03,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:03,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:03,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:03,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:03,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:03,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:03,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:03,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:03,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:03,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:03,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:03,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:03,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:03,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:03,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:03,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:03,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:03,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:03,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:03,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:03,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:03,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:03,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:03,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:03,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:51:04,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:04,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:04,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:04,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:04,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:04,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:04,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:04,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:04,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:04,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:04,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:04,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:04,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:04,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:04,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:04,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:04,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:04,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:04,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:04,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:04,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:04,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:04,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:04,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:04,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:04,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:04,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:04,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:04,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:04,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:04,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:04,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:05,617 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:51:07,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:51:08,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:08,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:08,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:08,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:08,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:08,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:08,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:08,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:08,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:08,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:08,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:08,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:08,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:08,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:08,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:08,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:09,619 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:51:10,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:10,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:11,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:51:12,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:12,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:12,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:12,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:12,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:12,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:12,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:12,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:12,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:12,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:12,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:12,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:12,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:12,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:12,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:12,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:13,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:13,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:13,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:13,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:13,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:13,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:13,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:13,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:13,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:13,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:13,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:13,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:13,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:13,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:13,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:13,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:13,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:51:14,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:14,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:14,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:14,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:14,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:14,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:14,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:14,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:14,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:14,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:14,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:14,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:14,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:14,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:14,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:14,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:14,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,621 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:51:15,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:15,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:16,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:16,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:16,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:16,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:16,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:16,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:16,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:16,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:17,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:51:17,187 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:51:17,622 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:51:17,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:17,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:17,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:17,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:17,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:17,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:17,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:17,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:17,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:17,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:17,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:17,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:17,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:17,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:17,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:17,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:17,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:17,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:17,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:17,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:17,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:17,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:17,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:17,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:17,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:17,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:17,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:17,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:17,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:17,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:17,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:17,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:18,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:18,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:18,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:18,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:18,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:18,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:18,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:18,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:18,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:18,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:18,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:18,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:18,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:18,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:18,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:18,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:19,623 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:51:19,686 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:51:20,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:20,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:20,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:20,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:20,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:20,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:20,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:20,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:20,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:20,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:20,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:20,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:20,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:20,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:20,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:20,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:21,623 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:51:21,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:21,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:21,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:21,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:21,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:21,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:21,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:21,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:21,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:21,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:21,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:21,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:21,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:21,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:21,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:21,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:21,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:21,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:21,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:21,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:21,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:21,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:21,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:21,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:21,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:21,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:21,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:21,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:21,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:21,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:21,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:21,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:22,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:22,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:22,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:22,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:22,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:22,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:22,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:22,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:22,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:22,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:22,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:22,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:22,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:22,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:22,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:22,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:23,624 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:51:25,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:25,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:25,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:25,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:25,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:25,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:25,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:25,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:25,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:25,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:25,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:25,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:25,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:25,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:25,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:25,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:25,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:51:27,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:51:28,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:28,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:28,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:28,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:28,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:28,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:28,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:28,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:28,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:28,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:28,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:28,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:28,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:28,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:28,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:28,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:29,626 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:51:31,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:51:32,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:51:32,411 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:51:33,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:51:35,629 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:51:37,629 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:51:39,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:51:39,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:39,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:39,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:39,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:40,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:40,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:40,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:40,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:40,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:40,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:40,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:40,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:40,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:51:40,368 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 18:51:40,600 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 18:51:40,663 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 18:51:40,664 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 18:51:41,664 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:51:47,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:51:47,687 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:51:49,785 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:51:51,668 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:51:55,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:51:59,671 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:52:03,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:52:03,023 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:52:03,672 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:52:07,674 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:52:10,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:10,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:10,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:10,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:10,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:10,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:10,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:10,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:10,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:10,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:10,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:10,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:10,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:10,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:10,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:10,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:11,676 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:52:11,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:11,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:11,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:11,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:11,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:11,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:11,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:11,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:11,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:11,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:11,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:11,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:11,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:11,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:11,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:11,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:15,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:52:18,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:52:18,391 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:52:19,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:52:19,859 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:52:21,680 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:52:25,682 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:52:29,683 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:52:31,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:52:33,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:52:33,615 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:52:35,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:52:37,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:52:37,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:37,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:37,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:37,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:37,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:37,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:37,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:37,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:37,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:37,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:37,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:37,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:37,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:37,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:37,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:37,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:41,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:41,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:41,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:41,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:41,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:41,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:41,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:41,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:41,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:41,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:41,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:41,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:41,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:41,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:41,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:41,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:41,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:52:44,689 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:52:45,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:45,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:45,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:45,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:45,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:45,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:45,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:45,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:46,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:46,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:46,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:46,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:46,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:46,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:46,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:46,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:46,690 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:52:46,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:46,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:46,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:46,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:46,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:46,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:46,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:46,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:46,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:46,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:46,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:46,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:46,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:46,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:46,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:46,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:48,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:48,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:48,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:48,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:48,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:48,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:48,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:48,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:48,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:48,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:48,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:48,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:48,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:48,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:48,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:48,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:48,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:52:48,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:52:48,996 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:52:49,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:49,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:49,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:49,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:49,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:49,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:49,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:49,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:49,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:49,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:49,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:49,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:49,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:49,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:49,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:49,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:49,926 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:52:51,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:51,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:51,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:51,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:51,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:51,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:51,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:51,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:51,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:51,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:51,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:51,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:51,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:51,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:51,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:51,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:52,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:52,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:52,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:52,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:52,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:52,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:52,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:52,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:52,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:52,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:52,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:52,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:52,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:52,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:52,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:52,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:52,693 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:52:54,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:54,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:54,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:54,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:54,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:54,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:54,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:54,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:54,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:54,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:54,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:54,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:54,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:54,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:54,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:54,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:54,693 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:52:55,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:55,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:55,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:55,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:55,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:55,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:55,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:55,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:55,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:55,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:55,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:55,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:55,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:55,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:55,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:55,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:56,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:52:56,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:56,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:56,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:56,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:56,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:56,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:56,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:56,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:56,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:56,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:56,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:56,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:56,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:56,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:56,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:56,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:58,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:58,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:58,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:58,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:58,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:58,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:58,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:58,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:58,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:58,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:58,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:58,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:58,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:58,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:58,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:58,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:58,695 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:52:59,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:52:59,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:00,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:00,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:00,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:00,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:00,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:00,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:00,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:00,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:00,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:00,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:00,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:00,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:00,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:00,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:00,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:00,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:00,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:00,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:00,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:00,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:00,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:00,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:00,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:00,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:00,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:00,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:00,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:00,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:00,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:00,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:00,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:00,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:00,696 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:53:01,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:01,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:01,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:01,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:01,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:01,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:01,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:01,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:01,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:01,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:01,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:01,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:01,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:01,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:01,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:01,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:01,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:01,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:01,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:01,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:01,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:01,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:01,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:01,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:01,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:01,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:01,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:01,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:01,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:01,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:01,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:01,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:03,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:03,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:03,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:03,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:03,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:03,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:03,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:03,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:03,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:03,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:03,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:03,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:03,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:03,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:03,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:03,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:04,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:53:04,221 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:53:04,697 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:53:04,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:04,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:04,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:04,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:04,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:04,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:04,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:04,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:04,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:04,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:04,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:04,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:04,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:04,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:04,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:04,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:06,699 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:53:07,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:07,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:07,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:07,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:07,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:07,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:07,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:07,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:07,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:07,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:07,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:07,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:07,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:07,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:07,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:07,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:08,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:08,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:08,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:08,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:08,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:08,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:08,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:08,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:08,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:08,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:08,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:08,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:08,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:08,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:08,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:08,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:08,699 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:53:10,700 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:53:11,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:11,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:11,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:11,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:11,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:11,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:11,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:11,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:11,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:11,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:11,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:11,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:11,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:11,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:11,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:11,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:11,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:11,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:11,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:11,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:11,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:11,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:11,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:11,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:11,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:11,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:11,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:11,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:11,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:11,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:11,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:11,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:12,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:12,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:12,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:12,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:12,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:12,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:12,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:12,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:12,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:12,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:12,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:12,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:12,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:12,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:12,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:12,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:12,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:12,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:12,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:12,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:12,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:12,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:12,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:12,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:12,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:12,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:12,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:12,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:12,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:12,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:12,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:12,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:12,701 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:53:13,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:13,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:13,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:13,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:13,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:13,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:13,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:13,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:13,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:13,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:13,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:13,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:13,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:13,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:13,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:13,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:14,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:14,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:14,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:14,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:14,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:14,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:14,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:14,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:14,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:14,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:14,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:14,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:14,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:14,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:14,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:14,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:14,702 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:53:15,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:15,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:15,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:15,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:15,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:15,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:15,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:15,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:15,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:15,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:15,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:15,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:15,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:15,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:15,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:15,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:15,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:15,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:15,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:15,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:15,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:15,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:15,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:15,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:15,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:15,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:15,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:15,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:15,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:15,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:15,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:15,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:16,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:16,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:16,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:16,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:16,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:16,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:16,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:16,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:16,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:16,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:16,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:16,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:16,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:16,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:16,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:16,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:16,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:16,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:16,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:16,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:16,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:16,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:16,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:16,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:16,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:16,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:16,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:16,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:16,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:16,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:16,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:16,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:16,703 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:53:17,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:17,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:17,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:17,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:17,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:17,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:17,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:17,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:17,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:17,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:17,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:17,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:17,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:17,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:17,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:17,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:17,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:17,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:17,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:17,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:17,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:17,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:17,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:17,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:17,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:17,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:17,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:17,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:17,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:17,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:17,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:17,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:18,704 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:53:18,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:18,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:18,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:18,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:18,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:18,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:18,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:18,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:18,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:18,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:18,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:18,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:18,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:18,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:18,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:18,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:18,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:18,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:18,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:18,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:18,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:18,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:18,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:18,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:18,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:18,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:18,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:18,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:18,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:18,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:18,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:18,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:19,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:53:19,533 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:53:19,998 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:53:20,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:20,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:20,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:20,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:20,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:20,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:20,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:20,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:20,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:20,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:20,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:20,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:20,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:20,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:20,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:20,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:20,704 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:53:21,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:21,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:21,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:21,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:21,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:21,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:21,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:21,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:21,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:21,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:21,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:21,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:21,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:21,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:21,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:21,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:22,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:53:24,706 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:53:25,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:25,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:26,707 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:53:26,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:26,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:26,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:26,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:26,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:26,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:26,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:26,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:26,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:26,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:26,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:26,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:26,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:26,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:26,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:26,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:27,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:27,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:27,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:27,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:27,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:27,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:27,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:27,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:27,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:27,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:27,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:27,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:27,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:27,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:27,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:27,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:28,707 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:53:30,708 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:53:32,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:32,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:32,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:32,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:32,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:32,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:32,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:32,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:32,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:32,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:32,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:32,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:32,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:32,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:32,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:32,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:32,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:53:33,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:33,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:33,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:33,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:33,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:33,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:33,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:33,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:33,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:33,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:33,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:33,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:33,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:33,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:33,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:33,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:34,717 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:53:34,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:53:34,771 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:53:36,718 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:53:38,719 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:53:40,720 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:53:40,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:40,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:40,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:40,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:41,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:41,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:41,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:41,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:41,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:41,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:41,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:41,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:53:42,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:53:49,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:53:49,999 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:53:50,234 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:53:52,725 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:53:58,727 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:54:02,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:54:05,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:54:05,362 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:54:06,730 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:54:10,731 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:54:14,733 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:54:16,734 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:54:20,149 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:54:20,735 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:54:20,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:54:20,743 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:54:24,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:54:25,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:25,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:25,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:25,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:25,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:25,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:25,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:25,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:25,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:25,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:25,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:25,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:25,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:25,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:25,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:25,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:26,738 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:54:26,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:26,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:26,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:26,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:26,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:26,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:26,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:26,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:26,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:26,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:26,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:26,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:26,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:26,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:26,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:26,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:30,739 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:54:32,740 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:54:36,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:54:36,087 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:54:36,742 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:54:39,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:54:40,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:40,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:40,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:40,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:40,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:40,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:40,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:40,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:40,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:40,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:40,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:40,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:40,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:40,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:40,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:40,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:41,744 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:54:43,745 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:54:47,746 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:54:49,747 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:54:50,216 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:54:50,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:50,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:50,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:50,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:50,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:50,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:50,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:50,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:50,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:50,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:50,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:50,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:50,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:50,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:50,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:50,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:51,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:51,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:51,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:51,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:51,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:51,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:51,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:51,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:51,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:51,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:51,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:51,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:51,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:51,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:51,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:51,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:51,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:54:51,325 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:54:51,748 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:54:53,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:53,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:53,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:53,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:53,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:53,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:53,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:53,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:53,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:53,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:53,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:53,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:53,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:53,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:53,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:53,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:53,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:53,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:53,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:53,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:53,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:53,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:53,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:53,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:53,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:53,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:53,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:53,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:53,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:53,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:53,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:53,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:53,748 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:54:55,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:55,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:55,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:55,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:55,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:55,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:55,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:55,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:55,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:55,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:55,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:55,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:55,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:55,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:55,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:55,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:56,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:56,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:56,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:56,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:56,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:56,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:56,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:56,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:56,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:56,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:56,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:56,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:56,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:56,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:56,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:56,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:56,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:56,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:56,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:56,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:56,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:56,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:56,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:56,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:56,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:56,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:56,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:56,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:56,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:56,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:56,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:56,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:57,750 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:54:58,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:58,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:58,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:58,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:58,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:58,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:58,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:58,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:58,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:58,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:58,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:58,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:58,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:58,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:58,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:58,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:54:59,750 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:55:01,751 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:55:02,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:02,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:03,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:03,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:03,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:03,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:03,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:03,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:03,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:03,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:03,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:03,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:03,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:03,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:03,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:03,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:03,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:03,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:03,752 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:55:03,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:03,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:03,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:03,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:03,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:03,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:03,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:03,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:03,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:03,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:03,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:03,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:03,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:03,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:03,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:03,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:04,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:04,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:04,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:04,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:04,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:04,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:04,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:04,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:04,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:04,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:04,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:04,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:04,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:04,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:04,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:04,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:05,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:05,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:05,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:05,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:05,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:05,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:05,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:05,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:05,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:05,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:05,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:05,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:05,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:05,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:05,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:05,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:05,753 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:55:06,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:06,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:06,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:06,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:06,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:06,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:06,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:06,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:06,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:06,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:06,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:06,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:06,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:06,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:06,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:06,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:06,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:55:06,683 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:55:07,754 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:55:07,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:07,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:07,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:07,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:07,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:07,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:07,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:07,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:08,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:08,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:08,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:08,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:08,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:08,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:08,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:08,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:08,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:08,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:08,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:08,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:08,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:08,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:08,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:08,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:08,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:08,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:08,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:08,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:08,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:08,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:08,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:08,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:09,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:09,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:09,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:09,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:09,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:09,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:09,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:09,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:09,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:09,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:09,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:09,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:09,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:09,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:09,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:09,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:09,755 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:55:10,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:10,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:10,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:10,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:10,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:10,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:10,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:10,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:10,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:10,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:10,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:10,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:10,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:10,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:10,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:10,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:11,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:11,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:11,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:11,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:11,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:11,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:11,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:11,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:11,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:11,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:11,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:11,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:11,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:11,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:11,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:11,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:11,755 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:55:12,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:12,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:12,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:12,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:12,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:12,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:12,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:12,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:12,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:12,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:12,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:12,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:12,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:12,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:12,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:12,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:13,756 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:55:15,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:15,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:15,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:15,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:15,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:15,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:15,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:15,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:15,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:15,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:15,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:15,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:15,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:15,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:15,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:15,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:15,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:15,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:15,757 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:55:15,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:15,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:15,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:15,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:15,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:15,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:15,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:15,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:15,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:15,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:15,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:15,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:15,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:15,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:16,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:16,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:16,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:16,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:16,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:16,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:16,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:16,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:16,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:16,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:16,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:16,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:17,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:17,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:17,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:17,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:17,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:17,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:17,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:17,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:17,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:17,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:17,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:17,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:17,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:17,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:17,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:17,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:17,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:17,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:17,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:17,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:17,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:17,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:17,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:17,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:17,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:17,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:17,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:17,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:17,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:17,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:17,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:17,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:17,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:17,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:17,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:17,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:17,758 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:55:18,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:18,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:18,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:18,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:18,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:18,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:18,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:18,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:18,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:18,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:18,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:18,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:18,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:18,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:18,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:18,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:18,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:18,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:18,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:18,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:18,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:18,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:18,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:18,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:18,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:18,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:18,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:18,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:18,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:18,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:18,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:18,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:19,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:19,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:19,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:19,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:19,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:19,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:19,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:19,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:19,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:19,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:19,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:19,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:19,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:19,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:19,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:19,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:19,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:19,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:19,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:19,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:19,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:19,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:19,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:19,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:19,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:19,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:19,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:19,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:19,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:19,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:19,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:19,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:19,759 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:55:20,289 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:55:20,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:20,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:20,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:20,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:20,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:20,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:20,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:20,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:20,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:20,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:20,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:20,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:20,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:20,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:20,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:20,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:21,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:21,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:21,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:21,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:21,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:21,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:21,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:21,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:21,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:21,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:21,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:21,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:21,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:21,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:21,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:21,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:21,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:55:21,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:55:21,914 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:55:22,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:22,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:22,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:22,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:22,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:22,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:22,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:22,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:22,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:22,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:22,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:22,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:22,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:22,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:22,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:22,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:23,761 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:55:23,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:23,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:23,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:23,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:23,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:23,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:23,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:23,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:23,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:23,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:23,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:23,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:23,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:23,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:23,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:23,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:24,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:24,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:24,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:24,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:24,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:24,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:24,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:24,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:24,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:24,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:24,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:24,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:24,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:24,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:24,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:24,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:25,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:55:25,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:25,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:25,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:25,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:25,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:25,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:25,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:25,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:25,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:25,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:25,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:25,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:25,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:25,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:25,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:25,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:27,763 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:55:28,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:28,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:28,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:28,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:28,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:28,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:28,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:28,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:28,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:28,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:28,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:28,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:28,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:28,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:28,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:28,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:29,763 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:55:30,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:30,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:30,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:30,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:30,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:30,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:30,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:30,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:30,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:30,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:30,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:30,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:30,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:30,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:30,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:30,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:31,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:31,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:31,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:31,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:31,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:31,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:31,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:31,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:31,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:31,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:31,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:31,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:31,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:31,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:31,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:31,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:31,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:31,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:31,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:31,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:31,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:31,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:31,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:31,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:31,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:31,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:31,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:31,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:31,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:31,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:31,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:31,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:31,764 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:55:33,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:33,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:33,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:33,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:33,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:33,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:33,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:33,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:33,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:33,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:33,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:33,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:33,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:33,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:33,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:33,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:33,765 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:55:34,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:34,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:34,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:34,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:34,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:34,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:34,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:34,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:34,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:34,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:34,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:34,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:34,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:34,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:34,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:34,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:34,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:34,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:34,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:34,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:34,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:34,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:34,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:34,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:34,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:34,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:34,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:34,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:34,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:34,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:34,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:34,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:35,766 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:55:37,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:55:37,135 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:55:37,766 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:55:39,767 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:55:40,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:40,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:40,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:40,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:40,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:40,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:40,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:40,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:40,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:40,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:40,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:40,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:40,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:55:40,971 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 18:55:41,164 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 18:55:41,236 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 18:55:41,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 18:55:41,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:55:42,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:55:49,771 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:55:50,374 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:55:52,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:55:52,398 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:55:56,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:56:00,775 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:56:04,777 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:56:08,779 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:56:11,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:56:11,304 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:56:12,780 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:56:16,782 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:56:20,449 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:56:20,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:56:22,785 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:56:26,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:56:26,528 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:56:26,786 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:56:27,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:27,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:27,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:27,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:27,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:27,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:27,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:27,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:27,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:27,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:27,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:27,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:27,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:27,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:27,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:27,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:28,787 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:56:31,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:31,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:31,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:31,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:31,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:31,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:31,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:31,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:31,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:31,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:31,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:31,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:31,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:31,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:31,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:31,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:32,789 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:56:34,790 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:56:38,792 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:56:40,793 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:56:41,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:56:41,753 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:56:42,793 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:56:44,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:44,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:44,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:44,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:44,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:44,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:44,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:44,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:44,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:44,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:44,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:44,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:44,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:44,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:44,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:44,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:44,794 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:56:48,796 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:56:50,524 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:56:50,797 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:56:52,798 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:56:53,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:53,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:53,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:53,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:53,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:53,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:53,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:53,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:53,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:53,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:53,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:53,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:53,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:53,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:53,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:53,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:54,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:54,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:54,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:54,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:54,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:54,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:54,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:54,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:54,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:54,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:54,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:54,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:54,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:54,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:54,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:54,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:54,799 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:56:55,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:55,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:55,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:55,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:55,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:55,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:55,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:55,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:55,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:55,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:55,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:55,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:55,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:55,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:55,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:55,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:55,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:55,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:55,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:55,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:55,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:55,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:55,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:55,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:55,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:55,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:55,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:55,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:55,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:55,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:55,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:55,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:56,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:56:56,979 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:56:57,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:57,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:57,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:57,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:57,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:57,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:57,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:57,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:57,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:57,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:57,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:57,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:57,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:57,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:57,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:57,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:56:58,801 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:57:00,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:00,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:00,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:00,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:00,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:00,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:00,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:00,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:00,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:00,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:00,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:00,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:00,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:00,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:00,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:00,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:00,801 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:57:01,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:01,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:01,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:01,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:01,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:01,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:01,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:01,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:01,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:01,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:01,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:01,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:01,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:01,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:01,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:01,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:02,802 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:57:03,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:03,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:03,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:03,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:03,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:03,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:03,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:03,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:03,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:03,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:03,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:03,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:03,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:03,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:03,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:03,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:04,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:04,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:04,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:04,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:04,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:04,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:04,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:04,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:04,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:04,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:04,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:04,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:04,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:04,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:04,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:04,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:04,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:04,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:04,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:04,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:04,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:04,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:04,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:04,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:04,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:04,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:04,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:04,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:04,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:04,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:04,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:04,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:04,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:57:06,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:06,804 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:57:08,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:08,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:08,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:08,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:08,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:08,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:08,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:08,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:08,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:08,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:08,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:08,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:08,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:08,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:08,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:08,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:08,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:08,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:08,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:08,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:08,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:08,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:08,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:08,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:08,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:08,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:08,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:08,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:08,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:08,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:08,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:08,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:08,805 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:57:09,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:09,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:09,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:09,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:09,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:09,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:09,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:09,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:09,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:09,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:09,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:09,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:09,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:09,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:09,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:09,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:10,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:10,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:10,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:10,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:10,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:10,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:10,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:10,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:10,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:10,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:10,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:10,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:10,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:10,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:10,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:10,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:10,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:10,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:10,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:10,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:10,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:10,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:10,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:10,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:10,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:10,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:10,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:10,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:10,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:10,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:10,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:10,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:10,805 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:57:11,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:11,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:11,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:11,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:11,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:11,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:11,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:11,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:11,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:11,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:11,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:11,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:11,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:11,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:11,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:11,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:12,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:57:12,282 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:57:12,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:57:13,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:13,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:14,807 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:57:15,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:15,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:15,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:15,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:15,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:15,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:15,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:15,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:15,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:15,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:15,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:15,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:15,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:15,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:15,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:15,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:16,808 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:57:16,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:16,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:16,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:16,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:16,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:16,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:16,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:16,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:16,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:16,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:16,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:16,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:16,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:16,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:16,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:16,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:17,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:17,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:17,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:17,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:17,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:17,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:17,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:17,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:17,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:17,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:17,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:17,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:17,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:17,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:17,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:17,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:18,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:18,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:18,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:18,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:18,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:18,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:18,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:18,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:18,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:18,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:18,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:18,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:18,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:18,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:18,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:18,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:18,809 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:57:20,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,599 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:57:20,810 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:57:20,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:20,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:21,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:21,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:21,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:21,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:21,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:21,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:21,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:21,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:21,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:21,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:21,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:21,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:21,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:21,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:21,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:21,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:21,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:21,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:21,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:21,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:21,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:21,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:21,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:21,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:21,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:21,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:21,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:21,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:21,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:21,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:21,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:21,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:22,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:22,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:22,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:22,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:22,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:22,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:22,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:22,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:22,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:22,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:22,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:22,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:22,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:22,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:22,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:22,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:22,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:57:24,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:24,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:24,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:24,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:24,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:24,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:24,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:24,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:24,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:24,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:24,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:24,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:24,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:24,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:24,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:24,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:24,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:57:25,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:25,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:25,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:25,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:25,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:25,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:25,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:25,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:25,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:25,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:25,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:25,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:25,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:25,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:25,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:25,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:25,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:25,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:25,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:25,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:25,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:25,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:25,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:25,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:25,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:25,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:25,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:25,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:25,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:25,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:25,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:25,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:26,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:57:27,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:57:27,666 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:57:28,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:28,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:28,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:28,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:28,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:28,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:28,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:28,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:28,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:28,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:28,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:28,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:28,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:28,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:28,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:28,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:28,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:57:29,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:29,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:29,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:29,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:29,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:29,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:29,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:29,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:29,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:29,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:29,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:29,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:29,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:29,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:29,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:29,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:30,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:30,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:30,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:30,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:30,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:30,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:30,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:30,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:30,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:30,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:30,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:30,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:30,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:30,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:30,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:30,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:30,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:57:31,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:31,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:31,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:31,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:31,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:31,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:31,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:31,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:31,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:31,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:31,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:31,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:31,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:31,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:31,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:31,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:32,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:57:33,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:33,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:34,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:57:35,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:35,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:35,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:35,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:35,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:35,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:35,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:35,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:35,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:35,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:35,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:35,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:35,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:35,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:35,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:35,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:36,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:57:38,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:38,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:38,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:38,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:38,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:57:38,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:38,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:38,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:38,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:38,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:38,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:38,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:38,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:57:40,826 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:57:42,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:57:42,906 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:57:50,673 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:57:50,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:57:56,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:57:58,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:57:58,176 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:58:02,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:58:06,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:58:10,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:58:13,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:58:13,597 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:58:14,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:58:17,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:58:20,739 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:58:21,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:58:25,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:58:27,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:58:28,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:58:28,821 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:58:31,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:58:33,846 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:58:34,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:34,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:34,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:34,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:34,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:34,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:34,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:34,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:34,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:34,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:34,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:34,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:34,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:34,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:34,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:34,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:36,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:36,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:36,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:36,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:36,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:36,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:36,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:36,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:36,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:36,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:36,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:36,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:36,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:36,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:36,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:36,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:37,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:58:39,849 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:58:43,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:58:44,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:58:44,199 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:58:45,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:58:47,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:58:48,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:48,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:48,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:48,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:48,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:48,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:48,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:48,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:48,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:48,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:48,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:48,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:48,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:48,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:48,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:48,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:50,808 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:58:51,854 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:58:53,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:58:55,856 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:58:57,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:58:59,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:58:59,416 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:58:59,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:59,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:59,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:59,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:59,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:59,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:59,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:59,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:59,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:59,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:59,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:59,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:59,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:59,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:59,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:59,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:58:59,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:59:03,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:03,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:03,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:03,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:03,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:03,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:03,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:03,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:03,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:03,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:03,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:03,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:03,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:03,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:03,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:03,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:03,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:59:04,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:04,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:04,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:04,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:04,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:04,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:04,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:04,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:04,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:04,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:04,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:04,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:04,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:04,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:04,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:04,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:05,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:59:06,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:06,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:06,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:06,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:06,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:06,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:06,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:06,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:06,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:06,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:06,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:06,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:06,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:06,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:06,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:06,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:06,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:06,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:06,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:06,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:06,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:06,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:06,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:06,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:06,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:06,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:06,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:06,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:06,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:06,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:06,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:06,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:07,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:07,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:07,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:07,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:07,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:07,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:07,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:07,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:07,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:07,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:07,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:07,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:07,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:07,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:07,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:07,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:07,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:07,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:07,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:07,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:07,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:07,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:07,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:07,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:07,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:07,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:07,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:07,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:07,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:07,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:07,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:07,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:07,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:59:09,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:09,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:09,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:09,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:09,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:09,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:09,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:09,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:09,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:09,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:09,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:09,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:09,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:09,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:09,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:09,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:09,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:59:11,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:11,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:59:12,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:12,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:12,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:12,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:12,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:12,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:12,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:12,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:12,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:12,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:12,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:12,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:12,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:12,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:12,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:12,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:12,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:12,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:12,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:12,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:12,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:12,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:12,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:12,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:12,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:12,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:12,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:12,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:12,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:12,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:12,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:12,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:13,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:13,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:13,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:13,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:13,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:13,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:13,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:13,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:13,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:13,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:13,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:13,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:13,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:13,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:13,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:13,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:13,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:59:14,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:59:14,640 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:59:14,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:14,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:15,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:59:17,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:17,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:17,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:17,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:17,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:17,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:17,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:17,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:17,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:17,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:17,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:17,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:17,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:17,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:17,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:17,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:17,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:59:18,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:18,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:18,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:18,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:18,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:18,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:18,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:18,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:18,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:18,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:18,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:18,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:18,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:18,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:18,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:18,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:19,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:19,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:19,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:19,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:19,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:19,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:19,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:19,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:19,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:19,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:19,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:19,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:19,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:19,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:19,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:19,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:19,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:59:20,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:20,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:20,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:20,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:20,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:20,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:20,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:20,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:20,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:20,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:20,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:20,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:20,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:20,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:20,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:20,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:20,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:20,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:20,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:20,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:20,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:20,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:20,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:20,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:20,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:20,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:20,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:20,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:20,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:20,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:20,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:20,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:20,881 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:59:21,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:21,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:21,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:21,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:21,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:21,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:21,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:21,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:21,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:21,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:21,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:21,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:21,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:21,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:21,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:21,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:21,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:21,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:21,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:21,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:21,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:21,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:21,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:21,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:21,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:21,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:21,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:21,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:21,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:21,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:21,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:21,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:21,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:59:23,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:23,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:23,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:23,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:23,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:23,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:23,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:23,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:23,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:23,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:23,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:23,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:23,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:23,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:23,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:23,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:23,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:59:23,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:23,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:23,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:23,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:24,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:25,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:25,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:25,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:25,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:25,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:25,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:25,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:25,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:25,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:25,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:25,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:25,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:25,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:25,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:25,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:25,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:25,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:59:26,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:26,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:26,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:26,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:26,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:26,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:26,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:26,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:26,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:26,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:26,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:26,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:26,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:26,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:26,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:26,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:27,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:27,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:27,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:27,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:27,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:27,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:27,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:27,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:27,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:27,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:27,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:27,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:27,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:27,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:27,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:27,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:27,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:59:28,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:28,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:28,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:28,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:28,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:28,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:28,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:28,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:28,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:28,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:28,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:28,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:28,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:28,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:28,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:28,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:29,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:29,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:29,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:29,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:29,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:29,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:29,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:29,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:29,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:29,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:29,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:29,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:29,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:29,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:29,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:29,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:29,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:59:29,866 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:59:29,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:59:31,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:31,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:31,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:31,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:31,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:31,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:31,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:31,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:31,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:31,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:31,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:31,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:31,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:31,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:31,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:31,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:31,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:59:31,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:31,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:31,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:31,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:32,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:32,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:32,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:32,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:32,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:32,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:32,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:32,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:32,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:32,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:32,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:32,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:32,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:32,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:32,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:32,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:32,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:32,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:32,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:32,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:32,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:32,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:32,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:32,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:32,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:32,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:32,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:32,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:33,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:59:35,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:35,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:35,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:35,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:35,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:35,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:35,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:35,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:35,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:35,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:35,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:35,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:35,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:35,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:35,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:35,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:35,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:59:36,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:36,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:36,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:36,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:36,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:36,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:36,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:36,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:36,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:36,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:36,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:36,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:36,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:36,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:36,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:36,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:37,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:59:37,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:37,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:37,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:37,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:37,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:37,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:37,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:37,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:37,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:37,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:37,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:37,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:37,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:37,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:37,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:37,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:38,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:38,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:38,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:38,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:38,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:38,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:38,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:38,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:38,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:38,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:38,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:38,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:38,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:38,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:38,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:38,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:39,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:39,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:39,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:39,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:39,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:39,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:39,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:39,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:39,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:39,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:39,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:39,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:39,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:39,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:39,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:39,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:39,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:59:40,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:40,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:41,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:59:42,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:42,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:42,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:42,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:42,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:42,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:42,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:42,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:42,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:42,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:42,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:42,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:43,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 18:59:43,261 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 18:59:43,482 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 18:59:43,554 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 18:59:43,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 18:59:44,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:59:45,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 18:59:45,154 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 18:59:45,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 18:59:50,974 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 18:59:54,882 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:00:00,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:00:00,380 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:00:00,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:00:04,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:00:08,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:00:12,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:00:15,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:00:15,610 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:00:16,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:00:20,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:00:21,060 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:00:24,894 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:00:26,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:00:30,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:00:31,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:00:31,026 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:00:32,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:00:37,900 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:00:39,901 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:00:43,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:00:44,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:00:44,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:00:44,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:00:44,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:00:44,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:00:44,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:00:44,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:00:44,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:00:44,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:00:44,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:00:44,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:00:44,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:00:44,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:00:44,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:00:44,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:00:44,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:00:45,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:00:46,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:00:46,271 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:00:47,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:00:50,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:00:50,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:00:50,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:00:50,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:00:50,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:00:50,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:00:50,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:00:50,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:00:50,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:00:50,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:00:50,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:00:50,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:00:50,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:00:50,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:00:50,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:00:50,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:00:51,135 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:00:51,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:00:53,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:00:55,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:00:57,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:01:01,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:01,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:01,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:01,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:01,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:01,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:01,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:01,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:01,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:01,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:01,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:01,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:01,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:01,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:01,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:01,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:01,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:01:01,753 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:01:01,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:01:03,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:01:05,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:01:07,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:07,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:07,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:07,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:07,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:07,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:07,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:07,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:07,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:07,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:07,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:07,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:07,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:07,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:07,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:07,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:07,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:01:09,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:09,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:09,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:09,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:09,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:09,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:09,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:09,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:09,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:09,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:09,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:09,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:09,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:09,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:09,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:09,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:09,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:01:10,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:10,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:10,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:10,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:10,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:10,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:10,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:10,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:10,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:10,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:10,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:10,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:10,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:10,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:10,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:10,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:11,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:11,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:11,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:11,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:11,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:11,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:11,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:11,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:11,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:11,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:11,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:11,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:11,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:11,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:11,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:11,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:11,916 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:01:12,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:12,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:12,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:12,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:12,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:12,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:12,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:12,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:12,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:12,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:12,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:12,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:12,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:12,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:12,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:12,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:13,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:13,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:13,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:13,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:13,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:13,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:13,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:13,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:13,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:13,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:13,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:13,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:13,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:13,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:13,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:13,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:13,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:01:14,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:14,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:14,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:14,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:14,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:14,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:14,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:14,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:14,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:14,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:14,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:14,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:14,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:14,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:14,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:14,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:15,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:01:17,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:01:17,058 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:01:17,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:17,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:17,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:17,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:17,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:17,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:17,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:17,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:17,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:17,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:17,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:17,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:17,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:17,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:17,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:17,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:17,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:01:18,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:18,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:19,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:19,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:19,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:19,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:19,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:19,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:19,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:19,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:19,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:19,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:19,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:19,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:19,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:19,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:19,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:19,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:19,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:01:20,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:20,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:20,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:20,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:20,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:20,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:20,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:20,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:20,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:20,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:20,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:20,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:20,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:20,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:20,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:20,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:21,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:21,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:21,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:21,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:21,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:21,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:21,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:21,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:21,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:21,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:21,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:21,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:21,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:21,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:21,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:21,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:21,208 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:01:21,927 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:01:22,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:22,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:23,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:23,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:23,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:23,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:23,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:23,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:23,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:23,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:23,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:23,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:23,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:23,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:23,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:23,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:23,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:23,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:23,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:23,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:23,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:23,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:23,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:23,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:23,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:23,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:23,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:23,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:23,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:23,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:23,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:23,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:23,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:23,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:23,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:01:24,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:24,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:24,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:24,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:24,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:24,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:24,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:24,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:24,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:24,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:24,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:24,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:24,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:24,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:24,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:24,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:25,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:01:27,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:27,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:01:28,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:28,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:28,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:28,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:28,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:28,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:28,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:28,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:28,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:28,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:28,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:28,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:28,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:28,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:28,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:28,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:29,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:29,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:29,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:29,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:29,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:29,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:29,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:29,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:29,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:29,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:29,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:29,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:29,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:29,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:29,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:29,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:29,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:01:30,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:30,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:30,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:30,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:30,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:30,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:30,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:30,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:30,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:30,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:30,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:30,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:30,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:30,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:30,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:30,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:30,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:30,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:30,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:30,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:30,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:30,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:30,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:30,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:30,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:30,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:30,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:30,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:30,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:30,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:30,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:30,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:31,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:31,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:31,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:31,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:31,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:31,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:31,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:31,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:31,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:31,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:31,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:31,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:31,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:31,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:31,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:31,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:31,932 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:01:31,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:31,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:31,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:31,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:31,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:31,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:31,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:31,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:31,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:31,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:31,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:31,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:31,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:31,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:31,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:31,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:32,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:32,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:32,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:32,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:32,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:32,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:32,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:32,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:32,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:32,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:32,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:32,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:32,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:32,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:32,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:32,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:32,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:01:32,344 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:01:33,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:01:35,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:35,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:35,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:35,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:35,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:35,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:35,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:35,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:35,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:35,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:35,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:35,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:35,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:35,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:35,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:35,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:35,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:01:36,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:36,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:36,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:36,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:36,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:36,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:36,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:36,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:36,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:36,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:36,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:36,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:36,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:36,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:36,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:36,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:36,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:36,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:36,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:36,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:36,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:36,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:36,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:36,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:36,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:36,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:36,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:36,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:36,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:36,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:36,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:36,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:37,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:37,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:37,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:37,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:37,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:37,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:37,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:37,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:37,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:37,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:37,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:37,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:37,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:37,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:37,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:37,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:37,935 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:01:38,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:38,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:38,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:38,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:38,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:38,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:38,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:38,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:38,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:38,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:38,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:38,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:38,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:38,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:38,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:38,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:39,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:01:40,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:40,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:40,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:40,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:40,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:40,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:40,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:40,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:40,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:40,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:40,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:40,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:40,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:40,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:40,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:40,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:40,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:40,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:40,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:40,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:40,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:40,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:40,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:40,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:40,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:40,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:40,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:40,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:40,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:40,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:40,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:40,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:41,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:41,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:41,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:41,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:41,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:41,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:41,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:41,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:41,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:41,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:41,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:41,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:41,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:41,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:41,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:41,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:41,937 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:01:43,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,938 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:01:43,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:43,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:44,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:44,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:44,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:44,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:44,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:44,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:44,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:44,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:44,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:44,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:44,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:44,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:44,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:44,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:44,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:44,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:44,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:44,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:44,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:44,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:44,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:44,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:44,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:44,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:44,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:44,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:44,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:44,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:01:45,939 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:01:47,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:01:47,571 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:01:51,287 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:01:53,942 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:01:57,943 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:02:02,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:02:02,796 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:02:03,946 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:02:08,948 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:02:10,949 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:02:14,951 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:02:18,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:02:18,052 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:02:18,953 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:02:21,360 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:02:22,955 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:02:24,956 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:02:28,957 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:02:30,958 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:02:33,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:02:33,279 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:02:34,960 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:02:36,961 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:02:40,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:02:42,963 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:02:44,964 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:02:46,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:02:46,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:02:46,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:02:46,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:02:46,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:02:46,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:02:46,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:02:46,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:02:46,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:02:46,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:02:46,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:02:46,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:02:46,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:02:46,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:02:46,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:02:46,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:02:46,965 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:02:48,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:02:48,520 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:02:50,967 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:02:51,431 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:02:51,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:02:51,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:02:51,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:02:51,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:02:51,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:02:51,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:02:51,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:02:51,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:02:51,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:02:51,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:02:51,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:02:51,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:02:51,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:02:51,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:02:51,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:02:51,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:02:52,968 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:02:54,969 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:02:56,970 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:02:58,970 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:03:00,971 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:03:04,973 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:03:05,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:03:05,099 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:03:06,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:06,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:06,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:06,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:06,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:06,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:06,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:06,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:06,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:06,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:06,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:06,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:06,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:06,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:06,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:06,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:06,974 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:03:08,975 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:03:10,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:10,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:10,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:10,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:10,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:10,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:10,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:10,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:10,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:10,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:10,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:10,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:10,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:10,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:10,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:10,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:10,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:10,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:10,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:10,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:10,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:10,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:10,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:10,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:10,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:10,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:10,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:10,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:10,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:10,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:10,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:10,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:10,976 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:03:12,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:12,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:12,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:12,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:12,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:12,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:12,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:12,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:12,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:12,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:12,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:12,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:12,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:12,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:12,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:12,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:12,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:12,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:12,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:12,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:12,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:12,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:12,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:12,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:12,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:12,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:12,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:12,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:12,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:12,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:12,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:12,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:12,977 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:03:14,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:14,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:14,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:14,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:14,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:14,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:14,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:14,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:14,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:14,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:14,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:14,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:14,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:14,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:14,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:14,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:14,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:14,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:14,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:14,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:14,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:14,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:14,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:14,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:14,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:14,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:14,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:14,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:14,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:14,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:14,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:14,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:14,978 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:03:15,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:15,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:15,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:15,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:15,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:15,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:15,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:15,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:15,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:15,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:15,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:15,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:15,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:15,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:15,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:15,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:16,979 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:03:16,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:16,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:16,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:16,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:16,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:16,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:16,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:16,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:16,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:16,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:16,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:17,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:17,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:17,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:17,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:17,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:18,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:18,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:18,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:18,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:18,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:18,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:18,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:18,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:18,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:18,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:18,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:18,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:18,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:18,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:18,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:18,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:18,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:18,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:18,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:18,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:18,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:18,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:18,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:18,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:18,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:18,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:18,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:18,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:18,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:18,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:18,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:18,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:18,980 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:03:20,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:03:20,330 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:03:20,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:20,981 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:03:21,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:21,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:21,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:21,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:21,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:21,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:21,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:21,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:21,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:21,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:21,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:21,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:21,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:21,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:21,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:21,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:21,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:21,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:21,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:21,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:21,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:21,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:21,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:21,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:21,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:21,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:21,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:21,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:21,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:21,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:21,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:21,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:22,982 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:03:23,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:23,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:23,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:23,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:23,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:23,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:23,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:23,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:23,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:23,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:23,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:23,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:23,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:23,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:23,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:23,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:23,480 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:03:24,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:24,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:24,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:24,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:24,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:24,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:24,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:24,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:24,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:24,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:24,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:24,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:24,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:24,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:24,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:24,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:24,983 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:03:26,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:26,983 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:03:27,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:27,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:27,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:27,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:27,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:27,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:27,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:27,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:27,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:27,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:27,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:27,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:27,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:27,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:27,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:27,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:28,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:28,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:28,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:28,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:28,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:28,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:28,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:28,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:28,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:28,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:28,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:28,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:28,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:28,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:28,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:28,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:28,984 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:03:30,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:30,985 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:03:31,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:31,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:31,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:31,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:31,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:31,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:31,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:31,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:31,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:31,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:31,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:31,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:31,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:31,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:31,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:31,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:31,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:31,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:31,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:31,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:31,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:31,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:31,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:31,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:31,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:31,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:31,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:31,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:31,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:31,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:31,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:31,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:32,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:32,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:32,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:32,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:32,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:32,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:32,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:32,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:32,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:32,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:32,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:32,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:32,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:32,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:32,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:32,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:32,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:32,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:32,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:32,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:32,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:32,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:32,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:32,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:32,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:32,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:32,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:32,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:32,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:32,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:32,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:32,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:32,986 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:03:34,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:34,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:34,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:34,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:34,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:34,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:34,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:34,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:34,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:34,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:34,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:34,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:34,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:34,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:34,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:34,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:34,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:34,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:34,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:34,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:34,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:34,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:34,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:34,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:34,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:34,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:34,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:34,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:34,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:34,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:34,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:34,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:34,986 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:03:35,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:35,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:35,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:35,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:35,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:35,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:35,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:35,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:35,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:35,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:35,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:35,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:35,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:35,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:35,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:35,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:35,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:35,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:35,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:35,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:35,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:35,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:35,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:35,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:35,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:35,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:35,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:35,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:35,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:35,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:35,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:35,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:36,987 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:03:37,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:37,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:37,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:37,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:37,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:37,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:37,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:37,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:37,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:37,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:37,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:37,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:37,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:37,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:37,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:37,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:37,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:37,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:37,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:37,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:37,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:37,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:37,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:37,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:37,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:37,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:37,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:37,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:37,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:37,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:37,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:37,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:38,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:38,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:38,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:38,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:38,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:38,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:38,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:38,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:38,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:38,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:38,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:38,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:38,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:38,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:38,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:38,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:38,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:03:38,482 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:03:38,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:03:39,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:39,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:39,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:39,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:39,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:39,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:39,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:39,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:39,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:39,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:39,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:39,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:39,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:39,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:39,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:39,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:40,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:40,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:40,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:40,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:40,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:40,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:40,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:40,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:40,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:40,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:40,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:40,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:40,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:40,426 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 19:03:40,679 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 19:03:40,747 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 19:03:40,989 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 19:03:40,989 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:03:42,990 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:03:45,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:45,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:45,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:45,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:45,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:45,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:45,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:45,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:45,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:45,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:45,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:45,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:45,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:45,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:45,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:45,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:50,992 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:03:51,674 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:03:51,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:51,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:51,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:51,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:51,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:51,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:51,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:51,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:51,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:51,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:51,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:51,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:51,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:51,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:51,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:51,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:53,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:03:53,739 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:03:56,994 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:03:58,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:58,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:58,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:58,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:58,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:58,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:58,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:58,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:58,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:58,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:58,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:58,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:58,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:58,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:58,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:03:58,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:04:00,995 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:04:04,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:04:09,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:04:09,063 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:04:09,998 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:04:13,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:04:16,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:04:20,001 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:04:21,753 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:04:24,003 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:04:24,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:04:24,375 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:04:26,004 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:04:30,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:04:32,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:04:36,007 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:04:38,008 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:04:39,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:04:39,679 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:04:42,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:04:44,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:04:46,012 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:04:46,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:04:46,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:04:46,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:04:46,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:04:46,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:04:46,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:04:46,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:04:46,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:04:46,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:04:46,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:04:46,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:04:46,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:04:46,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:04:46,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:04:46,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:04:46,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:04:48,013 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:04:51,828 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:04:52,014 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:04:53,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:04:53,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:04:53,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:04:53,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:04:53,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:04:53,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:04:53,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:04:53,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:04:53,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:04:53,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:04:53,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:04:53,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:04:53,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:04:53,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:04:53,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:04:53,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:04:54,015 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:04:54,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:04:54,961 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:04:56,015 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:04:58,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:05:00,017 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:05:04,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:05:06,019 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:05:06,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:06,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:06,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:06,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:06,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:06,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:06,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:06,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:06,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:06,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:06,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:06,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:06,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:06,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:06,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:06,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:08,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:05:10,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:05:10,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:05:10,321 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:05:12,021 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:05:13,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:13,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:13,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:13,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:13,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:13,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:13,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:13,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:13,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:13,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:13,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:13,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:13,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:13,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:13,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:13,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:14,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:05:15,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:15,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:15,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:15,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:15,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:15,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:15,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:15,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:15,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:15,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:15,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:15,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:15,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:15,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:15,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:15,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:15,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:15,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:15,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:15,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:15,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:15,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:15,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:15,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:15,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:15,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:15,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:15,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:15,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:15,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:15,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:15,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:16,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:05:16,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:16,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:16,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:16,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:16,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:16,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:16,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:16,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:16,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:16,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:16,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:16,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:16,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:16,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:16,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:16,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:17,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:17,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:17,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:17,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:17,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:17,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:17,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:17,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:17,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:17,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:17,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:17,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:17,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:17,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:17,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:17,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:18,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:05:18,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:18,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:18,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:18,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:18,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:18,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:18,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:18,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:18,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:18,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:18,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:18,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:18,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:18,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:18,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:18,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:19,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:19,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:19,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:19,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:19,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:19,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:19,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:19,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:19,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:19,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:19,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:19,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:19,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:19,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:19,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:19,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:19,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:19,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:19,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:19,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:19,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:19,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:19,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:19,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:19,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:19,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:19,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:19,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:19,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:19,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:19,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:19,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:20,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:05:20,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:20,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:20,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:20,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:20,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:20,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:20,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:20,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:20,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:20,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:20,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:20,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:20,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:20,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:20,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:20,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:21,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:21,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:21,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:21,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:21,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:21,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:21,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:21,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:21,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:21,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:21,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:21,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:21,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:21,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:21,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:21,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:21,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:21,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:21,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:21,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:21,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:21,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:21,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:21,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:21,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:21,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:21,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:21,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:21,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:21,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:21,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:21,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:21,904 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:05:22,025 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:05:23,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:23,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:23,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:23,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:23,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:23,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:23,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:23,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:23,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:23,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:23,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:23,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:23,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:23,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:23,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:23,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:23,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:23,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:23,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:23,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:23,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:23,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:23,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:23,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:23,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:23,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:23,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:23,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:23,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:23,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:23,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:23,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:05:24,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:24,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:25,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:05:25,550 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:05:26,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:05:26,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:26,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:27,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:27,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:27,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:27,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:27,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:27,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:27,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:27,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:27,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:27,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:27,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:27,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:27,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:27,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:27,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:27,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:27,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:27,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:27,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:27,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:27,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:27,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:27,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:27,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:27,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:27,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:27,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:27,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:27,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:27,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:27,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:27,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:28,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:05:28,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:28,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:28,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:28,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:28,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:28,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:28,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:28,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:28,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:28,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:28,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:28,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:28,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:28,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:28,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:28,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:29,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:29,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:29,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:29,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:29,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:29,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:29,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:29,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:29,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:29,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:29,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:29,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:29,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:29,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:29,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:29,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:29,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:29,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:29,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:29,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:29,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:29,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:29,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:29,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:29,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:29,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:29,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:29,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:29,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:29,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:29,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:29,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:30,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:05:30,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:30,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:30,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:30,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:30,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:30,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:30,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:30,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:30,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:30,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:30,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:30,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:30,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:30,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:30,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:30,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:31,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:31,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:31,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:31,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:31,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:31,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:31,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:31,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:31,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:31,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:31,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:31,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:31,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:31,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:31,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:31,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:32,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:32,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:32,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:32,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:32,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:32,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:32,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:32,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:32,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:32,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:32,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:32,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:32,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:32,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:32,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:32,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:33,031 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:05:33,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:33,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:33,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:33,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:33,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:33,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:33,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:33,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:33,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:33,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:33,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:33,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:33,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:33,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:33,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:33,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:34,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:35,032 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:05:35,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:35,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:35,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:35,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:35,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:35,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:35,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:35,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:35,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:35,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:35,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:35,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:35,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:35,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:35,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:35,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:35,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:35,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:35,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:35,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:35,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:35,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:35,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:35,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:35,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:35,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:35,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:35,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:35,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:35,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:35,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:35,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:36,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:36,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:36,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:36,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:36,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:36,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:36,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:36,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:36,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:36,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:36,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:36,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:36,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:36,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:36,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:36,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:37,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:05:37,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:37,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:37,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:37,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:37,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:37,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:37,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:37,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:37,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:37,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:37,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:37,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:37,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:37,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:37,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:37,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:38,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:38,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:38,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:38,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:38,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:38,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:38,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:38,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:38,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:38,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:38,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:38,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:38,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:38,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:38,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:38,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:38,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:38,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:38,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:38,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:38,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:38,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:38,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:38,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:38,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:38,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:38,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:38,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:38,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:38,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:38,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:38,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:39,034 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:05:39,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:39,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:39,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:39,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:39,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:39,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:39,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:39,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:39,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:39,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:39,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:39,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:39,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:39,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:39,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:39,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:39,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:39,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:39,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:39,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:39,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:39,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:39,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:39,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:39,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:39,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:39,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:39,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:39,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:39,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:39,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:39,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:40,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:40,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:40,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:40,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:40,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:40,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:40,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:40,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:40,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:40,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:40,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:40,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:41,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:05:41,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:05:41,136 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:05:43,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:05:44,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:44,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:44,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:44,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:44,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:44,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:44,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:44,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:44,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:44,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:44,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:44,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:44,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:44,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:44,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:44,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:44,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:44,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:44,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:44,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:44,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:44,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:44,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:44,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:44,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:44,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:44,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:44,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:44,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:44,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:44,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:44,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:51,981 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:05:53,041 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:05:53,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:53,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:53,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:53,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:53,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:53,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:53,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:53,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:53,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:53,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:53,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:53,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:53,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:53,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:53,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:53,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:05:56,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:05:56,749 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:05:59,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:06:03,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:06:07,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:06:09,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:09,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:09,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:09,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:09,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:09,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:09,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:09,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:09,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:09,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:09,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:09,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:09,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:09,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:09,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:09,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:09,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:09,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:09,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:09,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:09,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:09,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:09,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:09,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:09,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:09,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:09,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:09,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:09,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:09,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:09,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:09,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:11,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:06:12,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:06:12,237 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:06:15,049 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:06:19,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:06:22,056 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:06:23,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:06:27,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:06:27,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:06:27,582 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:06:29,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:06:33,056 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:06:35,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:06:39,059 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:06:41,059 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:06:42,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:06:42,811 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:06:43,060 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:06:47,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:06:49,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:06:51,063 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:06:52,131 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:06:55,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:06:55,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:55,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:55,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:55,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:55,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:55,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:55,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:55,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:55,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:55,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:55,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:55,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:55,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:55,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:55,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:55,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:57,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:06:57,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:57,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:57,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:57,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:57,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:57,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:57,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:57,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:57,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:57,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:57,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:57,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:57,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:57,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:57,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:57,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:06:58,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:06:58,120 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:06:59,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:07:01,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:07:03,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:07:05,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:07:07,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:07:09,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:07:10,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:10,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:10,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:10,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:10,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:10,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:10,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:10,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:10,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:10,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:10,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:10,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:10,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:10,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:10,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:10,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:11,071 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:07:13,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:07:13,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:07:13,378 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:07:15,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:07:17,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:07:19,074 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:07:20,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:20,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:20,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:20,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:20,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:20,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:20,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:20,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:20,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:20,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:20,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:20,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:20,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:20,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:20,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:20,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:07:21,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:21,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:22,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:22,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:22,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:22,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:22,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:22,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:22,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:22,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:22,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:22,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:22,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:22,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:22,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:22,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:22,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:22,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:22,206 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:07:23,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:07:23,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:23,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:23,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:23,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:23,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:23,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:23,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:23,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:23,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:23,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:23,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:23,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:23,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:23,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:23,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:23,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:23,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:23,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:23,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:23,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:23,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:23,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:23,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:23,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:23,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:23,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:23,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:23,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:23,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:23,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:23,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:23,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:24,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:24,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:24,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:24,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:24,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:24,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:24,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:24,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:24,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:24,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:24,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:24,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:24,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:24,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:24,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:24,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:24,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:24,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:24,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:24,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:24,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:24,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:24,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:24,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:24,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:24,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:24,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:24,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:24,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:24,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:24,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:24,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:07:25,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:25,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:07:27,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:27,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:28,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:07:28,673 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:07:29,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:07:29,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:29,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:30,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:30,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:30,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:30,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:30,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:30,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:30,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:30,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:30,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:30,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:30,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:30,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:30,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:30,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:30,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:30,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:31,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:07:31,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:31,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:31,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:31,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:31,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:31,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:31,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:31,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:31,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:31,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:31,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:31,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:31,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:31,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:31,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:31,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:32,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:32,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:32,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:32,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:32,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:32,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:32,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:32,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:32,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:32,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:32,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:32,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:32,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:32,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:32,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:32,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:33,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:33,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:33,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:33,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:33,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:33,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:33,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:33,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:33,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:33,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:33,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:33,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:33,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:33,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:33,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:33,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:33,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:07:34,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:34,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:34,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:34,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:34,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:34,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:34,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:34,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:34,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:34,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:34,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:34,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:34,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:34,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:34,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:34,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:34,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:34,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:34,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:34,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:34,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:34,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:34,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:34,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:34,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:34,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:34,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:34,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:34,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:34,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:34,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:34,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:35,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:35,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:35,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:35,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:35,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:35,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:35,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:35,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:35,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:35,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:35,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:35,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:35,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:35,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:35,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:35,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:35,081 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:07:36,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:36,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:36,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:36,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:36,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:36,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:36,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:36,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:36,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:36,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:36,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:36,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:36,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:36,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:36,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:36,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:36,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:36,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:36,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:36,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:36,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:36,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:36,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:36,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:36,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:36,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:36,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:36,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:36,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:36,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:36,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:36,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:37,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:07:37,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:37,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:37,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:37,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:37,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:37,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:37,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:37,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:37,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:37,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:37,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:37,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:37,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:37,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:37,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:37,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:38,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:38,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:38,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:38,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:38,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:38,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:38,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:38,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:38,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:38,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:38,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:38,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:38,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:38,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:38,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:38,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:07:39,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:39,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:40,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:41,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:07:41,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:41,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:41,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:41,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:41,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:41,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:41,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:41,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:41,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:41,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:41,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:41,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:41,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:41,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:41,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:41,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:41,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:41,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:41,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:41,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:41,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:41,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:41,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:41,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:41,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:41,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:41,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:41,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:41,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:07:41,723 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 19:07:41,958 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 19:07:42,032 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 19:07:42,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 19:07:43,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:07:44,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:07:44,001 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:07:44,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:07:45,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:07:47,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:07:49,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:07:51,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:07:52,356 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:07:53,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:07:55,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:07:57,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:07:59,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:07:59,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:07:59,227 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:08:01,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:08:03,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:08:05,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:08:07,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:08:09,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:08:12,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:08:14,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:08:14,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:08:14,459 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:08:16,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:08:18,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:08:20,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:08:22,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:08:22,433 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:08:24,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:08:26,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:08:28,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:08:29,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:08:29,677 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:08:30,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:08:32,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:08:34,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:08:36,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:08:38,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:08:40,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:08:42,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:08:44,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:08:44,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:08:44,941 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:08:46,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:08:48,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:08:50,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:08:52,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:08:52,506 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:08:55,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:08:57,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:08:59,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:09:00,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:09:00,266 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:09:01,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:09:03,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:09:05,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:09:07,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:09:09,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:09:11,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:09:13,121 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:09:15,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:09:15,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:09:15,496 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:09:17,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:09:19,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:09:21,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:09:22,580 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:09:23,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:09:25,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:09:27,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:09:29,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:09:30,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:09:30,722 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:09:31,128 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:09:33,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:09:35,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:09:37,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:09:39,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:09:41,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:09:43,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:09:45,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:09:45,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:09:45,945 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:09:47,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:09:49,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:09:51,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:09:52,655 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:09:53,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:09:55,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:09:57,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:09:59,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:10:01,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:10:01,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:10:01,238 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:10:04,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:10:06,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:10:08,142 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:10:10,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:10:12,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:10:14,145 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:10:16,146 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:10:16,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:10:16,464 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:10:18,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:10:20,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:10:22,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:10:22,729 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:10:24,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:10:26,150 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:10:28,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:10:30,152 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:10:31,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:10:31,793 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:10:32,153 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:10:34,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:10:36,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:10:38,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:10:40,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:10:42,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:10:44,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:10:46,159 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:10:47,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:10:47,143 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:10:48,160 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:10:50,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:10:52,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:10:52,802 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:10:54,163 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:10:56,163 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:10:58,164 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:11:00,165 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:11:02,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:11:02,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:11:02,455 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:11:04,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:11:06,168 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:11:08,168 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:11:10,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:11:12,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:11:14,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:11:16,172 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:11:17,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:11:17,679 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:11:18,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:11:20,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:11:22,175 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:11:22,877 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:11:24,175 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:11:26,176 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:11:28,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:11:30,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:11:32,179 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:11:33,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:11:33,023 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:11:34,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:11:37,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:11:39,182 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:11:41,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:11:43,184 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:11:45,185 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:11:47,186 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:11:48,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:11:48,316 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:11:49,187 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:11:51,188 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:11:52,948 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:11:53,189 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:11:55,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:11:57,191 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:11:59,192 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:12:01,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:12:03,194 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:12:03,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:12:03,669 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:12:05,195 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:12:07,196 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:12:09,197 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:12:11,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:12:13,199 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:12:15,200 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:12:17,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:12:19,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:12:19,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:12:19,476 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:12:21,202 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:12:23,025 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:12:23,203 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:12:25,204 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:12:27,205 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:12:29,206 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:12:31,207 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:12:33,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:12:34,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:12:34,785 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:12:35,209 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:12:37,210 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:12:39,211 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:12:41,212 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:12:43,213 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:12:45,213 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:12:47,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:12:49,215 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:12:50,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:12:50,008 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:12:51,216 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:12:53,092 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:12:53,217 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:12:55,218 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:12:57,219 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:12:59,220 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:13:02,221 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:13:04,222 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:13:05,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:13:05,235 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:13:06,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:13:08,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:13:10,224 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:13:12,225 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:13:14,226 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:13:16,227 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:13:18,228 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:13:20,229 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:13:22,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:13:22,099 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:13:22,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:13:23,150 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:13:24,231 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:13:26,232 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:13:28,233 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:13:30,234 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:13:32,235 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:13:34,235 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:13:36,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:13:37,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:13:37,325 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:13:38,237 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:13:40,238 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:13:42,239 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:13:44,240 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:13:46,241 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:13:48,242 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:13:50,243 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:13:52,244 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:13:52,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:13:52,621 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:13:53,226 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:13:54,245 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:13:56,245 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:13:58,246 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:14:00,247 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:14:02,248 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:14:04,249 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:14:06,249 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:14:07,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:14:07,847 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:14:08,250 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:14:10,251 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:14:13,252 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:14:15,253 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:14:17,254 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:14:19,255 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:14:21,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:14:23,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:14:23,147 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:14:23,257 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:14:23,369 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:14:25,258 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:14:27,259 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:14:29,260 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:14:31,261 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:14:33,262 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:14:35,263 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:14:37,263 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:14:38,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:14:38,462 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:14:39,264 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:14:41,265 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:14:43,266 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:14:45,266 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:14:47,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:14:49,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:14:51,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:14:53,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:14:53,378 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:14:53,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:14:53,699 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:14:55,270 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:14:57,271 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:14:59,272 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:15:01,272 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:15:03,273 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:15:05,274 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:15:07,275 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:15:08,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:15:08,925 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:15:09,275 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:15:11,276 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:15:13,277 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:15:15,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:15:17,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:15:19,279 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:15:21,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:15:23,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:15:23,457 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:15:24,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:15:24,424 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:15:25,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:15:27,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:15:29,283 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:15:31,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:15:33,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:15:35,285 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:15:37,286 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:15:39,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:15:39,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:15:39,674 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:15:41,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:15:43,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:15:45,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:15:47,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:15:49,290 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:15:51,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:15:53,292 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:15:53,534 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:15:55,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:15:55,025 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:15:55,292 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:15:57,293 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:15:59,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:16:01,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:16:03,296 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:16:05,297 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:16:08,298 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:16:10,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:16:10,255 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:16:10,299 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:16:12,300 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:16:14,301 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:16:16,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:16:18,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:16:20,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:16:22,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:16:23,600 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:16:24,306 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:16:25,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:16:25,478 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:16:26,306 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:16:28,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:16:30,308 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:16:32,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:16:34,310 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:16:36,311 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:16:38,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:16:40,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:16:40,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:16:40,804 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:16:42,313 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:16:44,314 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:16:46,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:16:48,316 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:16:50,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:16:52,318 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:16:53,673 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:16:54,319 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:16:56,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:16:56,233 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:16:56,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:16:58,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:17:00,321 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:17:02,322 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:17:04,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:17:06,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:17:08,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:17:10,326 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:17:11,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:17:11,533 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:17:12,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:17:14,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:17:16,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:17:18,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:17:20,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:17:22,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:17:23,745 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:17:24,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:17:26,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:17:26,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:17:26,833 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:17:28,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:17:30,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:17:32,335 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:17:34,335 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:17:36,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:17:38,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:17:40,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:17:42,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:17:42,062 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:17:42,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:17:44,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:17:46,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:17:49,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:17:51,342 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:17:53,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:17:53,821 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:17:55,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:17:57,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:17:57,287 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:17:57,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:17:59,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:18:01,346 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:18:03,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:18:05,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:18:07,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:18:09,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:18:11,350 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:18:12,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:18:12,521 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:18:13,350 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:18:15,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:18:17,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:18:19,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:18:21,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:18:23,354 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:18:23,899 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:18:25,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:18:27,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:18:27,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:18:27,781 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:18:29,356 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:18:31,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:18:33,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:18:35,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:18:37,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:18:39,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:18:41,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:18:43,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:18:43,115 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:18:43,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:18:45,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:18:47,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:18:49,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:18:51,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:18:53,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:18:53,974 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:18:55,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:18:57,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:18:58,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:18:58,339 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:18:59,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:19:01,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:19:03,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:19:05,371 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:19:08,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:19:10,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:19:12,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:19:13,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:19:13,619 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:19:14,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:19:16,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:19:18,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:19:20,376 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:19:22,377 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:19:24,051 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:19:24,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:19:26,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:19:28,379 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:19:28,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:19:28,844 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:19:30,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:19:32,381 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:19:34,382 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:19:36,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:19:38,384 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:19:40,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:19:42,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:19:44,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:19:44,190 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:19:44,386 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:19:46,387 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:19:48,388 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:19:50,389 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:19:52,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:19:54,124 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:19:54,391 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:19:56,391 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:19:58,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:19:59,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:19:59,412 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:20:01,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:20:03,395 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:20:05,396 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:20:07,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:20:09,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:20:11,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:20:13,399 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:20:14,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:20:14,737 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:20:15,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:20:17,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:20:19,402 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:20:21,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:20:23,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:20:24,200 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:20:25,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:20:27,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:20:29,406 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:20:30,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:20:30,033 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:20:31,407 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:20:33,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:20:35,409 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:20:37,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:20:39,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:20:41,411 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:20:43,412 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:20:45,413 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:20:45,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:20:45,478 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:20:47,413 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:20:49,414 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:20:51,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:20:53,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:20:54,274 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:20:55,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:20:57,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:20:59,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:21:00,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:21:00,701 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:21:01,419 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:21:03,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:21:05,421 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:21:07,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:21:09,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:21:11,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:21:13,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:21:16,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:21:16,126 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:21:16,425 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:21:18,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:21:20,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:21:22,427 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:21:24,348 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:21:24,428 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:21:26,428 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:21:28,429 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:21:30,430 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:21:31,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:21:31,517 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:21:32,430 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:21:34,431 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:21:36,432 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:21:38,434 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:21:40,434 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:21:42,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:21:44,436 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:21:46,436 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:21:46,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:21:46,897 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:21:48,437 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:21:50,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:21:52,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:21:54,425 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:21:54,439 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:21:56,440 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:21:58,440 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:22:00,441 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:22:02,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:22:02,127 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:22:02,442 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:22:04,443 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:22:06,443 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:22:08,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:22:10,445 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:22:12,446 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:22:14,447 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:22:16,448 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:22:17,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:22:17,503 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:22:18,449 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:22:20,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:22:22,451 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:22:24,499 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:22:25,452 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:22:27,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:22:29,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:22:31,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:22:32,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:22:32,728 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:22:33,455 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:22:35,456 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:22:37,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:22:39,458 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:22:41,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:22:43,460 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:22:45,464 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:22:47,465 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:22:47,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:22:47,998 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:22:49,466 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:22:51,467 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:22:53,467 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:22:54,578 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:22:55,468 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:22:57,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:22:59,470 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:23:01,471 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:23:03,472 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:23:03,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:23:03,696 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:23:05,473 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:23:07,474 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:23:09,475 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:23:11,476 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:23:13,477 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:23:15,478 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:23:18,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:23:19,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:23:19,103 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:23:20,480 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:23:22,481 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:23:24,482 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:23:24,652 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:23:26,483 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:23:28,484 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:23:30,485 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:23:32,486 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:23:34,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:23:34,332 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:23:34,487 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:23:36,488 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:23:38,489 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:23:40,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:23:42,491 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:23:44,493 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:23:46,494 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:23:48,494 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:23:49,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:23:49,627 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:23:50,495 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:23:52,496 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:23:54,497 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:23:54,725 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:23:56,498 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:23:58,499 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:24:00,501 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:24:02,502 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:24:04,502 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:24:04,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:24:04,859 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:24:06,503 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:24:08,504 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:24:10,506 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:24:12,506 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:24:14,507 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:24:16,508 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:24:18,509 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:24:20,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:24:20,293 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:24:20,510 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:24:22,511 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:24:24,512 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:24:24,803 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:24:26,514 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:24:28,514 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:24:30,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:24:32,516 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:24:34,517 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:24:35,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:24:35,542 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:24:36,518 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:24:38,519 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:24:40,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:24:42,521 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:24:44,522 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:24:46,523 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:24:49,524 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:24:50,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:24:50,767 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:24:51,524 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:24:53,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:24:54,879 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:24:55,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:24:57,526 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:24:59,527 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:25:01,528 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:25:03,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:25:05,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:25:07,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:25:07,089 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:25:07,530 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:25:09,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:25:11,532 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:25:13,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:25:15,534 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:25:17,535 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:25:19,536 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:25:21,537 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:25:22,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:25:22,473 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:25:23,537 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:25:24,956 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:25:25,538 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:25:27,539 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:25:29,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:25:31,541 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:25:33,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:25:35,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:25:37,543 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:25:37,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:25:37,776 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:25:39,544 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:25:41,545 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:25:43,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:25:45,547 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:25:47,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:25:49,549 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:25:51,550 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:25:53,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:25:53,027 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:25:53,551 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:25:55,031 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:25:55,552 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:25:57,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:25:59,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:26:01,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:26:03,555 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:26:05,556 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:26:07,556 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:26:08,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:26:08,260 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:26:09,557 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:26:12,559 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:26:14,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:26:16,561 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:26:18,562 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:26:20,562 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:26:22,563 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:26:23,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:26:23,748 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:26:24,564 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:26:25,109 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:26:26,565 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:26:28,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:26:30,567 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:26:32,568 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:26:34,569 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:26:36,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:26:38,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:26:38,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:26:38,983 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:26:40,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:26:42,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:26:44,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:26:46,574 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:26:48,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:26:50,576 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:26:52,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:26:54,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:26:54,330 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:26:54,578 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:26:55,184 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:26:56,579 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:26:58,580 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:27:00,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:27:02,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:27:04,583 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:27:06,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:27:08,585 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:27:09,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:27:09,614 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:27:10,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:27:12,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:27:14,587 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:27:16,588 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:27:18,589 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:27:21,590 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:27:23,591 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:27:24,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:27:24,836 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:27:25,255 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:27:25,592 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:27:27,592 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:27:29,593 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:27:31,594 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:27:33,595 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:27:35,596 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:27:37,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:27:39,598 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:27:40,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:27:40,335 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:27:41,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:27:43,601 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:27:45,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:27:47,603 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:27:49,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:27:51,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:27:53,605 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:27:55,323 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:27:55,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:27:55,601 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:27:55,607 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:27:57,608 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:27:59,608 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:28:01,609 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:28:03,610 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:28:05,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:28:07,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:28:09,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:28:10,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:28:10,877 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:28:11,613 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:28:13,614 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:28:15,615 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:28:17,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:28:19,617 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:28:21,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:28:23,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:28:25,400 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:28:25,619 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:28:26,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:28:26,174 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:28:27,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:28:29,621 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:28:31,622 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:28:33,623 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:28:36,624 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:28:38,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:28:40,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:28:41,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:28:41,397 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:28:42,626 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:28:44,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:28:46,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:28:48,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:28:50,629 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:28:52,629 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:28:54,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:28:55,469 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:28:56,631 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:28:56,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:28:56,729 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:28:58,632 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:29:00,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:29:02,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:29:04,634 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:29:06,635 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:29:08,636 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:29:10,636 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:29:12,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:29:12,028 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:29:12,637 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:29:14,638 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:29:16,639 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:29:18,639 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:29:20,640 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:29:22,641 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:29:24,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:29:25,543 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:29:26,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:29:27,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:29:27,271 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:29:28,643 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:29:30,644 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:29:32,644 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:29:34,645 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:29:36,646 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:29:38,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:29:40,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:29:42,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:29:42,553 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:29:42,648 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:29:44,649 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:29:46,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:29:48,651 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:29:50,652 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:29:52,652 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:29:54,653 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:29:55,617 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:29:57,654 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:29:57,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:29:57,778 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:29:59,655 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:30:01,655 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:30:03,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:30:05,657 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:30:07,658 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:30:09,659 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:30:11,660 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:30:13,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:30:13,135 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:30:13,661 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:30:15,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:30:17,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:30:19,663 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:30:21,664 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:30:23,665 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:30:25,666 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:30:25,692 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:30:27,667 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:30:28,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:30:28,367 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:30:29,667 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:30:31,668 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:30:33,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:30:35,670 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:30:37,671 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:30:39,672 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:30:41,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:30:43,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:30:43,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:30:43,695 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:30:45,674 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:30:47,675 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:30:49,676 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:30:51,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:30:53,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:30:55,678 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:30:55,766 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:30:57,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:30:59,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:30:59,035 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:30:59,680 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:31:01,680 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:31:03,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:31:05,682 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:31:07,682 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:31:09,683 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:31:11,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:31:13,685 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:31:14,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:31:14,364 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:31:15,685 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:31:17,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:31:19,687 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:31:21,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:31:23,689 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:31:25,690 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:31:25,840 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:31:27,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:31:29,692 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:31:29,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:31:29,720 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:31:32,693 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:31:34,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:31:36,695 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:31:38,696 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:31:40,697 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:31:42,698 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:31:44,699 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:31:44,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:31:44,951 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:31:46,700 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:31:48,701 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:31:50,702 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:31:52,703 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:31:54,704 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:31:55,916 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:31:56,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:31:58,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:32:00,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:32:00,308 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:32:00,706 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:32:02,707 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:32:04,708 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:32:06,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:32:08,710 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:32:10,711 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:32:12,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:32:14,713 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:32:15,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:32:15,590 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:32:16,714 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:32:18,715 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:32:20,716 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:32:22,717 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:32:24,717 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:32:25,993 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:32:26,718 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:32:28,719 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:32:30,720 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:32:30,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:32:30,826 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:32:32,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:32:34,722 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:32:36,723 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:32:38,724 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:32:40,724 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:32:42,725 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:32:44,726 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:32:46,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:32:46,045 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:32:46,727 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:32:48,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:32:50,729 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:32:52,730 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:32:54,730 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:32:56,069 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:32:56,731 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:32:58,732 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:33:00,733 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:33:01,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:33:01,304 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:33:02,734 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:33:04,735 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:33:06,736 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:33:08,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:33:10,738 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:33:12,738 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:33:14,739 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:33:16,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:33:16,712 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:33:16,740 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:33:18,741 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:33:20,742 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:33:22,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:33:24,744 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:33:26,136 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:33:27,745 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:33:29,746 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:33:31,747 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:33:31,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:33:31,968 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:33:33,748 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:33:35,748 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:33:37,749 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:33:39,750 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:33:41,751 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:33:43,752 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:33:45,753 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:33:47,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:33:47,204 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:33:47,754 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:33:49,754 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:33:51,755 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:33:53,756 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:33:55,757 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:33:56,197 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:33:57,758 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:33:59,759 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:34:01,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:34:02,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:34:02,427 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:34:03,761 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:34:05,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:34:07,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:34:09,763 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:34:11,764 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:34:13,765 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:34:15,766 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:34:17,767 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:34:17,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:34:17,844 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:34:19,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:34:21,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:34:23,769 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:34:25,770 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:34:26,273 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:34:27,771 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:34:30,772 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:34:32,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:34:33,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:34:33,065 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:34:34,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:34:36,775 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:34:38,776 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:34:40,777 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:34:42,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:34:44,779 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:34:46,780 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:34:48,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:34:48,319 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:34:48,780 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:34:50,781 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:34:52,782 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:34:54,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:34:56,350 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:34:56,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:34:58,785 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:35:00,786 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:35:02,787 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:35:03,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:35:03,636 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:35:04,788 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:35:06,788 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:35:08,789 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:35:10,790 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:35:12,790 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:35:14,791 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:35:16,792 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:35:18,793 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:35:19,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:35:19,023 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:35:20,794 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:35:22,795 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:35:24,795 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:35:26,425 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:35:26,796 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:35:28,797 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:35:30,798 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:35:32,799 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:35:34,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:35:34,320 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:35:34,800 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:35:36,801 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:35:38,802 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:35:40,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:35:42,804 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:35:44,804 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:35:46,805 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:35:48,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:35:49,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:35:49,540 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:35:50,807 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:35:52,807 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:35:54,808 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:35:56,498 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:35:56,809 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:35:58,810 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:36:00,810 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:36:02,811 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:36:04,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:36:05,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:36:05,068 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:36:06,813 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:36:09,814 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:36:11,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:36:13,816 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:36:15,816 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:36:17,817 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:36:19,817 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:36:20,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:36:20,556 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:36:21,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:36:23,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:36:25,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:36:26,577 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:36:27,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:36:29,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:36:31,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:36:33,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:36:35,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:36:35,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:36:35,854 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:36:37,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:36:39,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:36:41,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:36:43,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:36:45,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:36:47,826 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:36:50,826 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:36:51,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:36:51,082 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:36:52,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:36:54,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:36:56,650 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:36:56,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:36:58,829 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:37:00,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:37:02,831 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:37:04,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:37:06,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:37:06,435 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:37:06,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:37:08,833 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:37:10,834 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:37:12,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:37:14,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:37:16,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:37:18,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:37:20,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:37:21,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:37:21,730 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:37:22,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:37:24,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:37:26,728 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:37:26,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:37:28,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:37:30,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:37:32,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:37:34,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:37:36,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:37:36,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:37:36,971 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:37:38,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:37:40,846 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:37:42,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:37:44,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:37:46,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:37:48,849 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:37:50,850 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:37:52,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:37:52,348 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:37:52,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:37:54,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:37:56,800 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:37:56,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:37:58,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:38:00,854 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:38:02,854 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:38:04,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:38:06,856 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:38:07,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:38:07,734 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:38:08,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:38:10,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:38:13,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:38:15,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:38:17,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:38:19,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:38:21,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:38:22,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:38:22,959 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:38:23,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:38:25,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:38:26,870 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:38:27,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:38:29,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:38:31,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:38:33,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:38:35,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:38:37,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:38:38,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:38:38,182 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:38:39,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:38:41,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:38:43,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:38:45,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:38:48,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:38:50,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:38:52,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:38:53,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:38:53,544 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:38:54,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:38:56,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:38:56,942 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:38:58,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:39:00,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:39:02,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:39:04,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:39:06,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:39:08,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:39:08,865 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:39:08,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:39:10,882 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:39:12,882 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:39:14,883 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:39:16,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:39:18,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:39:20,885 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:39:22,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:39:24,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:39:24,089 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:39:24,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:39:26,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:39:27,017 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:39:28,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:39:30,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:39:32,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:39:34,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:39:36,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:39:38,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:39:39,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:39:39,317 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:39:40,894 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:39:42,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:39:45,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:39:47,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:39:49,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:39:51,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:39:53,900 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:39:54,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:39:54,692 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:39:55,901 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:39:57,093 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:39:57,902 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:39:59,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:40:01,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:40:03,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:40:05,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:40:07,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:40:09,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:40:09,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:40:09,945 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:40:11,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:40:13,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:40:15,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:40:17,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:40:19,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:40:21,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:40:23,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:40:25,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:40:25,164 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:40:25,916 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:40:27,174 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:40:27,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:40:29,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:40:31,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:40:33,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:40:35,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:40:37,921 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:40:39,922 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:40:40,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:40:40,478 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:40:41,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:40:43,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:40:45,925 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:40:47,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:40:49,927 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:40:51,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:40:53,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:40:55,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:40:55,703 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:40:55,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:40:57,251 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:40:57,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:40:59,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:41:01,932 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:41:03,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:41:05,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:41:07,935 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:41:09,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:41:10,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:41:10,943 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:41:11,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:41:13,937 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:41:15,938 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:41:17,939 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:41:19,940 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:41:21,941 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:41:24,942 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:41:26,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:41:26,260 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:41:26,943 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:41:27,326 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:41:28,944 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:41:30,945 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:41:32,945 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:41:34,946 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:41:36,947 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:41:38,948 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:41:40,948 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:41:41,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:41:41,489 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:41:42,949 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:41:44,950 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:41:46,950 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:41:48,951 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:41:50,952 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:41:52,953 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:41:54,954 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:41:56,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:41:56,940 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:41:56,955 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:41:57,401 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:41:58,956 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:42:00,956 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:42:02,957 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:42:04,958 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:42:06,959 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:42:08,960 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:42:10,960 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:42:12,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:42:12,250 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:42:12,961 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:42:14,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:42:16,963 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:42:18,964 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:42:20,965 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:42:23,966 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:42:25,967 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:42:27,477 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:42:27,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:42:27,491 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:42:27,968 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:42:29,969 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:42:31,970 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:42:33,971 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:42:35,972 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:42:37,973 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:42:39,974 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:42:41,975 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:42:42,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:42:42,719 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:42:43,976 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:42:45,976 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:42:47,977 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:42:49,978 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:42:51,979 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:42:53,980 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:42:55,981 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:42:57,552 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:42:57,982 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:42:57,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:42:57,982 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:42:59,983 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:43:01,984 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:43:03,985 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:43:05,986 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:43:07,986 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:43:09,987 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:43:11,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:43:13,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:43:13,325 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:43:13,989 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:43:15,990 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:43:17,991 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:43:19,992 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:43:21,993 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:43:23,994 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:43:25,995 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:43:27,620 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:43:27,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:43:28,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:43:28,643 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:43:29,997 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:43:31,998 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:43:33,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:43:36,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:43:38,001 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:43:40,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:43:42,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:43:44,003 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:43:44,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:43:44,051 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:43:46,004 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:43:48,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:43:51,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:43:53,007 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:43:55,008 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:43:57,009 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:43:57,691 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:43:59,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:43:59,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:43:59,336 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:44:01,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:44:03,012 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:44:05,013 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:44:07,014 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:44:09,015 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:44:11,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:44:13,017 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:44:14,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:44:14,639 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:44:15,017 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:44:17,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:44:19,019 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:44:21,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:44:23,021 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:44:25,021 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:44:27,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:44:27,766 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:44:29,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:44:29,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:44:29,973 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:44:31,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:44:33,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:44:35,025 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:44:37,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:44:39,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:44:41,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:44:43,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:44:45,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:44:45,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:44:45,330 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:44:47,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:44:49,031 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:44:51,032 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:44:53,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:44:55,034 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:44:57,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:44:57,844 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:44:59,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:45:00,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:45:00,777 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:45:01,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:45:03,038 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:45:05,038 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:45:07,039 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:45:09,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:45:11,041 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:45:13,042 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:45:15,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:45:16,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:45:16,005 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:45:17,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:45:19,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:45:21,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:45:23,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:45:25,047 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:45:27,921 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:45:28,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:45:30,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:45:31,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:45:31,377 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:45:32,049 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:45:34,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:45:36,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:45:38,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:45:40,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:45:42,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:45:44,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:45:46,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:45:46,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:45:46,603 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:45:48,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:45:50,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:45:52,056 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:45:54,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:45:56,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:45:57,999 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:45:58,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:46:00,059 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:46:01,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:46:01,829 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:46:02,060 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:46:04,060 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:46:06,061 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:46:08,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:46:10,063 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:46:12,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:46:14,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:46:16,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:46:17,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:46:17,077 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:46:18,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:46:20,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:46:22,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:46:24,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:46:26,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:46:28,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:46:28,072 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:46:30,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:46:32,071 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:46:32,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:46:32,304 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:46:34,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:46:36,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:46:38,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:46:40,074 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:46:42,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:46:44,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:46:46,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:46:47,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:46:47,635 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:46:48,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:46:50,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:46:52,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:46:54,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:46:56,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:46:58,081 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:46:58,137 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:47:00,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:47:02,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:47:02,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:47:02,947 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:47:05,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:47:07,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:47:09,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:47:11,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:47:13,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:47:15,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:47:17,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:47:18,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:47:18,198 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:47:19,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:47:21,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:47:23,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:47:25,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:47:27,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:47:28,202 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:47:29,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:47:31,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:47:33,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:47:33,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:47:33,551 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:47:35,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:47:37,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:47:39,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:47:41,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:47:43,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:47:45,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:47:47,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:47:48,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:47:49,000 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:47:49,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:47:51,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:47:53,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:47:55,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:47:57,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:47:58,268 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:47:59,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:48:01,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:48:03,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:48:04,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:48:04,287 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:48:05,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:48:07,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:48:09,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:48:11,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:48:13,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:48:15,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:48:17,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:48:19,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:48:19,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:48:19,578 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:48:21,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:48:23,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:48:25,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:48:27,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:48:28,336 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:48:29,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:48:31,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:48:33,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:48:34,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:48:34,940 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:48:35,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:48:38,121 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:48:40,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:48:42,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:48:44,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:48:46,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:48:48,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:48:50,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:48:50,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:48:50,164 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:48:52,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:48:54,128 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:48:56,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:48:58,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:48:58,401 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:49:00,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:49:02,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:49:04,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:49:05,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:49:05,388 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:49:06,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:49:08,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:49:10,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:49:12,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:49:14,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:49:16,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:49:18,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:49:20,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:49:20,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:49:20,882 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:49:22,140 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:49:24,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:49:26,142 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:49:28,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:49:28,462 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:49:30,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:49:32,145 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:49:34,146 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:49:36,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:49:36,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:49:36,179 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:49:38,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:49:40,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:49:42,150 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:49:45,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:49:47,152 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:49:49,153 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:49:51,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:49:51,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:49:51,501 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:49:53,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:49:55,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:49:57,157 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:49:58,602 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:49:59,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:50:01,159 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:50:03,160 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:50:05,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:50:06,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:50:06,784 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:50:07,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:50:09,163 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:50:11,163 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:50:13,164 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:50:15,165 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:50:17,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:50:19,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:50:21,168 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:50:22,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:50:22,110 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:50:23,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:50:25,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:50:27,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:50:28,616 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:50:29,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:50:31,172 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:50:33,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:50:35,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:50:37,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:50:37,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:50:37,352 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:50:40,176 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:50:42,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:50:44,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:50:46,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:50:48,179 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:50:50,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:50:52,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:50:52,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:50:52,582 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:50:54,182 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:50:56,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:50:58,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:50:58,693 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:51:00,184 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:51:02,185 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:51:04,186 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:51:06,187 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:51:07,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:51:07,915 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:51:08,187 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:51:10,188 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:51:12,189 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:51:14,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:51:16,191 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:51:18,192 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:51:20,192 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:51:22,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:51:23,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:51:23,140 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:51:24,194 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:51:26,195 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:51:28,196 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:51:28,768 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:51:30,197 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:51:32,197 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:51:34,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:51:36,199 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:51:38,200 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:51:38,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:51:38,373 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:51:40,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:51:42,202 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:51:53,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:51:53,598 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:51:58,836 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:52:08,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:52:08,961 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:52:24,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:52:24,451 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:52:28,910 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:52:39,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:52:39,724 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:52:42,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:52:45,225 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:52:53,228 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:52:59,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:53:04,120 ERROR SenderThread:1049978 [internal_api.py:execute():143] 500 response executing GraphQL. 2022-05-23 19:53:04,121 ERROR SenderThread:1049978 [internal_api.py:execute():144] {"error":"Error 1040: Too many connections"} 2022-05-23 19:53:04,122 ERROR SenderThread:1049978 [retry.py:__call__():126] Retry attempt failed: Traceback (most recent call last): File "/mnt/lv_ai_1_dante/ml/rolvb/venv/lib/python3.9/site-packages/wandb/sdk/lib/retry.py", line 102, in __call__ result = self._call_fn(*args, **kwargs) File "/mnt/lv_ai_1_dante/ml/rolvb/venv/lib/python3.9/site-packages/wandb/sdk/internal/internal_api.py", line 140, in execute return self.client.execute(*args, **kwargs) File "/mnt/lv_ai_1_dante/ml/rolvb/venv/lib/python3.9/site-packages/wandb/vendor/gql-0.2.0/wandb_gql/client.py", line 52, in execute result = self._get_result(document, *args, **kwargs) File "/mnt/lv_ai_1_dante/ml/rolvb/venv/lib/python3.9/site-packages/wandb/vendor/gql-0.2.0/wandb_gql/client.py", line 60, in _get_result return self.transport.execute(document, *args, **kwargs) File "/mnt/lv_ai_1_dante/ml/rolvb/venv/lib/python3.9/site-packages/wandb/vendor/gql-0.2.0/wandb_gql/transport/requests.py", line 39, in execute request.raise_for_status() File "/mnt/lv_ai_1_dante/ml/rolvb/venv/lib/python3.9/site-packages/requests/models.py", line 960, in raise_for_status raise HTTPError(http_error_msg, response=self) requests.exceptions.HTTPError: 500 Server Error: Internal Server Error for url: https://api.wandb.ai/graphql 2022-05-23 19:53:11,354 ERROR SenderThread:1049978 [internal_api.py:execute():143] 500 response executing GraphQL. 2022-05-23 19:53:11,354 ERROR SenderThread:1049978 [internal_api.py:execute():144] {"error":"Error 1040: Too many connections"} 2022-05-23 19:53:13,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:53:19,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:53:23,195 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 19:53:23,196 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 19:53:23,391 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 19:53:23,393 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:53:23,394 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:53:24,096 WARNING FileStreamThread:1049978 [file_stream.py:request_with_retry():593] requests_with_retry encountered retryable exception: 500 Server Error: Internal Server Error for url: https://api.wandb.ai/files/nbailab/wav2vec2/3dybzmyz/file_stream. func: >, args: ('https://api.wandb.ai/files/nbailab/wav2vec2/3dybzmyz/file_stream',), kwargs: {'json': {'files': {'wandb-events.jsonl': {'offset': 958, 'content': ['{"system.cpu": 4.47, "system.memory": 9.2, "system.disk": 68.3, "system.proc.memory.availableMB": 203687.52, "system.proc.memory.rssMB": 105.55, "system.proc.memory.percent": 0.05, "system.proc.cpu.threads": 12.0, "system.network.sent": 36563311900, "system.network.recv": 419729847, "_wandb": true, "_timestamp": 1653328348, "_runtime": 28843}']}}, 'dropped': 0}} 2022-05-23 19:53:24,276 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 19:53:24,786 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:53:29,093 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:53:39,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:53:39,791 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:53:57,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:53:57,017 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:53:59,168 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:54:12,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:54:12,685 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:54:28,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:54:28,156 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:54:29,243 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:54:43,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:54:43,761 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:54:58,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:54:58,985 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:54:59,322 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:55:14,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:55:14,213 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:55:29,396 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:55:29,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:55:29,624 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:55:46,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:55:46,883 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:55:59,475 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:56:02,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:56:02,114 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:56:17,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:56:17,703 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:56:29,552 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:56:32,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:56:32,924 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:56:48,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:56:48,180 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:56:59,628 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:57:04,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:57:04,789 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:57:07,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:57:09,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:57:16,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:16,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:16,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:16,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:16,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:16,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:16,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:16,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:16,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:16,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:16,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:16,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:16,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:16,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:16,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:16,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:19,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:57:20,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:57:20,068 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:57:23,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:57:27,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:27,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:27,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:27,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:27,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:27,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:27,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:27,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:27,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:27,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:27,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:27,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:27,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:27,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:27,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:27,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:27,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:57:29,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:29,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:29,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:29,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:29,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:29,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:29,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:29,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:29,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:29,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:29,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:29,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:29,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:29,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:29,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:29,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:29,698 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:57:31,377 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:57:35,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:57:35,283 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:57:35,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:35,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:35,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:35,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:35,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:35,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:35,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:35,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:35,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:35,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:35,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:35,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:35,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:35,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:35,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:35,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:35,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:57:38,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:38,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:38,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:38,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:38,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:38,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:38,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:38,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:38,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:38,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:38,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:38,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:38,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:38,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:38,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:38,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:39,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:57:41,381 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:57:45,382 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:57:45,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:45,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:45,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:45,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:45,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:45,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:45,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:45,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:45,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:45,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:45,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:45,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:45,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:45,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:45,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:45,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:57:49,384 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:57:50,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:57:50,562 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:57:51,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:57:55,386 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:57:57,387 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:57:59,773 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:58:02,389 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:58:04,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:58:05,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:58:05,901 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:58:06,391 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:58:08,391 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:58:12,393 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:58:14,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:58:16,395 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:58:18,396 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:58:20,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:20,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:20,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:20,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:20,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:20,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:20,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:20,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:20,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:20,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:20,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:20,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:20,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:20,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:20,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:20,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:21,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:58:21,231 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:58:22,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:58:24,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:58:26,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:26,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:26,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:26,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:26,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:26,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:26,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:26,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:26,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:26,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:26,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:26,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:26,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:26,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:26,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:26,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:26,399 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:58:28,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:58:29,845 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:58:30,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:58:32,402 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:58:34,402 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:58:36,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:58:36,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:58:36,457 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:58:37,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:37,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:37,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:37,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:37,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:37,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:37,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:37,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:37,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:37,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:37,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:37,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:37,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:37,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:37,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:37,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:38,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:58:40,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:58:42,406 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:58:44,407 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:58:45,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:45,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:45,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:45,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:45,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:45,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:45,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:45,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:45,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:45,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:45,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:45,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:45,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:45,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:45,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:45,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:46,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:46,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:46,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:46,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:46,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:46,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:46,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:46,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:46,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:46,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:46,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:46,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:46,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:46,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:46,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:46,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:46,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:46,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:46,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:46,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:46,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:46,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:46,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:46,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:46,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:46,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:46,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:46,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:46,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:46,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:46,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:46,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:46,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:58:47,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:47,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:47,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:47,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:47,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:47,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:47,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:47,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:47,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:47,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:47,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:47,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:47,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:47,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:47,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:47,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:48,409 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:58:48,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:48,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:48,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:48,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:48,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:48,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:48,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:48,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:48,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:48,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:48,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:48,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:48,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:48,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:48,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:48,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:48,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:48,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:48,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:48,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:48,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:48,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:48,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:48,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:48,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:48,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:48,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:48,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:48,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:48,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:48,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:48,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:49,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:49,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:49,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:49,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:49,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:49,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:49,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:49,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:49,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:49,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:49,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:49,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:49,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:49,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:49,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:49,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:49,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:49,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:49,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:49,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:49,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:49,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:49,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:49,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:49,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:49,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:49,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:49,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:49,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:49,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:49,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:49,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:50,411 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:58:51,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:51,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:51,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:51,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:51,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:51,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:51,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:51,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:51,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:51,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:51,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:51,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:51,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:51,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:51,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:51,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:51,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:51,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:51,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:51,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:51,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:51,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:51,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:51,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:51,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:51,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:51,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:51,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:51,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:51,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:51,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:51,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:51,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:58:51,680 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:58:52,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,412 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:58:52,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:52,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:53,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:53,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:53,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:53,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:53,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:53,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:53,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:53,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:53,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:53,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:53,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:53,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:53,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:53,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:53,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:53,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:54,412 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:58:55,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:55,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:55,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:55,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:55,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:55,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:55,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:55,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:55,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:55,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:55,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:55,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:55,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:55,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:55,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:55,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:55,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:55,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:55,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:55,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:55,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:55,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:55,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:55,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:55,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:55,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:55,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:55,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:55,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:55,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:55,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:55,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:56,413 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:58:57,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:57,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:58,419 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:58:58,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:58,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:58,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:58,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:58,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:58,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:58,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:58,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:58,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:58,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:58,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:58,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:58,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:58,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:58,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:58,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:58,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:58,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:58,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:58,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:58,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:58,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:58,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:58,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:58,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:58,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:58,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:58,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:58,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:58,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:58,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:58,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:59,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:59,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:59,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:59,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:59,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:59,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:59,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:59,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:59,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:59,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:59,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:59,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:59,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:59,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:59,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:59,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:58:59,921 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:59:00,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:59:00,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:00,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:02,421 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:59:02,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:02,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:02,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:02,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:02,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:02,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:02,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:02,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:02,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:02,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:02,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:02,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:02,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:02,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:02,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:02,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:03,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:03,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:03,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:03,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:03,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:03,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:03,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:03,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:03,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:03,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:03,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:03,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:03,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:03,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:03,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:03,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:59:04,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:04,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:06,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:59:06,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:59:06,908 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:59:12,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:12,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:12,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:12,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:12,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:12,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:12,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:12,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:12,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:12,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:12,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:12,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:12,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:12,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:12,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:12,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:13,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:13,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:13,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:13,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:13,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:13,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:13,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:13,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:13,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:13,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:13,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:13,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:13,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:13,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:13,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:13,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:14,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:59:18,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:18,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:18,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:18,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:18,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:18,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:18,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:18,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:18,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:18,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:18,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:18,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:18,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:18,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:18,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:18,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:18,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:18,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:18,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:18,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:18,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:18,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:18,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:18,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:18,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:18,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:18,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:18,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:18,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:18,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:18,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:18,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:20,428 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:59:20,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:20,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:20,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:20,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:20,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:20,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:20,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:20,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:20,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:20,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:20,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:20,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:20,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:20,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:20,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:20,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:22,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:59:22,295 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:59:24,430 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:59:28,431 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:59:29,996 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 19:59:30,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:30,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:30,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:30,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:30,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:30,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:30,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:30,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:30,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:30,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:30,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:30,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:30,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:30,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:30,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:30,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:32,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:32,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:32,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:32,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:32,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:32,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:32,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:32,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:32,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:32,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:32,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:32,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:32,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:32,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:32,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:32,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:32,433 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:59:34,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:34,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:34,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:34,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:34,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:34,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:34,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:34,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:34,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:34,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:34,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:34,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:34,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:34,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:34,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:34,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:36,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:59:37,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:59:37,676 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:59:40,436 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:59:41,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:41,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:41,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:41,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:41,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:41,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:41,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:41,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:41,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:41,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:41,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:41,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:41,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:41,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:41,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:41,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:41,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:41,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:41,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:41,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:41,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:41,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:41,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:41,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:41,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:41,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:41,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:41,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:41,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:41,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:41,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:41,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:42,437 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:59:46,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:46,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:46,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:46,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:46,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:46,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:46,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:46,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:46,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:46,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:46,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:46,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:46,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:46,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:46,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:46,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 19:59:46,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:59:49,439 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:59:53,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 19:59:53,045 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 19:59:53,441 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:59:55,442 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 19:59:59,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:00:00,069 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:00:01,445 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:00:05,446 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:00:07,447 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:00:09,448 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:00:10,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:00:10,161 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:00:13,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:00:15,451 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:00:17,452 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:00:19,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:00:23,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:00:23,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:23,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:23,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:23,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:23,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:23,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:23,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:23,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:23,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:23,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:23,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:23,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:23,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:23,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:23,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:23,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:25,455 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:00:26,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:00:26,889 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:00:27,456 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:00:29,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:00:30,143 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:00:30,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:30,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:30,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:30,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:30,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:30,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:30,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:30,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:30,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:30,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:30,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:30,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:30,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:30,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:30,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:30,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:31,458 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:00:33,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:00:35,460 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:00:37,461 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:00:39,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:39,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:39,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:39,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:39,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:39,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:39,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:39,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:39,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:39,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:39,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:39,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:39,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:39,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:39,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:39,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:39,462 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:00:41,463 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:00:42,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:00:42,152 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:00:43,464 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:00:45,464 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:00:46,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:46,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:46,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:46,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:46,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:46,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:46,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:46,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:46,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:46,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:46,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:46,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:46,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:46,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:46,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:46,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:47,465 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:00:48,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:48,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:48,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:48,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:48,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:48,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:48,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:48,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:48,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:48,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:48,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:48,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:48,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:48,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:48,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:48,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:48,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:48,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:48,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:48,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:48,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:48,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:48,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:48,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:48,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:48,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:48,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:48,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:48,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:48,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:48,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:48,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:49,466 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:00:51,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:51,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:51,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:51,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:51,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:51,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:51,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:51,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:51,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:51,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:51,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:51,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:51,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:51,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:51,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:51,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:51,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:51,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:51,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:51,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:51,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:51,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:51,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:51,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:51,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:51,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:51,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:51,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:51,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:51,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:51,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:51,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:51,466 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:00:52,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:52,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:52,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:52,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:52,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:52,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:52,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:52,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:52,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:52,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:52,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:52,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:52,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:52,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:52,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:52,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:52,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:52,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:52,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:52,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:52,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:52,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:52,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:52,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:52,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:52,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:52,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:52,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:52,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:52,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:52,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:52,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:53,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:53,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:53,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:53,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:53,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:53,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:53,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:53,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:53,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:53,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:53,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:53,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:53,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:53,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:53,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:53,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:53,467 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:00:53,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:53,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:53,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:53,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:53,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:53,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:53,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:53,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:53,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:53,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:53,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:53,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:53,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:53,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:53,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:53,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:55,468 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:00:56,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:56,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:56,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:56,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:56,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:56,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:56,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:56,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:56,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:56,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:56,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:56,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:56,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:56,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:56,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:56,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:56,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:56,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:56,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:56,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:56,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:56,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:56,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:56,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:56,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:56,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:56,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:56,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:56,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:56,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:56,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:56,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:57,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:57,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:57,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:57,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:57,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:57,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:57,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:57,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:57,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:57,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:57,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:57,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:57,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:57,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:57,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:57,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:57,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:00:57,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:00:57,565 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:00:58,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:58,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:58,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:58,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:58,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:58,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:58,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:58,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:58,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:58,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:58,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:58,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:58,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:58,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:58,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:58,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:58,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:58,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:58,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:58,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:58,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:58,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:58,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:58,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:58,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:58,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:58,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:58,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:58,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:58,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:58,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:58,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:00:59,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:00:59,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,214 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:01:00,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:00,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:01,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:01,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:01,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:01,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:01,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:01,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:01,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:01,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:01,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:01,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:01,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:01,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:01,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:01,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:01,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:01,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:01,470 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:01:02,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:02,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:02,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:02,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:02,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:02,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:02,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:02,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:02,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:02,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:02,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:02,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:02,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:02,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:02,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:02,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:02,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:02,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:02,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:02,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:02,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:02,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:02,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:02,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:02,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:02,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:02,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:02,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:02,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:02,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:02,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:02,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:03,471 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:01:04,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:04,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:04,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:04,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:04,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:04,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:04,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:04,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:04,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:04,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:04,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:04,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:04,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:04,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:04,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:04,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:05,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:05,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:05,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:05,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:05,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:05,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:05,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:05,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:05,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:05,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:05,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:05,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:05,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:05,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:05,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:05,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:05,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:05,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:05,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:05,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:05,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:05,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:05,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:05,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:05,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:05,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:05,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:05,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:05,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:05,440 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 20:01:05,574 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:01:05,588 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 20:01:05,649 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 20:01:06,569 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 20:01:06,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:01:07,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:01:09,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:09,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:09,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:09,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:09,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:09,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:09,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:09,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:09,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:09,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:09,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:09,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:09,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:09,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:09,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:09,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:12,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:01:12,986 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:01:13,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:13,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:13,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:13,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:13,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:13,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:13,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:13,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:13,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:13,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:13,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:13,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:13,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:13,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:13,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:13,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:14,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:14,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:14,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:14,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:14,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:14,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:14,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:14,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:14,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:14,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:14,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:14,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:14,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:14,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:14,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:14,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:15,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:01:19,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:19,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:19,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:19,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:19,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:19,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:19,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:19,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:19,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:19,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:19,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:19,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:19,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:19,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:19,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:19,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:19,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:19,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:19,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:19,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:19,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:19,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:19,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:19,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:19,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:19,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:19,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:19,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:19,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:19,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:19,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:19,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:20,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:20,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:20,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:20,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:20,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:20,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:20,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:20,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:20,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:20,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:20,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:20,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:20,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:20,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:20,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:20,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:21,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:01:21,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:21,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:21,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:21,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:21,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:21,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:21,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:21,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:21,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:21,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:21,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:21,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:21,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:21,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:21,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:21,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:25,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:01:26,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:26,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:26,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:26,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:26,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:26,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:26,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:26,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:26,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:26,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:26,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:26,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:26,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:26,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:26,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:26,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:28,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:01:28,244 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:01:28,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:28,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:28,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:28,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:28,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:28,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:28,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:28,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:28,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:28,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:28,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:28,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:28,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:28,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:28,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:28,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:29,579 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:01:30,302 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:01:34,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:01:36,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:36,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:36,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:36,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:36,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:36,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:36,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:36,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:36,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:36,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:36,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:36,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:36,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:36,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:36,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:36,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:37,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:37,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:37,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:37,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:37,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:37,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:37,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:37,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:37,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:37,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:37,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:37,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:37,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:37,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:37,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:37,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:38,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:38,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:38,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:38,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:38,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:38,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:38,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:38,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:38,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:38,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:38,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:38,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:38,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:38,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:38,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:38,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:38,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:01:42,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:01:43,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:43,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:43,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:43,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:43,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:43,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:43,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:43,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:43,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:43,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:43,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:43,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:43,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:43,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:43,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:43,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:43,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:01:43,502 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:01:46,585 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:01:48,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:01:52,588 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:01:53,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:53,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:53,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:53,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:53,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:53,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:53,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:53,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:53,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:53,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:53,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:53,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:53,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:53,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:53,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:53,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:54,589 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:01:54,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:54,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:54,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:54,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:54,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:54,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:54,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:54,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:54,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:54,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:54,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:54,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:54,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:54,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:54,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:54,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:58,590 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:01:58,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:01:58,757 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:01:59,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:59,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:59,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:59,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:59,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:59,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:59,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:59,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:59,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:59,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:59,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:59,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:59,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:59,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:59,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:01:59,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:00,374 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:02:00,591 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:02:04,593 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:02:06,594 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:02:10,596 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:02:12,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:02:14,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:02:14,246 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:02:14,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:02:16,598 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:02:20,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:02:22,601 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:02:24,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:02:26,603 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:02:28,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:02:29,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:02:29,682 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:02:30,605 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:02:30,803 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:02:31,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:31,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:31,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:31,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:31,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:31,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:31,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:31,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:31,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:31,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:31,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:31,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:31,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:31,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:31,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:31,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:32,605 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:02:34,606 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:02:36,607 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:02:36,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:36,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:36,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:36,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:36,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:36,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:36,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:36,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:36,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:36,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:36,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:36,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:36,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:36,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:36,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:36,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:38,607 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:02:40,608 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:02:42,609 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:02:43,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:43,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:43,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:43,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:43,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:43,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:43,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:43,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:43,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:43,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:43,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:43,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:43,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:43,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:43,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:43,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:44,610 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:02:45,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:02:45,940 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:02:46,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:02:48,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:02:50,613 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:02:50,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:50,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:50,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:50,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:50,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:50,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:50,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:50,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:50,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:50,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:50,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:50,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:50,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:50,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:50,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:50,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:51,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:51,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:51,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:51,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:51,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:51,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:51,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:51,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:51,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:51,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:51,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:51,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:51,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:51,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:51,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:51,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:52,613 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:02:53,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:53,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:53,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:53,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:53,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:53,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:53,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:53,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:53,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:53,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:53,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:53,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:53,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:53,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:53,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:53,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:54,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:54,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:54,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:54,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:54,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:54,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:54,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:54,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:54,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:54,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:54,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:54,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:54,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:54,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:54,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:54,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:54,614 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:02:54,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:54,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:54,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:54,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:54,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:54,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:54,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:54,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:54,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:54,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:54,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:54,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:54,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:54,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:54,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:54,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:56,615 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:02:58,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:02:58,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:58,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:58,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:58,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:58,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:58,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:58,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:58,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:58,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:58,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:58,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:58,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:58,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:58,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:58,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:58,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:58,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:58,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:58,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:58,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:58,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:58,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:58,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:58,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:58,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:58,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:58,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:58,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:58,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:58,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:58,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:58,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:59,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:59,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:59,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:59,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:59,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:59,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:59,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:59,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:59,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:59,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:59,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:59,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:59,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:59,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:59,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:59,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:59,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:59,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:59,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:59,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:59,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:59,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:59,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:59,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:59,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:59,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:59,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:59,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:59,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:59,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:59,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:02:59,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:00,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:00,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:00,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:00,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:00,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:00,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:00,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:00,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:00,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:00,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:00,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:00,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:00,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:00,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:00,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:00,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:00,547 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:03:00,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:03:00,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:00,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:00,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:00,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:00,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:00,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:00,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:00,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:00,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:00,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:00,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:00,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:00,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:00,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:00,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:00,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:01,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:01,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:01,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:01,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:01,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:01,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:01,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:01,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:01,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:01,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:01,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:01,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:01,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:01,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:01,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:01,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:01,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:03:01,227 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:03:01,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:01,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:01,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:01,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:01,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:01,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:01,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:01,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:01,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:01,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:01,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:01,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:01,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:01,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:01,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:01,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,617 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:03:02,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:02,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:03,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:04,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:03:05,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:05,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:05,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:05,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:05,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:05,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:05,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:05,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:05,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:05,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:05,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:05,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:05,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:05,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:05,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:05,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:05,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:05,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:05,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:05,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:05,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:05,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:05,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:05,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:05,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:05,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:05,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:05,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:05,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:05,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:05,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:05,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:06,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:06,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:06,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:06,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:06,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:06,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:06,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:06,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:06,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:06,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:06,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:06,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:06,619 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:03:08,619 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:03:11,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:11,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:11,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:11,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:11,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:11,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:11,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:11,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:11,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:11,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:11,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:11,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:11,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:11,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:11,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:11,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:16,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:16,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:16,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:16,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:16,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:16,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:16,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:16,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:16,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:16,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:16,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:16,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:16,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:16,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:16,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:16,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:17,623 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:03:17,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:03:17,737 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:03:18,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:18,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:18,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:18,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:18,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:18,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:18,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:18,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:18,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:18,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:18,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:18,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:18,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:18,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:18,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:18,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:21,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:21,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:21,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:21,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:21,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:21,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:21,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:21,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:21,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:21,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:21,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:21,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:21,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:21,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:21,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:21,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:21,624 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:03:21,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:21,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:21,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:21,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:21,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:21,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:21,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:21,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:21,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:21,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:21,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:21,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:21,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:21,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:21,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:21,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:23,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:23,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:23,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:23,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:23,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:23,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:23,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:23,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:23,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:23,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:23,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:23,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:23,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:23,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:23,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:23,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:25,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:03:25,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:25,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:25,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:25,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:25,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:25,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:25,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:25,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:25,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:25,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:25,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:25,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:25,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:25,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:25,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:25,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:27,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:27,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:27,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:27,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:27,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:27,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:27,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:27,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:27,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:27,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:27,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:27,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:27,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:27,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:27,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:27,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:29,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:03:30,619 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:03:31,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:31,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:31,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:31,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:31,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:31,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:31,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:31,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:31,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:31,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:31,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:31,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:31,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:31,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:31,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:31,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:31,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:31,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:31,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:31,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:31,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:31,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:31,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:31,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:31,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:31,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:31,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:31,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:31,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:31,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:31,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:31,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:33,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:03:33,029 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:03:33,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:33,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:33,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:33,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:33,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:33,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:33,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:33,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:33,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:33,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:33,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:33,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:33,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:03:33,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:33,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:33,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:33,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:37,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:37,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:37,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:37,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:37,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:37,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:37,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:37,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:37,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:37,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:37,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:37,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:37,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:37,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:37,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:37,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:37,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:03:41,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:41,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:41,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:41,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:41,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:41,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:41,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:41,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:41,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:41,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:41,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:41,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:41,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:41,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:41,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:41,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:41,631 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:03:44,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:44,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:44,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:44,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:44,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:44,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:44,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:44,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:44,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:44,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:44,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:44,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:44,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:44,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:44,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:44,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:45,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:03:46,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:46,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:46,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:46,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:46,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:46,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:46,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:46,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:46,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:46,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:46,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:46,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:46,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:46,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:46,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:46,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:48,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:03:48,320 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:03:49,635 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:03:51,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:51,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:51,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:51,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:51,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:51,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:51,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:51,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:51,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:51,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:51,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:51,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:51,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:51,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:51,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:51,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:03:51,636 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:03:55,637 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:03:57,638 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:03:59,639 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:04:00,691 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:04:02,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:02,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:03,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:04:03,594 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:04:03,640 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:04:05,641 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:04:07,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:04:11,644 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:04:13,644 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:04:15,645 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:04:17,646 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:04:18,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:04:18,857 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:04:21,648 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:04:23,648 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:04:25,649 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:04:27,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:04:29,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:04:30,765 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:04:31,651 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:04:33,652 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:04:34,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:34,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:34,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:04:34,334 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:04:34,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:34,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:34,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:34,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:34,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:34,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:34,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:34,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:34,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:34,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:34,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:34,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:34,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:34,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:35,652 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:04:37,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:37,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:37,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:37,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:37,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:37,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:37,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:37,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:37,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:37,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:37,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:37,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:37,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:37,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:37,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:37,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:37,653 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:04:39,654 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:04:41,654 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:04:43,655 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:04:45,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:04:46,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:46,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:46,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:46,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:46,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:46,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:46,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:46,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:46,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:46,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:46,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:46,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:46,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:46,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:46,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:46,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:47,657 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:04:49,657 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:04:49,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:04:49,794 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:04:50,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:50,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:50,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:50,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:50,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:50,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:50,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:50,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:50,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:50,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:50,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:50,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:50,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:50,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:50,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:50,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:50,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:50,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:50,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:50,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:50,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:50,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:50,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:50,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:50,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:50,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:50,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:50,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:50,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:50,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:50,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:50,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:51,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:51,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:51,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:51,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:51,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:51,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:51,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:51,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:51,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:51,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:51,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:51,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:51,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:51,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:51,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:51,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:51,658 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:04:52,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:52,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:52,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:52,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:52,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:52,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:52,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:52,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:52,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:52,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:52,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:52,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:52,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:52,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:52,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:52,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:53,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:53,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:53,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:53,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:53,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:53,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:53,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:53,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:53,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:53,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:53,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:53,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:53,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:53,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:53,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:53,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:53,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:53,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:53,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:53,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:53,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:53,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:53,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:53,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:53,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:53,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:53,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:53,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:53,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:53,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:53,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:53,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:54,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:54,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:54,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:54,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:54,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:54,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:54,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:54,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:54,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:54,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:54,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:54,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:54,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:54,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:54,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:54,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:54,659 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:04:55,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:55,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:55,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:55,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:55,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:55,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:55,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:55,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:55,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:55,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:55,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:55,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:55,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:55,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:55,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:55,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:56,660 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:04:57,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:57,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:57,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:57,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:57,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:57,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:57,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:57,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:57,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:57,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:57,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:57,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:57,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:57,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:57,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:57,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:57,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:57,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:57,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:57,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:57,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:57,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:57,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:57,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:57,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:57,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:57,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:57,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:57,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:57,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:57,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:57,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:58,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:58,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:58,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:58,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:58,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:58,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:58,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:58,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:58,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:58,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:58,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:58,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:58,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:58,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:58,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:58,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:58,661 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:04:58,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:58,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:58,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:58,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:58,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:58,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:58,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:58,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:58,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:58,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:58,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:58,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:58,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:58,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:58,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:58,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:04:59,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:00,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:05:00,838 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:05:01,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:01,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:01,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:01,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:01,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:01,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:01,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:01,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:01,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:01,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:01,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:01,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:01,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:01,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:01,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:01,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:01,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:01,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:01,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:01,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:01,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:01,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:01,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:01,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:01,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:01,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:01,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:01,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:01,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:01,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:01,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:01,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:02,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:02,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:02,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:02,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:02,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:02,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:02,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:02,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:02,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:02,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:02,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:02,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:02,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:02,599 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 20:05:02,819 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 20:05:02,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:05:02,891 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 20:05:03,814 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 20:05:03,814 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:05:05,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:05:05,043 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:05:07,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:07,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:07,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:07,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:07,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:07,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:07,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:07,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:07,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:07,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:07,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:07,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:07,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:07,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:07,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:07,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:10,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:10,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:10,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:10,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:10,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:10,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:10,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:10,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:10,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:10,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:10,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:10,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:10,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:10,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:10,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:10,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:11,817 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:05:12,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:12,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:12,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:12,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:12,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:12,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:12,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:12,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:12,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:12,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:12,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:12,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:12,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:12,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:12,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:12,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:13,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:13,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:13,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:13,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:13,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:13,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:13,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:13,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:13,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:13,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:13,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:13,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:13,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:13,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:13,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:13,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:17,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:17,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:17,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:17,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:17,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:17,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:17,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:17,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:17,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:17,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:17,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:17,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:17,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:17,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:17,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:17,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:17,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:05:20,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:05:20,482 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:05:22,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:05:24,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:24,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:24,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:24,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:24,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:24,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:24,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:24,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:24,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:24,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:24,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:24,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:24,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:24,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:24,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:24,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:25,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:25,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:25,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:25,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:25,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:25,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:25,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:25,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:25,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:25,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:25,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:25,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:25,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:25,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:25,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:25,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:25,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:25,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:25,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:25,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:25,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:25,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:25,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:25,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:25,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:25,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:25,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:25,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:26,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:26,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:26,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:26,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:26,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:05:29,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:29,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:29,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:29,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:29,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:29,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:29,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:29,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:29,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:29,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:29,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:29,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:29,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:29,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:29,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:29,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:30,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:30,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:30,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:30,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:30,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:30,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:30,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:30,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:30,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:30,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:30,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:30,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:30,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:30,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:30,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:30,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:30,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:05:30,973 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:05:33,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:33,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:33,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:33,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:33,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:33,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:33,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:33,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:33,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:33,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:33,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:33,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:33,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:33,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:33,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:33,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:34,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:05:35,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:05:35,902 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:05:37,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:37,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:37,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:37,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:37,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:37,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:37,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:37,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:37,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:37,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:37,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:37,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:37,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:37,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:37,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:37,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:37,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:37,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:37,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:37,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:37,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:37,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:37,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:37,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:37,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:37,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:37,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:37,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:37,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:37,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:37,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:37,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:38,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:05:39,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:39,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:39,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:39,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:39,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:39,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:39,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:39,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:39,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:39,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:39,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:39,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:39,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:39,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:39,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:39,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:40,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:40,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:40,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:40,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:40,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:40,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:40,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:40,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:40,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:40,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:40,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:40,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:40,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:40,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:40,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:40,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:40,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:05:42,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:42,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:42,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:42,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:42,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:42,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:42,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:42,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:42,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:42,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:42,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:42,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:42,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:42,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:42,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:42,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:44,829 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:05:47,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:47,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:47,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:47,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:47,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:47,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:47,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:47,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:47,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:47,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:47,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:47,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:47,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:47,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:47,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:47,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:48,831 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:05:50,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:05:51,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:05:51,329 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:05:54,833 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:05:54,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:54,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:54,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:54,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:54,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:54,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:54,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:54,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:54,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:54,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:54,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:54,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:54,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:54,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:54,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:54,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:56,834 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:05:59,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:59,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:59,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:59,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:59,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:59,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:59,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:59,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:59,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:59,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:59,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:59,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:59,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:59,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:59,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:05:59,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:00,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:00,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:00,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:00,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:00,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:00,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:00,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:00,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:00,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:00,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:00,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:00,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:00,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:00,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:00,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:06:00,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:00,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:01,043 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:06:02,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:06:04,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:06:06,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:06,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:06,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:06,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:06,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:06,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:06,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:06,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:06,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:06,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:06,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:06,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:06,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:06,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:06,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:06,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:06,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:06,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:06,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:06,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:06,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:06,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:06,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:06,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:06,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:06,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:06,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:06,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:06,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:06,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:06,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:06,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:06,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:06:06,555 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:06:08,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:06:10,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:06:12,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:06:16,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:06:18,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:06:20,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:06:21,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:06:21,892 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:06:22,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:06:24,846 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:06:26,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:06:28,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:06:30,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:06:31,111 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:06:32,849 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:06:34,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:34,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:34,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:34,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:34,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:34,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:34,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:34,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:34,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:34,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:34,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:34,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:34,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:34,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:34,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:34,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:34,850 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:06:36,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:06:37,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:06:37,219 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:06:38,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:38,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:38,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:38,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:38,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:38,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:38,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:38,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:38,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:38,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:38,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:38,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:38,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:38,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:38,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:38,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:38,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:06:40,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:06:42,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:06:44,854 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:06:46,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:06:47,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:47,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:47,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:47,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:47,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:47,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:47,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:47,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:47,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:47,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:47,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:47,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:47,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:47,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:47,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:47,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:48,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:06:50,856 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:06:52,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:52,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:52,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:52,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:52,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:52,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:52,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:52,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:52,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:52,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:52,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:52,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:06:52,442 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:06:52,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:52,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:52,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:52,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:52,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:52,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:06:53,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:53,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:53,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:53,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:53,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:53,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:53,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:53,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:53,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:53,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:53,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:53,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:53,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:53,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:53,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:53,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:54,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:54,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:54,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:54,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:54,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:54,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:54,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:54,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:54,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:54,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:54,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:54,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:54,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:54,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:54,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:54,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:54,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:06:56,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:56,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:06:57,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:57,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:57,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:57,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:57,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:57,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:57,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:57,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:57,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:57,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:57,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:57,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:57,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:57,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:57,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:57,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:58,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:58,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:58,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:58,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:58,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:58,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:58,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:58,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:58,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:58,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:58,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:58,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:58,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:58,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:58,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:58,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:58,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:06:59,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:59,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:59,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:59,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:59,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:59,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:59,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:59,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:59,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:59,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:59,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:59,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:59,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:59,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:59,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:06:59,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:00,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:00,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:00,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:00,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:00,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:00,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:00,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:00,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:00,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:00,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:00,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:00,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:00,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:00,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:00,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:00,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:00,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:00,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:00,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:00,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:00,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:00,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:00,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:00,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:00,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:00,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:00,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:00,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:00,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:00,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:00,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:00,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:00,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:07:01,178 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:07:01,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:01,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:02,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:02,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:02,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:02,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:02,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:02,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:02,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:02,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:02,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:02,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:02,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:02,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:02,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:02,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:02,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:02,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:02,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:02,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:02,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:02,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:02,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:02,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:02,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:02,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:02,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:02,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:02,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:02,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:02,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:07:06,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:06,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:06,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:06,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:06,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:06,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:06,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:06,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:06,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:06,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:06,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:06,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:06,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:06,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:06,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:06,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:07,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:07:07,810 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:07:09,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:09,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:09,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:09,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:09,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:09,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:09,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:09,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:09,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:09,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:09,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:09,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:09,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:09,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:09,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:09,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:12,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:07:18,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:18,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:18,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:18,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:18,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:18,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:18,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:18,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:18,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:18,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:18,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:18,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:18,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:18,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:18,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:18,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:19,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:07:20,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:20,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:20,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:20,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:20,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:20,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:20,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:20,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:20,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:20,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:20,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:20,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:20,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:20,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:20,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:20,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:22,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:23,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:07:23,236 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:07:23,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:07:27,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:27,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:27,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:27,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:27,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:27,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:27,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:27,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:27,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:27,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:27,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:27,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:27,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:27,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:27,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:27,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:27,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:07:31,252 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:07:31,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:07:31,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:31,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:31,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:31,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:31,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:31,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:31,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:31,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:31,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:31,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:31,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:31,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:31,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:31,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:31,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:31,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:33,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:07:33,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:33,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:33,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:33,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:33,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:33,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:33,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:33,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:33,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:33,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:33,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:33,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:33,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:33,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:33,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:33,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:34,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:34,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:34,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:34,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:34,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:34,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:34,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:34,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:34,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:34,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:34,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:34,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:34,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:34,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:34,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:34,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:37,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:37,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:37,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:37,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:37,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:37,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:37,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:37,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:37,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:37,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:37,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:37,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:37,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:37,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:37,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:37,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:37,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:07:38,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:07:38,516 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:07:38,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:38,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:38,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:38,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:38,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:38,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:38,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:38,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:38,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:38,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:38,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:38,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:38,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:38,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:38,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:38,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:39,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:39,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:39,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:39,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:39,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:39,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:39,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:39,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:39,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:39,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:39,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:39,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:39,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:39,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:39,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:39,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:40,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:40,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:40,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:40,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:40,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:40,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:40,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:40,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:40,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:40,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:40,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:40,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:40,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:40,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:40,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:40,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:41,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:07:43,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:07:45,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:45,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:45,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:45,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:45,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:45,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:45,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:45,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:45,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:45,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:45,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:45,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:45,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:45,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:45,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:45,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:46,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:46,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:46,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:46,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:46,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:46,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:46,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:46,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:46,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:46,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:46,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:46,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:46,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:46,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:46,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:46,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:47,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:47,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:47,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:47,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:47,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:47,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:47,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:47,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:47,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:47,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:47,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:47,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:47,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:47,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:47,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:47,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:47,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:07:48,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:48,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:48,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:48,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:48,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:48,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:48,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:48,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:48,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:48,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:48,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:48,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:48,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:48,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:48,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:48,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:49,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:07:52,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:52,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:52,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:52,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:52,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:52,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:52,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:52,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:52,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:52,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:52,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:52,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:52,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:52,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:52,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:52,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:53,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:07:53,742 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:07:53,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:07:55,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:55,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:55,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:55,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:55,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:55,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:55,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:55,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:55,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:55,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:55,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:55,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:55,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:55,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:55,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:55,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:07:55,882 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:07:59,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:08:01,314 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:08:01,885 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:08:02,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:02,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:02,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:02,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:02,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:02,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:02,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:02,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:02,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:02,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:02,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:02,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:02,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:02,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:02,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:02,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:02,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:02,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:02,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:02,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:02,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:02,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:02,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:02,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:02,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:02,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:02,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:02,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:02,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:02,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:02,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:02,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:03,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:08:07,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:07,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:07,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:07,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:07,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:07,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:07,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:07,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:07,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:07,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:07,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:07,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:07,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:07,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:07,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:07,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:07,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:08:09,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:08:09,030 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:08:09,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:08:10,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:10,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:10,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:10,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:10,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:10,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:10,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:10,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:10,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:10,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:10,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:10,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:10,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:10,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:10,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:10,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:11,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:08:13,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:13,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:13,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:13,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:13,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:13,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:13,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:13,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:13,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:13,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:13,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:13,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:13,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:13,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:13,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:13,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:13,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:08:15,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:08:19,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:08:21,894 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:08:23,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:08:24,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:08:24,397 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:08:25,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:08:27,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:08:29,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:08:31,377 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:08:31,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:08:33,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:08:36,901 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:08:38,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:38,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:38,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:38,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:38,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:38,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:38,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:38,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:38,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:38,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:38,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:38,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:38,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:38,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:38,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:38,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:38,901 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:08:39,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:08:39,656 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:08:39,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:39,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:39,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:39,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:39,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:39,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:39,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:39,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:39,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:39,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:39,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:39,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:39,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:39,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:39,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:39,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:40,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:08:42,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:08:44,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:08:46,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:08:47,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:47,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:47,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:47,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:47,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:47,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:47,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:47,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:47,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:47,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:47,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:47,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:47,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:47,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:47,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:47,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:48,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:08:50,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:08:52,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:08:52,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:52,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:52,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:52,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:52,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:52,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:52,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:52,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:52,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:52,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:52,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:52,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:52,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:52,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:52,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:52,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:53,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:53,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:53,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:53,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:53,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:53,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:53,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:53,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:53,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:53,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:53,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:53,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:53,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:53,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:53,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:53,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:54,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:08:54,881 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:08:54,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:08:55,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:55,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:56,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:56,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:56,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:56,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:56,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:56,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:56,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:56,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:56,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:56,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:56,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:56,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:56,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:56,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:56,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:56,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:56,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:08:58,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:08:58,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:58,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:08:59,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:00,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:00,180 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 20:09:00,393 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 20:09:00,467 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 20:09:00,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 20:09:00,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:09:01,470 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:09:02,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:09:03,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:03,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:03,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:03,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:03,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:03,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:03,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:03,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:03,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:03,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:03,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:03,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:03,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:03,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:03,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:03,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:03,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:03,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:03,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:03,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:03,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:03,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:03,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:03,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:03,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:03,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:03,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:03,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:03,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:03,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:03,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:03,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:04,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:04,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:04,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:04,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:04,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:04,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:04,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:04,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:04,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:04,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:04,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:04,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:04,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:04,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:04,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:04,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:07,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:07,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:07,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:07,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:07,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:07,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:07,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:07,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:07,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:07,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:07,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:07,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:07,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:07,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:07,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:07,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:08,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:08,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:08,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:08,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:08,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:08,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:08,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:08,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:08,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:08,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:08,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:08,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:08,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:08,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:08,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:08,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:10,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:09:10,109 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:09:10,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:10,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:10,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:10,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:10,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:10,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:10,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:10,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:10,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:10,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:10,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:10,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:10,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:10,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:10,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:10,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:10,916 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:09:11,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:11,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:11,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:11,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:11,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:11,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:11,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:11,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:11,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:11,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:11,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:11,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:11,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:11,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:11,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:11,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:12,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:12,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:12,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:12,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:12,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:12,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:12,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:12,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:12,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:12,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:12,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:12,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:12,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:12,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:12,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:12,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:15,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:15,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:15,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:15,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:15,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:15,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:15,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:15,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:15,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:15,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:15,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:15,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:15,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:15,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:15,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:15,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:16,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:09:20,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:09:24,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:24,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:24,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:24,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:24,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:24,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:24,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:24,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:24,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:24,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:24,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:24,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:24,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:24,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:24,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:24,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:24,922 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:09:25,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:09:25,457 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:09:25,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:25,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:25,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:25,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:25,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:25,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:25,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:25,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:25,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:25,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:25,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:25,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:25,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:25,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:25,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:25,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:25,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:25,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:25,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:25,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:25,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:25,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:25,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:25,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:25,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:25,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:25,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:25,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:25,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:25,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:25,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:25,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:26,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:26,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:26,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:26,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:26,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:26,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:26,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:26,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:26,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:26,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:26,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:26,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:26,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:26,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:26,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:26,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:28,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:09:29,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:29,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:29,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:29,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:29,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:29,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:29,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:29,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:29,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:29,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:29,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:29,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:29,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:29,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:29,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:29,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:31,545 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:09:32,925 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:09:34,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:34,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:34,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:34,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:34,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:34,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:34,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:34,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:34,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:34,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:34,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:34,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:34,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:34,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:34,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:34,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:34,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:09:38,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:38,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:09:40,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:09:40,824 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:09:41,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:41,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:42,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:09:44,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:44,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:44,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:44,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:44,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:44,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:44,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:44,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:44,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:44,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:44,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:44,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:44,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:44,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:44,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:44,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:44,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:09:45,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:45,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:45,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:45,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:45,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:45,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:45,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:45,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:45,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:45,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:45,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:45,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:45,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:45,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:45,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:45,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:48,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:09:50,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:09:51,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:51,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:51,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:51,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:51,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:51,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:51,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:51,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:51,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:51,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:51,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:51,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:51,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:51,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:51,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:51,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:53,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:53,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:53,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:53,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:53,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:53,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:53,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:53,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:53,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:53,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:53,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:53,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:53,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:53,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:53,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:53,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:54,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:09:56,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:09:56,048 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:09:56,937 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:09:57,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:57,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:57,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:57,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:57,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:57,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:57,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:57,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:57,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:57,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:57,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:57,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:57,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:57,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:57,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:57,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:58,938 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:09:59,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:59,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:59,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:59,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:59,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:59,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:59,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:59,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:59,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:59,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:59,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:59,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:59,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:59,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:59,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:09:59,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:01,620 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:10:02,940 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:10:04,941 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:10:05,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:05,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:05,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:05,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:05,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:05,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:05,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:05,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:05,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:05,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:05,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:05,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:05,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:05,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:05,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:05,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:05,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:05,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:05,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:05,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:05,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:05,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:05,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:05,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:05,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:05,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:05,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:05,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:05,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:05,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:05,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:05,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:06,942 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:10:07,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:07,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:07,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:07,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:07,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:07,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:07,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:07,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:07,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:07,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:07,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:07,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:07,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:07,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:07,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:07,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:07,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:07,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:07,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:07,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:07,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:07,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:07,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:07,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:07,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:07,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:07,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:07,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:07,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:07,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:07,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:07,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:09,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:09,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:09,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:09,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:09,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:09,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:09,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:09,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:09,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:09,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:09,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:09,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:09,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:09,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:09,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:09,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:10,944 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:10:11,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:10:11,327 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:10:12,944 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:10:14,945 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:10:16,946 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:10:17,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:17,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:17,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:17,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:17,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:17,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:17,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:17,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:17,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:17,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:17,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:17,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:17,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:17,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:17,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:17,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:18,947 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:10:20,948 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:10:22,949 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:10:24,950 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:10:26,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:10:26,558 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:10:26,951 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:10:28,952 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:10:30,953 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:10:31,694 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:10:32,954 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:10:34,955 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:10:36,956 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:10:38,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:38,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:38,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:38,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:38,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:38,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:38,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:38,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:38,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:38,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:38,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:38,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:38,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:38,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:38,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:38,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:38,957 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:10:39,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:39,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:39,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:39,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:39,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:39,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:39,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:39,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:39,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:39,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:39,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:39,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:39,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:39,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:39,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:39,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:40,958 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:10:41,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:10:41,860 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:10:42,959 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:10:44,960 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:10:46,961 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:10:47,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:47,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:47,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:47,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:47,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:47,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:47,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:47,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:47,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:47,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:47,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:47,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:47,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:47,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:47,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:47,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:48,961 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:10:50,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:10:51,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:51,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:51,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:51,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:51,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:51,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:51,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:51,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:51,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:51,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:51,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:51,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:51,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:51,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:51,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:51,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:52,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:52,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:52,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:52,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:52,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:52,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:52,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:52,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:52,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:52,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:52,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:52,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:52,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:52,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:52,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:52,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:52,963 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:10:54,964 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:10:55,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:55,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:55,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:55,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:55,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:55,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:55,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:55,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:55,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:55,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:55,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:55,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:55,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:55,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:55,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:55,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:56,964 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:10:57,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:10:57,125 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:10:57,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:57,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:57,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:57,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:57,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:57,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:57,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:57,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:57,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:57,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:57,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:57,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:10:58,965 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:11:01,770 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:11:02,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:02,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:02,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:02,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:02,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:02,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:02,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:02,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:02,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:02,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:02,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:02,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:02,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:02,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:02,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:02,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:06,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:06,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:06,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:06,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:06,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:06,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:06,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:06,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:06,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:06,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:06,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:06,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:06,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:06,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:06,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:06,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:08,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:08,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:08,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:08,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:08,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:08,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:08,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:08,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:08,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:08,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:08,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:08,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:08,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:08,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:08,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:08,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:08,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:08,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:08,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:08,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:08,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:08,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:08,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:08,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:08,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:08,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:08,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:08,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:08,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:08,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:08,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:08,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:08,968 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:11:11,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:11,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:11,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:11,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:11,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:11,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:11,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:11,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:11,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:11,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:11,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:11,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:11,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:11,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:11,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:11,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:12,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:11:12,584 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:11:12,970 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:11:13,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:13,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:13,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:13,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:13,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:13,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:13,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:13,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:13,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:13,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:13,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:13,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:13,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:13,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:13,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:13,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:15,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:15,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:15,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:15,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:15,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:15,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:15,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:15,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:15,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:15,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:15,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:15,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:15,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:15,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:16,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:16,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:16,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:16,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:16,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:16,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:16,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:16,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:16,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:16,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:16,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:16,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:16,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:16,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:16,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:16,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:16,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:16,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:17,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:17,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:17,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:17,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:17,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:17,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:17,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:17,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:17,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:17,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:17,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:17,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:17,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:17,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:17,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:17,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:18,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:18,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:18,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:18,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:18,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:18,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:18,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:18,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:18,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:18,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:18,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:18,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:18,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:18,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:18,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:18,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:18,972 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:11:22,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:22,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:22,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:22,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:22,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:22,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:22,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:22,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:22,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:22,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:22,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:22,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:22,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:22,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:22,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:22,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:22,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:22,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:22,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:22,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:22,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:22,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:22,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:22,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:22,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:22,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:22,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:22,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:22,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:22,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:22,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:22,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:22,974 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:11:24,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:24,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:24,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:24,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:24,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:24,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:24,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:24,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:24,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:24,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:24,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:24,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:24,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:24,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:24,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:24,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:26,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:26,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:26,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:26,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:26,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:26,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:26,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:26,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:26,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:26,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:26,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:26,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:26,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:26,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:26,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:26,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:26,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:26,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:26,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:26,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:26,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:26,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:26,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:26,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:26,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:26,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:26,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:26,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:26,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:26,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:26,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:26,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:26,976 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:11:28,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:28,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:28,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:28,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:28,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:28,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:28,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:28,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:28,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:28,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:28,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:28,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:28,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:28,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:28,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:28,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:30,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:11:30,630 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:11:30,977 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:11:31,840 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:11:34,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:34,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:34,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:34,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:34,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:34,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:34,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:34,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:34,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:34,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:34,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:34,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:34,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:34,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:34,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:34,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:34,979 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:11:36,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:36,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:36,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:36,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:36,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:36,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:36,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:36,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:36,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:36,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:36,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:36,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:36,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:36,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:36,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:36,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:36,979 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:11:40,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:40,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:40,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:40,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:40,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:40,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:40,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:40,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:40,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:40,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:40,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:40,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:40,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:40,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:40,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:40,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:40,981 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:11:42,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:42,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:42,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:42,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:42,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:42,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:42,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:42,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:42,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:42,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:42,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:42,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:42,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:42,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:42,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:42,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:42,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:42,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:42,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:42,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:42,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:42,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:42,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:42,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:42,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:42,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:42,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:42,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:42,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:42,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:42,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:42,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:45,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:11:45,862 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:11:45,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:45,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:45,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:45,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:45,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:45,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:45,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:45,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:45,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:45,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:45,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:45,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:45,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:45,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:45,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:45,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:45,983 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:11:46,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:46,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:46,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:46,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:46,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:46,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:46,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:46,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:46,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:46,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:46,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:46,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:46,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:46,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:46,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:46,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:46,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:46,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:46,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:46,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:46,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:46,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:46,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:46,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:46,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:46,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:46,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:46,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:46,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:46,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:46,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:46,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:47,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:47,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:47,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:47,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:47,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:47,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:47,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:47,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:47,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:47,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:47,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:47,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:47,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:47,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:47,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:47,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:47,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:47,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:47,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:47,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:47,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:47,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:47,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:47,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:47,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:47,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:47,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:47,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:47,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:47,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:47,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:47,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:47,984 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:11:51,986 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:11:53,987 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:11:55,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:55,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:55,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:55,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:55,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:55,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:55,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:55,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:55,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:55,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:55,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:55,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:55,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:55,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:55,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:55,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:57,989 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:11:59,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:59,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:59,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:59,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:59,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:59,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:59,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:59,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:59,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:59,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:59,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:59,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:59,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:59,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:59,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:59,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:59,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:59,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:59,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:59,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:59,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:59,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:59,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:59,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:59,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:59,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:59,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:59,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:59,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:59,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:59,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:59,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:11:59,989 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:12:00,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:00,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:00,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:00,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:00,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:00,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:00,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:00,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:00,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:00,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:00,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:00,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:00,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:00,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:00,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:00,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:01,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:12:01,235 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:12:01,906 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:12:01,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:01,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:01,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:01,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:01,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:01,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:01,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:01,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:01,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:01,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:01,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:01,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:01,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:01,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:01,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:01,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:01,990 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:12:05,992 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:12:07,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:07,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:07,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:07,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:07,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:07,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:07,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:07,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:07,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:07,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:07,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:07,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:07,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:07,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:07,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:07,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:07,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:07,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:07,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:07,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:07,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:07,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:07,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:07,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:07,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:07,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:07,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:07,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:07,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:07,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:07,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:07,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:07,993 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:12:09,994 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:12:13,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:13,995 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:12:15,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:15,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:15,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:15,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:15,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:15,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:15,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:15,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:15,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:15,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:15,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:15,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:15,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:15,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:15,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:15,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:15,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:12:16,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:12:16,570 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:12:17,997 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:12:19,998 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:12:21,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:12:23,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:23,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:23,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:23,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:23,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:23,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:24,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:12:24,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:24,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:24,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:24,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:24,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:24,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:24,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:24,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:24,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:24,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:28,001 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:12:30,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:12:31,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:12:31,866 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:12:32,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:12:32,091 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:12:34,003 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:12:36,004 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:12:38,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:12:40,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:12:42,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:12:43,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:43,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:43,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:43,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:43,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:43,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:43,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:43,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:43,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:43,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:43,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:43,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:43,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:43,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:43,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:43,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:44,007 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:12:45,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:45,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:45,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:45,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:45,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:45,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:45,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:45,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:45,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:45,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:45,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:45,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:45,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:45,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:45,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:45,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:46,009 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:12:47,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:12:47,121 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:12:48,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:12:50,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:12:51,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:51,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:51,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:51,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:51,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:51,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:51,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:51,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:51,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:51,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:51,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:51,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:51,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:51,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:51,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:51,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:52,012 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:12:54,012 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:12:56,013 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:12:56,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:56,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:56,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:56,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:56,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:56,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:56,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:56,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:56,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:56,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:56,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:56,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:56,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:56,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:56,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:56,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:57,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:57,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:57,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:57,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:57,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:57,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:57,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:57,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:57,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:57,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:57,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:57,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:57,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:57,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:57,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:57,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:57,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:57,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:57,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:57,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:57,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:57,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:57,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:57,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:57,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:57,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:57,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:57,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:57,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:57,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:57,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:57,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:58,013 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:12:58,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:58,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:58,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:58,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:58,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:58,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:58,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:58,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:58,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:58,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:58,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:58,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:58,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:58,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:58,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:58,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:59,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:59,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:59,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:59,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:59,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:59,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:59,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:59,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:59,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:59,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:59,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:59,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:59,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:12:59,847 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 20:13:00,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:13:00,088 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 20:13:00,166 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 20:13:01,061 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 20:13:02,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:13:02,171 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:13:02,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:13:02,382 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:13:05,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:05,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:05,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:05,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:05,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:05,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:05,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:05,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:05,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:05,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:05,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:05,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:05,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:05,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:05,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:05,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:07,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:07,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:07,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:07,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:07,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:07,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:07,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:07,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:08,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:08,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:08,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:08,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:08,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:08,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:08,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:08,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:08,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:08,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:08,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:08,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:08,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:08,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:08,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:08,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:08,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:08,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:08,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:08,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:08,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:08,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:08,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:08,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:13,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:13:17,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:13:17,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:13:17,777 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:13:18,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:18,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:21,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:13:21,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:21,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:21,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:21,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:21,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:21,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:21,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:21,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:21,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:21,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:21,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:21,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:21,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:21,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:21,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:21,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:23,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:23,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:23,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:23,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:23,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:23,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:23,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:23,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:23,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:23,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:23,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:23,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:23,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:23,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:23,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:23,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:23,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:23,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:23,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:23,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:23,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:23,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:23,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:23,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:23,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:23,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:23,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:23,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:23,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:23,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:23,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:23,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:25,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:13:27,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:27,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:27,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:27,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:27,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:27,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:27,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:27,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:27,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:27,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:27,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:27,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:27,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:27,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:27,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:27,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:28,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:28,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:28,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:28,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:28,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:28,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:28,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:28,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:28,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:28,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:28,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:28,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:28,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:28,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:28,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:28,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:28,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:28,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:28,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:28,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:28,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:28,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:28,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:28,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:29,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:29,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:29,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:29,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:29,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:29,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:29,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:29,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:29,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:13:31,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:31,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:31,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:31,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:31,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:31,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:31,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:31,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:31,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:31,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:31,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:31,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:31,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:31,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:31,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:31,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,248 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:13:32,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:32,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,071 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:13:33,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:13:33,128 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:13:33,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:33,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:37,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:13:39,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:39,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:39,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:39,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:39,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:39,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:39,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:39,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:39,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:39,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:39,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:39,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:39,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:39,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:39,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:39,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:41,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:13:43,074 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:13:43,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:43,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:43,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:43,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:43,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:43,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:43,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:43,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:43,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:43,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:43,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:43,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:43,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:43,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:43,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:43,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:44,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:44,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:44,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:44,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:44,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:44,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:44,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:44,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:44,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:44,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:44,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:44,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:44,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:44,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:44,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:44,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:47,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:13:47,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:47,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:47,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:47,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:47,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:47,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:47,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:47,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:47,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:47,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:47,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:47,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:47,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:47,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:47,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:47,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:47,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:47,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:47,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:47,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:47,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:47,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:47,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:47,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:47,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:47,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:47,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:47,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:47,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:47,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:47,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:47,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:48,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:13:48,548 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:13:49,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:13:52,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:52,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:52,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:52,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:52,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:52,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:52,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:52,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:52,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:52,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:52,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:52,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:52,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:52,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:52,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:52,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:53,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:13:53,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:53,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:53,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:53,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:53,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:53,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:53,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:53,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:53,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:53,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:53,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:53,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:53,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:53,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:53,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:53,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:54,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:57,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:13:58,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:58,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:58,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:58,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:58,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:58,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:58,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:58,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:58,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:58,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:58,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:58,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:58,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:58,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:58,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:58,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:58,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:58,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:58,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:58,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:58,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:58,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:58,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:58,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:58,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:58,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:58,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:58,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:58,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:58,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:58,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:58,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:13:59,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:14:01,081 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:14:02,325 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:14:03,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:14:03,845 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:14:05,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:05,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:05,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:05,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:05,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:05,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:05,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:05,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:05,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:05,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:05,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:05,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:05,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:05,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:05,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:05,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:05,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:14:06,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:06,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:06,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:06,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:06,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:06,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:06,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:06,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:06,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:06,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:06,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:06,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:06,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:06,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:06,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:06,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:07,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:14:08,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:08,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:08,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:08,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:08,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:08,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:08,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:08,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:08,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:08,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:08,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:08,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:08,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:08,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:08,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:08,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:08,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:08,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:08,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:08,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:08,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:08,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:08,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:08,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:08,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:08,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:08,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:08,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:08,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:08,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:08,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:08,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:09,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:14:11,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:11,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:11,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:11,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:11,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:11,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:11,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:11,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:11,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:11,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:11,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:11,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:11,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:11,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:11,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:11,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:13,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:14:14,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:14,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:14,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:14,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:14,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:14,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:14,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:14,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:14,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:14,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:14,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:14,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:14,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:14,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:14,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:14,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:15,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:14:16,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:16,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:16,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:16,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:16,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:16,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:16,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:16,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:16,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:16,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:16,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:16,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:16,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:16,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:16,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:16,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:17,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:14:19,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:14:19,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:14:19,330 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:14:19,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:19,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:19,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:19,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:19,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:19,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:19,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:19,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:19,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:19,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:19,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:19,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:19,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:19,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:19,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:19,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:21,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:14:21,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:21,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:21,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:21,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:21,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:21,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:21,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:21,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:21,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:21,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:21,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:21,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:21,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:21,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:21,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:21,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:22,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:22,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:22,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:22,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:22,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:22,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:22,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:22,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:22,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:22,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:22,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:22,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:22,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:22,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:22,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:22,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:23,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:14:25,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:14:27,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:14:28,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:28,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:28,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:28,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:28,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:28,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:28,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:28,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:28,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:28,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:28,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:28,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:28,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:28,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:28,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:28,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:29,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:14:31,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:14:32,400 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:14:33,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:14:34,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:14:34,554 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:14:35,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:14:37,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:14:39,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:14:41,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:14:43,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:14:45,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:14:46,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:46,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:46,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:46,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:46,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:46,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:46,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:46,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:46,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:46,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:46,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:46,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:46,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:46,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:46,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:46,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:47,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:14:47,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:47,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:47,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:47,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:47,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:47,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:47,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:47,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:47,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:47,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:47,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:47,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:47,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:47,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:47,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:47,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:49,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:14:49,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:14:49,785 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:14:51,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:14:53,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:14:55,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:14:55,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:55,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:55,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:55,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:55,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:55,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:55,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:55,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:55,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:55,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:55,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:55,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:55,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:55,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:55,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:55,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:57,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:14:58,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:58,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:58,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:58,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:58,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:58,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:58,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:58,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:58,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:58,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:58,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:58,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:58,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:58,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:58,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:58,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:59,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:14:59,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:59,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:59,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:59,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:59,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:59,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:59,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:59,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:59,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:59,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:59,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:59,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:59,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:59,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:59,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:14:59,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:00,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:00,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:00,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:00,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:00,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:00,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:00,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:00,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:00,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:00,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:00,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:00,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:02,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:15:02,473 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:15:05,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:15:05,002 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:15:12,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:15:12,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:12,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:12,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:12,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:12,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:12,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:12,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:12,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:12,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:12,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:12,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:12,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:12,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:12,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:12,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:12,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:15,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:15,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:15,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:15,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:15,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:15,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:15,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:15,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:15,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:15,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:15,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:15,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:15,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:15,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:15,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:15,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:18,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:15:19,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:19,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:19,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:19,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:19,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:19,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:19,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:19,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:19,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:19,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:19,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:19,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:19,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:19,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:19,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:19,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:19,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:19,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:19,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:19,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:19,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:19,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:19,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:19,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:19,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:19,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:19,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:19,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:19,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:19,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:19,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:19,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:20,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:15:20,233 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:15:22,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:15:22,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:22,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:22,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:22,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:22,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:22,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:22,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:22,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:22,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:22,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:22,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:22,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:22,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:22,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:22,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:22,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:27,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:27,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:27,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:27,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:27,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:27,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:27,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:27,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:27,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:27,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:27,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:27,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:27,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:27,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:27,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:27,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:27,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:27,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:27,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:27,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:27,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:27,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:27,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:27,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:27,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:27,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:27,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:27,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:27,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:27,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:27,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:27,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:28,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:15:28,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:28,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:28,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:28,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:28,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:28,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:28,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:28,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:28,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:28,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:28,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:28,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:28,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:28,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:28,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:28,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:29,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:29,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:29,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:29,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:29,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:29,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:29,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:29,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:29,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:29,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:29,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:29,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:29,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:29,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:29,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:29,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:29,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:29,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:29,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:29,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:29,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:29,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:29,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:29,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:29,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:29,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:29,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:29,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:29,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:29,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:29,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:29,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:32,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:15:32,548 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:15:35,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:15:35,791 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:15:36,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:15:36,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:36,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:36,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:36,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:36,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:36,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:36,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:36,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:36,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:36,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:36,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:36,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:36,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:36,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:36,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:36,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:38,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:15:38,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:38,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:38,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:38,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:38,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:38,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:38,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:38,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:38,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:38,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:38,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:38,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:38,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:38,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:38,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:38,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:40,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:41,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:41,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:41,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:41,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:41,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:41,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:41,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:41,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:41,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:41,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:41,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:41,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:41,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:41,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:41,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:41,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:15:42,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:42,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:43,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:43,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:43,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:43,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:43,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:43,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:43,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:43,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:43,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:43,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:43,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:43,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:43,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:43,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:43,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:43,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:45,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:45,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:45,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:45,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:45,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:45,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:45,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:45,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:45,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:45,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:45,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:45,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:45,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:45,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:45,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:45,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:47,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:15:49,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:15:51,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:15:51,176 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:15:51,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:51,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:51,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:51,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:51,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:51,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:51,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:51,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:51,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:51,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:51,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:51,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:51,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:51,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:51,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:51,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:53,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:15:53,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:53,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:53,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:53,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:53,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:53,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:53,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:53,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:53,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:53,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:53,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:53,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:53,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:53,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:53,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:53,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:54,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:54,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:54,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:54,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:54,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:54,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:54,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:54,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:54,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:54,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:54,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:54,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:54,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:54,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:54,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:54,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:55,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:15:58,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:58,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:58,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:58,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:58,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:58,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:58,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:58,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:58,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:58,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:58,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:58,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:58,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:58,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:58,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:58,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:59,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:15:59,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:59,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:59,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:59,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:59,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:59,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:59,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:59,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:59,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:59,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:59,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:59,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:59,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:59,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:59,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:15:59,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:01,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:16:02,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:02,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:02,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:02,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:02,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:02,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:02,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:02,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:02,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:02,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:02,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:02,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:02,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:02,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:02,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:02,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:02,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:02,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:02,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:02,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:02,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:02,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:02,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:02,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:02,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:02,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:02,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:02,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:02,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:02,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:02,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:02,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:02,622 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:16:03,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:03,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:03,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:03,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:03,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:03,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:03,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:03,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:03,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:03,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:03,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:03,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:03,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:03,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:03,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:03,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:05,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:16:06,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:06,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:06,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:06,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:06,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:06,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:06,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:06,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:06,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:06,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:06,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:06,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:06,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:06,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:06,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:06,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:06,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:16:06,426 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:16:06,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:06,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:06,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:06,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:06,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:06,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:06,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:06,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:06,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:06,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:06,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:06,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:06,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:06,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:06,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:06,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:07,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:16:07,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:07,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:07,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:07,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:07,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:07,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:07,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:07,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:07,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:07,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:07,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:07,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:07,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:07,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:07,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:07,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:11,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:16:13,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:16:14,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:14,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:14,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:14,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:14,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:14,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:14,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:14,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:14,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:14,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:14,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:14,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:14,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:14,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:14,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:14,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:15,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:16:15,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:15,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:15,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:15,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:15,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:15,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:15,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:15,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:15,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:15,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:15,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:15,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:15,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:15,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:15,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:15,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:17,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:16:19,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:19,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:19,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:19,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:19,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:19,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:19,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:19,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:19,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:19,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:19,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:19,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:19,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:19,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:19,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:19,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:19,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:19,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:19,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:19,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:19,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:19,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:19,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:19,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:19,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:19,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:19,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:19,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:19,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:19,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:19,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:19,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:20,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:20,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:20,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:20,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:20,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:20,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:20,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:20,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:20,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:20,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:20,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:20,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:20,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:20,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:20,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:20,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:21,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:16:21,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:16:21,653 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:16:23,140 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:16:24,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:24,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:24,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:24,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:24,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:24,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:24,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:24,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:24,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:24,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:24,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:24,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:24,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:24,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:24,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:24,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:25,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:16:25,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:25,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:25,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:25,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:25,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:25,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:25,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:25,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:25,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:25,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:25,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:25,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:25,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:25,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:25,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:25,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:27,142 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:16:29,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:16:29,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:29,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:29,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:29,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:29,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:29,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:29,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:29,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:29,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:29,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:29,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:29,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:29,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:29,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:29,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:29,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:30,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:30,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:30,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:30,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:30,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:30,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:30,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:30,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:30,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:30,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:30,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:30,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:30,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:30,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:30,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:30,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:31,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:16:32,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:32,699 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:16:32,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:32,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:32,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:32,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:32,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:32,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:32,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:32,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:32,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:32,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:32,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:32,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:32,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:32,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:32,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:33,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:16:34,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:34,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:34,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:34,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:34,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:34,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:34,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:34,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:34,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:34,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:34,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:34,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:34,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:34,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:34,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:34,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:35,145 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:16:36,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:16:36,952 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:16:37,146 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:16:39,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:16:41,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:16:43,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:16:45,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:16:47,150 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:16:49,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:16:51,152 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:16:52,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:16:52,216 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:16:52,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:52,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:53,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:53,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:53,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:53,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:53,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:53,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:53,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:53,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:53,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:53,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:53,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:53,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:53,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:53,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:53,152 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:16:54,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:54,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:54,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:54,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:54,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:54,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:54,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:54,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:54,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:54,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:54,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:54,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:54,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:54,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:54,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:54,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:16:55,153 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:16:57,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:16:59,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:17:00,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:00,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:00,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:00,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:00,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:00,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:00,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:00,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:00,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:00,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:00,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:00,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:00,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:00,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:00,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:00,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:01,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:17:02,774 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:17:03,157 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:17:03,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:03,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:03,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:03,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:03,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:03,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:03,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:03,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:03,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:03,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:03,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:03,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:03,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:03,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:03,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:03,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:03,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:03,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:03,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:03,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:03,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:03,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:03,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:03,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:03,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:03,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:03,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:03,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:03,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 20:17:04,036 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 20:17:04,292 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 20:17:04,374 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 20:17:05,265 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 20:17:05,265 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:17:07,265 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:17:07,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:17:07,498 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:17:09,266 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:17:11,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:17:13,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:17:15,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:17:17,270 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:17:19,271 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:17:21,271 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:17:22,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:17:22,739 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:17:23,272 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:17:25,273 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:17:27,274 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:17:29,275 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:17:31,276 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:17:32,895 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:17:33,277 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:17:35,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:17:38,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:17:38,066 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:17:38,279 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:17:40,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:17:42,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:17:44,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:17:46,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:17:48,283 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:17:50,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:17:52,285 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:17:54,286 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:17:54,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:17:54,605 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:17:56,286 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:17:58,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:18:00,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:18:02,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:18:02,971 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:18:04,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:18:06,290 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:18:08,290 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:18:09,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:18:09,927 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:18:10,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:18:12,292 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:18:14,292 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:18:16,293 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:18:18,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:18:20,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:18:22,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:18:24,296 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:18:25,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:18:25,298 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:18:26,297 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:18:28,297 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:18:30,298 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:18:32,299 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:18:33,044 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:18:34,299 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:18:36,300 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:18:38,301 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:18:40,301 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:18:41,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:18:41,088 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:18:42,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:18:44,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:18:46,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:18:48,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:18:50,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:18:52,306 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:18:54,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:18:56,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:18:56,421 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:18:57,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:18:59,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:19:01,310 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:19:03,116 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:19:03,311 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:19:05,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:19:07,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:19:09,313 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:19:11,314 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:19:12,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:19:12,250 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:19:13,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:19:15,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:19:17,316 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:19:19,316 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:19:21,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:19:23,318 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:19:25,319 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:19:27,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:19:27,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:19:27,474 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:19:29,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:19:31,321 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:19:33,189 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:19:33,322 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:19:35,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:19:37,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:19:39,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:19:41,326 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:19:42,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:19:42,867 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:19:43,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:19:45,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:19:47,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:19:49,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:19:51,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:19:53,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:19:55,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:19:57,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:19:58,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:19:58,135 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:19:59,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:20:01,335 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:20:03,265 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:20:04,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:20:06,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:20:08,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:20:10,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:20:12,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:20:13,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:20:13,496 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:20:14,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:20:16,342 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:20:18,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:20:20,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:20:22,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:20:24,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:20:26,346 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:20:28,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:20:28,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:20:28,792 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:20:30,348 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:20:32,348 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:20:33,340 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:20:34,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:20:36,350 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:20:38,350 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:20:40,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:20:42,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:20:44,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:20:44,016 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:20:44,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:20:47,354 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:20:49,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:20:51,356 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:20:53,356 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:20:55,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:20:57,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:20:59,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:20:59,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:20:59,380 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:21:01,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:21:03,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:21:03,413 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:21:05,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:21:07,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:21:09,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:21:11,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:21:13,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:21:14,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:21:14,602 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:21:15,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:21:17,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:21:19,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:21:21,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:21:23,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:21:25,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:21:27,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:21:29,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:21:29,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:21:29,941 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:21:31,371 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:21:33,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:21:33,488 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:21:35,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:21:37,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:21:39,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:21:41,376 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:21:43,377 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:21:45,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:21:45,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:21:45,612 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:21:47,379 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:21:49,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:21:51,381 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:21:53,382 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:21:56,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:21:58,384 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:22:00,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:22:01,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:22:01,047 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:22:02,386 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:22:03,563 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:22:04,387 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:22:06,388 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:22:08,389 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:22:10,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:22:12,391 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:22:14,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:22:16,393 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:22:16,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:22:16,394 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:22:18,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:22:20,395 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:22:22,396 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:22:24,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:22:26,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:22:28,399 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:22:30,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:22:31,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:22:31,824 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:22:32,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:22:33,644 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:22:34,402 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:22:36,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:22:38,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:22:40,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:22:42,406 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:22:44,407 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:22:46,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:22:47,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:22:47,147 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:22:48,409 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:22:50,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:22:52,411 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:22:54,412 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:22:56,413 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:22:58,414 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:23:00,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:23:02,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:23:02,373 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:23:02,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:23:03,715 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:23:04,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:23:06,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:23:08,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:23:10,419 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:23:12,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:23:14,421 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:23:16,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:23:17,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:23:17,678 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:23:18,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:23:20,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:23:22,425 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:23:24,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:23:27,428 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:23:29,429 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:23:31,429 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:23:32,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:23:32,968 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:23:33,430 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:23:33,789 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:23:35,431 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:23:37,432 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:23:39,433 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:23:41,434 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:23:43,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:23:45,436 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:23:47,437 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:23:48,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:23:48,231 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:23:49,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:23:51,439 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:23:53,440 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:23:55,441 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:23:57,442 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:23:59,443 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:24:01,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:24:03,445 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:24:03,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:24:03,489 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:24:03,856 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:24:05,446 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:24:07,447 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:24:09,448 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:24:11,449 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:24:13,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:24:15,451 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:24:17,452 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:24:18,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:24:18,864 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:24:19,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:24:21,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:24:23,455 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:24:25,456 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:24:28,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:24:30,458 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:24:32,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:24:33,931 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:24:34,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:24:34,094 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:24:34,460 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:24:36,461 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:24:38,461 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:24:40,462 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:24:42,463 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:24:44,464 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:24:46,465 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:24:48,466 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:24:49,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:24:49,375 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:24:50,467 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:24:52,468 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:24:54,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:24:56,470 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:24:58,470 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:25:00,471 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:25:02,472 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:25:04,005 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:25:04,473 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:25:04,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:25:04,787 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:25:06,474 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:25:08,474 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:25:10,475 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:25:12,476 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:25:14,477 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:25:16,478 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:25:18,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:25:20,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:25:20,077 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:25:20,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:25:22,480 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:25:24,481 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:25:26,482 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:25:28,483 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:25:30,484 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:25:33,485 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:25:34,084 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:25:35,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:25:35,370 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:25:35,486 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:25:37,486 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:25:39,487 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:25:41,488 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:25:43,489 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:25:45,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:25:47,491 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:25:49,491 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:25:51,493 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:25:52,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:25:52,593 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:25:53,493 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:25:55,494 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:25:57,495 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:25:59,496 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:26:01,497 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:26:03,498 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:26:04,159 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:26:05,499 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:26:07,499 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:26:07,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:26:07,817 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:26:09,500 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:26:11,501 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:26:13,502 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:26:15,503 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:26:17,504 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:26:19,505 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:26:21,506 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:26:23,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:26:23,260 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:26:23,506 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:26:25,507 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:26:27,508 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:26:29,509 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:26:31,511 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:26:34,240 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:26:34,512 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:26:36,513 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:26:38,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:26:38,483 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:26:38,514 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:26:40,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:26:42,516 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:26:44,517 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:26:46,518 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:26:48,519 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:26:50,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:26:52,521 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:26:53,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:26:53,708 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:26:54,522 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:26:56,523 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:26:58,524 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:27:00,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:27:02,526 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:27:04,314 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:27:04,527 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:27:06,528 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:27:08,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:27:09,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:27:09,122 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:27:10,530 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:27:12,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:27:14,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:27:16,532 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:27:18,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:27:20,534 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:27:22,535 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:27:24,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:27:24,400 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:27:24,536 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:27:26,537 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:27:28,538 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:27:31,539 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:27:33,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:27:34,392 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:27:35,541 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:27:37,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:27:39,543 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:27:39,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:27:39,739 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:27:41,544 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:27:43,545 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:27:45,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:27:47,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:27:49,547 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:27:51,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:27:53,549 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:27:54,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:27:54,967 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:27:55,550 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:27:57,551 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:27:59,552 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:28:01,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:28:03,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:28:04,466 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:28:05,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:28:07,555 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:28:09,556 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:28:10,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:28:10,250 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:28:11,557 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:28:13,558 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:28:15,559 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:28:17,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:28:19,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:28:21,561 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:28:23,562 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:28:25,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:28:25,562 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:28:25,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:28:27,567 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:28:29,567 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:28:31,568 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:28:33,569 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:28:34,538 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:28:35,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:28:37,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:28:39,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:28:40,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:28:40,786 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:28:41,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:28:43,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:28:45,574 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:28:47,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:28:49,576 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:28:51,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:28:53,578 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:28:55,579 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:28:56,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:28:56,256 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:28:57,579 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:28:59,580 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:29:01,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:29:03,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:29:04,611 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:29:05,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:29:07,583 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:29:10,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:29:11,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:29:11,711 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:29:12,585 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:29:14,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:29:16,587 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:29:18,587 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:29:20,588 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:29:22,589 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:29:24,590 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:29:26,591 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:29:27,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:29:27,143 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:29:28,592 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:29:30,593 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:29:32,594 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:29:34,594 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:29:34,683 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:29:36,595 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:29:38,596 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:29:40,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:29:42,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:29:42,569 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:29:42,598 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:29:44,599 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:29:46,599 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:29:48,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:29:50,601 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:29:52,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:29:54,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:29:56,603 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:29:57,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:29:57,834 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:29:58,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:30:00,605 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:30:02,605 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:30:04,606 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:30:04,742 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:30:06,607 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:30:08,608 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:30:10,609 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:30:12,610 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:30:13,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:30:13,313 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:30:14,610 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:30:16,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:30:18,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:30:20,613 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:30:23,614 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:30:25,615 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:30:27,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:30:28,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:30:28,620 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:30:29,617 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:30:31,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:30:33,619 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:30:34,817 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:30:35,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:30:37,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:30:39,621 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:30:41,622 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:30:43,623 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:30:43,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:30:43,843 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:30:45,624 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:30:47,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:30:49,626 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:30:51,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:30:53,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:30:55,629 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:30:57,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:30:59,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:30:59,081 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:30:59,631 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:31:01,632 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:31:03,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:31:04,893 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:31:05,634 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:31:07,635 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:31:09,636 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:31:11,637 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:31:13,638 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:31:14,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:31:14,503 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:31:15,639 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:31:17,640 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:31:19,641 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:31:21,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:31:23,643 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:31:25,644 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:31:27,644 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:31:29,645 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:31:29,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:31:29,781 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:31:31,646 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:31:33,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:31:34,966 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:31:35,648 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:31:37,649 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:31:39,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:31:42,652 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:31:44,652 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:31:45,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:31:45,006 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:31:46,654 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:31:48,655 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:31:50,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:31:52,657 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:31:54,658 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:31:56,659 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:31:58,660 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:32:00,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:32:00,351 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:32:00,661 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:32:02,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:32:04,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:32:05,036 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:32:06,663 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:32:08,664 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:32:10,665 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:32:12,666 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:32:14,667 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:32:15,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:32:15,736 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:32:16,668 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:32:18,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:32:20,670 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:32:22,671 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:32:24,672 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:32:26,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:32:28,674 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:32:30,675 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:32:31,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:32:31,015 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:32:32,676 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:32:34,676 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:32:35,108 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:32:36,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:32:38,678 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:32:40,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:32:42,680 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:32:44,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:32:46,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:32:46,243 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:32:46,682 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:32:48,683 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:32:50,683 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:32:52,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:32:54,685 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:32:56,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:32:58,687 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:33:00,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:33:01,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:33:01,509 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:33:02,689 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:33:04,690 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:33:05,182 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:33:06,690 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:33:08,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:33:10,692 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:33:12,692 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:33:14,693 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:33:16,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:33:16,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:33:16,739 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:33:18,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:33:20,695 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:33:22,696 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:33:24,697 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:33:26,698 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:33:28,699 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:33:30,700 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:33:31,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:33:31,975 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:33:33,702 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:33:35,255 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:33:35,703 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:33:37,704 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:33:39,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:33:41,706 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:33:43,707 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:33:45,708 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:33:47,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:33:47,304 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:33:47,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:33:49,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:33:51,710 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:33:53,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:33:55,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:33:57,713 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:33:59,714 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:34:01,715 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:34:02,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:34:02,531 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:34:03,716 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:34:05,327 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:34:05,717 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:34:07,718 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:34:09,719 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:34:11,720 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:34:13,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:34:15,722 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:34:17,723 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:34:17,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:34:17,788 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:34:19,724 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:34:21,725 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:34:23,726 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:34:25,727 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:34:27,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:34:29,729 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:34:31,730 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:34:33,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:34:33,103 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:34:33,733 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:34:35,390 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:34:36,734 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:34:38,735 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:34:40,735 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:34:42,736 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:34:44,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:34:46,738 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:34:48,738 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:34:48,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:34:48,865 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:34:50,739 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:34:52,740 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:34:54,741 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:34:56,741 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:34:58,742 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:35:00,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:35:02,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:35:04,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:35:04,148 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:35:04,744 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:35:05,453 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:35:06,745 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:35:08,746 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:35:10,747 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:35:12,747 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:35:14,748 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:35:16,749 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:35:18,750 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:35:19,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:35:19,435 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:35:20,751 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:35:22,752 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:35:24,753 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:35:26,754 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:35:28,755 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:35:30,756 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:35:32,757 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:35:34,758 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:35:34,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:35:34,770 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:35:35,536 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:35:36,759 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:35:38,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:35:40,761 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:35:42,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:35:44,763 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:35:46,764 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:35:48,764 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:35:50,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:35:50,361 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:35:50,766 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:35:52,766 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:35:54,767 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:35:56,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:35:58,769 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:36:00,770 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:36:02,771 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:36:05,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:36:05,604 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:36:05,772 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:36:06,034 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:36:07,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:36:09,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:36:11,775 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:36:13,775 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:36:15,776 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:36:17,777 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:36:19,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:36:21,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:36:21,132 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:36:21,779 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:36:23,780 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:36:25,781 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:36:27,782 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:36:29,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:36:31,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:36:33,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:36:35,686 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:36:35,785 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:36:36,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:36:36,495 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:36:37,786 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:36:39,787 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:36:41,788 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:36:43,788 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:36:45,789 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:36:47,790 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:36:49,791 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:36:51,792 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:36:51,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:36:51,829 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:36:53,793 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:36:55,794 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:36:57,795 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:36:59,795 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:37:01,796 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:37:03,797 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:37:05,765 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:37:05,798 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:37:07,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:37:07,062 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:37:07,799 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:37:09,800 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:37:11,800 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:37:13,801 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:37:15,802 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:37:17,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:37:19,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:37:21,804 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:37:22,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:37:22,411 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:37:23,805 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:37:25,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:37:27,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:37:29,807 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:37:31,808 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:37:33,809 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:37:35,810 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:37:35,842 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:37:37,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:37:37,737 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:37:37,810 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:37:39,811 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:37:41,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:37:43,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:37:45,813 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:37:47,814 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:37:49,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:37:51,816 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:37:52,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:37:52,984 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:37:53,817 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:37:56,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:37:58,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:38:00,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:38:02,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:38:04,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:38:05,916 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:38:06,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:38:08,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:38:08,208 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:38:08,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:38:10,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:38:12,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:38:14,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:38:16,826 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:38:18,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:38:20,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:38:22,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:38:23,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:38:23,482 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:38:24,829 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:38:26,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:38:28,831 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:38:30,831 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:38:32,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:38:34,833 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:38:35,992 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:38:36,834 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:38:38,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:38:38,795 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:38:38,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:38:40,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:38:42,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:38:44,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:38:46,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:38:48,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:38:50,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:38:52,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:38:54,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:38:54,072 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:38:54,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:38:56,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:38:59,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:39:01,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:39:03,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:39:05,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:39:06,068 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:39:07,846 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:39:09,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:39:09,392 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:39:09,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:39:11,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:39:13,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:39:15,849 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:39:17,850 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:39:19,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:39:21,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:39:23,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:39:24,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:39:24,685 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:39:25,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:39:27,854 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:39:29,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:39:31,856 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:39:33,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:39:35,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:39:36,143 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:39:37,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:39:39,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:39:39,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:39:39,980 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:39:41,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:39:43,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:39:45,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:39:47,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:39:49,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:39:51,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:39:53,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:39:55,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:39:55,197 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:39:55,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:39:57,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:39:59,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:40:01,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:40:03,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:40:05,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:40:06,220 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:40:07,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:40:09,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:40:10,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:40:10,430 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:40:11,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:40:13,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:40:15,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:40:17,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:40:19,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:40:21,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:40:24,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:40:25,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:40:25,660 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:40:26,882 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:40:28,883 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:40:30,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:40:32,885 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:40:34,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:40:36,296 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:40:36,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:40:38,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:40:40,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:40:41,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:40:41,001 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:40:42,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:40:44,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:40:46,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:40:48,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:40:50,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:40:52,894 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:40:54,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:40:56,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:40:56,309 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:40:56,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:40:58,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:41:00,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:41:02,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:41:04,900 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:41:06,372 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:41:06,901 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:41:08,902 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:41:10,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:41:11,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:41:11,571 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:41:12,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:41:14,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:41:16,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:41:18,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:41:20,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:41:22,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:41:24,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:41:26,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:41:26,813 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:41:26,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:41:28,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:41:30,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:41:32,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:41:34,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:41:36,446 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:41:36,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:41:38,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:41:40,916 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:41:42,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:41:42,058 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:41:42,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:41:44,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:41:46,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:41:48,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:41:50,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:41:52,921 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:41:54,922 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:41:56,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:41:57,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:41:57,556 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:41:58,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:42:00,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:42:02,925 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:42:04,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:42:06,520 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:42:06,927 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:42:09,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:42:11,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:42:12,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:42:12,819 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:42:13,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:42:15,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:42:17,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:42:19,932 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:42:21,932 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:42:23,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:42:25,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:42:27,935 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:42:28,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:42:28,373 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:42:29,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:42:31,937 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:42:33,937 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:42:35,938 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:42:36,580 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:42:37,939 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:42:39,940 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:42:41,941 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:42:43,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:42:43,656 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:42:43,941 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:42:45,942 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:42:47,943 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:42:49,944 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:42:51,945 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:42:53,946 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:42:55,947 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:42:57,948 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:42:58,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:42:58,877 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:42:59,949 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:43:01,949 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:43:03,950 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:43:05,951 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:43:06,653 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:43:07,952 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:43:09,953 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:43:11,954 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:43:13,955 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:43:14,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:43:14,346 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:43:15,955 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:43:17,956 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:43:19,957 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:43:21,958 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:43:23,959 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:43:25,960 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:43:27,961 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:43:29,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:43:29,644 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:43:29,961 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:43:31,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:43:33,963 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:43:35,964 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:43:36,723 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:43:37,965 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:43:39,966 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:43:42,967 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:43:44,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:43:44,898 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:43:44,968 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:43:46,969 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:43:48,970 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:43:50,971 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:43:52,972 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:43:54,973 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:43:56,973 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:43:58,974 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:44:00,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:44:00,191 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:44:00,975 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:44:02,976 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:44:04,977 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:44:06,794 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:44:06,978 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:44:08,979 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:44:10,980 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:44:12,981 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:44:14,982 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:44:15,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:44:15,427 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:44:16,983 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:44:18,984 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:44:20,985 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:44:22,986 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:44:24,987 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:44:26,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:44:28,989 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:44:30,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:44:30,813 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:44:30,989 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:44:32,991 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:44:34,991 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:44:36,869 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:44:36,992 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:44:38,993 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:44:40,994 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:44:42,995 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:44:44,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:44:46,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:44:46,077 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:44:46,997 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:44:48,998 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:44:50,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:44:53,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:44:55,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:44:57,001 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:44:59,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:45:01,003 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:45:01,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:45:01,446 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:45:03,004 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:45:05,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:45:06,945 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:45:07,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:45:09,007 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:45:11,008 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:45:13,009 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:45:15,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:45:16,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:45:16,674 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:45:17,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:45:19,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:45:21,012 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:45:23,013 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:45:26,015 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:45:28,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:45:30,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:45:32,017 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:45:32,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:45:32,136 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:45:34,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:45:36,019 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:45:37,022 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:45:38,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:45:40,021 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:45:42,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:45:44,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:45:46,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:45:47,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:45:47,485 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:45:48,025 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:45:50,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:45:52,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:45:54,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:45:56,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:45:58,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:46:00,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:46:02,031 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:46:02,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:46:02,710 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:46:04,032 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:46:06,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:46:07,101 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:46:08,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:46:10,034 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:46:12,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:46:15,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:46:17,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:46:17,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:46:17,937 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:46:19,038 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:46:21,039 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:46:23,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:46:25,041 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:46:27,042 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:46:29,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:46:31,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:46:33,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:46:33,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:46:33,232 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:46:35,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:46:37,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:46:37,177 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:46:39,047 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:46:41,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:46:43,049 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:46:45,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:46:47,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:46:48,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:46:48,658 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:46:49,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:46:51,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:46:53,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:46:55,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:46:57,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:46:59,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:47:01,056 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:47:03,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:47:03,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:47:03,893 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:47:05,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:47:07,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:47:07,246 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:47:09,059 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:47:11,060 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:47:13,061 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:47:16,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:47:18,063 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:47:19,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:47:19,269 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:47:20,063 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:47:22,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:47:24,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:47:26,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:47:28,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:47:30,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:47:32,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:47:34,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:47:34,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:47:34,559 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:47:36,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:47:37,322 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:47:38,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:47:40,071 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:47:42,071 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:47:44,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:47:46,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:47:48,074 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:47:49,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:47:49,789 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:47:50,074 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:47:52,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:47:54,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:47:56,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:47:58,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:48:00,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:48:02,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:48:04,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:48:05,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:48:05,032 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:48:06,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:48:07,399 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:48:08,081 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:48:10,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:48:12,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:48:14,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:48:16,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:48:18,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:48:20,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:48:20,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:48:20,259 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:48:22,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:48:24,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:48:26,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:48:28,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:48:30,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:48:32,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:48:35,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:48:35,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:48:35,479 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:48:37,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:48:37,473 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:48:39,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:48:41,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:48:43,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:48:45,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:48:47,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:48:49,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:48:50,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:48:50,744 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:48:51,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:48:53,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:48:55,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:48:57,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:48:59,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:49:01,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:49:03,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:49:05,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:49:06,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:49:06,033 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:49:07,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:49:07,549 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:49:09,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:49:11,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:49:13,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:49:15,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:49:17,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:49:19,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:49:21,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:49:21,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:49:21,393 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:49:23,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:49:25,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:49:27,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:49:29,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:49:31,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:49:33,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:49:35,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:49:36,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:49:36,759 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:49:37,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:49:37,623 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:49:39,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:49:41,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:49:43,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:49:45,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:49:47,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:49:49,121 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:49:51,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:49:52,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:49:52,080 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:49:53,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:49:55,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:49:58,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:50:00,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:50:02,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:50:04,128 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:50:06,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:50:07,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:50:07,309 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:50:08,132 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:50:08,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:50:10,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:50:12,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:50:14,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:50:16,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:50:18,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:50:20,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:50:22,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:50:23,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:50:23,134 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:50:24,142 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:50:26,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:50:28,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:50:30,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:50:32,145 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:50:34,146 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:50:36,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:50:37,776 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:50:38,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:50:38,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:50:38,461 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:50:40,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:50:42,150 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:50:44,150 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:50:46,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:50:48,152 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:50:50,153 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:50:52,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:50:53,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:50:53,923 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:50:54,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:50:56,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:50:58,157 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:51:00,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:51:02,159 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:51:04,160 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:51:06,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:51:07,851 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:51:08,163 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:51:09,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:51:09,147 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:51:10,164 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:51:12,165 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:51:14,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:51:16,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:51:18,168 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:51:21,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:51:23,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:51:24,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:51:24,399 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:51:25,172 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:51:27,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:51:29,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:51:31,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:51:33,175 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:51:35,176 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:51:37,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:51:37,929 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:51:39,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:51:39,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:51:39,639 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:51:41,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:51:43,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:51:45,182 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:51:47,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:51:49,184 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:51:51,184 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:51:53,185 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:51:55,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:51:55,049 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:51:55,186 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:51:57,187 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:51:59,188 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:52:01,189 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:52:03,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:52:05,191 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:52:07,192 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:52:08,006 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:52:09,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:52:10,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:52:10,309 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:52:11,194 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:52:13,195 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:52:15,196 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:52:17,197 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:52:20,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:52:22,199 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:52:24,200 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:52:25,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:52:25,639 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:52:26,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:52:28,202 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:52:30,203 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:52:32,204 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:52:34,205 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:52:36,206 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:52:38,083 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:52:38,207 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:52:40,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:52:41,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:52:41,013 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:52:42,209 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:52:44,210 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:52:46,211 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:52:48,212 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:52:50,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:52:52,215 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:52:54,216 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:52:56,217 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:52:56,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:52:56,430 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:52:58,218 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:53:00,219 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:53:02,220 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:53:04,221 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:53:06,222 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:53:08,159 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:53:08,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:53:10,224 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:53:11,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:53:11,655 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:53:12,225 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:53:14,226 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:53:16,227 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:53:18,228 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:53:20,229 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:53:22,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:53:24,231 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:53:26,232 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:53:26,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:53:26,903 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:53:28,233 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:53:30,234 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:53:32,235 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:53:34,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:53:36,237 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:53:38,234 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:53:38,238 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:53:40,239 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:53:42,240 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:53:42,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:53:42,337 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:53:45,241 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:53:47,242 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:53:49,243 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:53:51,244 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:53:53,245 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:53:55,246 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:53:57,247 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:53:57,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:53:57,562 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:53:59,248 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:54:01,248 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:54:03,250 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:54:05,251 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:54:07,252 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:54:09,114 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:54:09,252 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:54:11,253 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:54:13,254 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:54:15,255 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:54:17,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:54:17,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:54:17,563 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:54:19,257 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:54:21,258 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:54:23,258 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:54:25,259 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:54:27,260 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:54:29,261 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:54:31,262 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:54:32,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:54:32,784 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:54:33,263 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:54:35,264 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:54:37,265 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:54:38,370 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:54:39,266 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:54:41,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:54:43,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:54:45,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:54:47,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:54:48,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:54:48,037 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:54:49,270 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:54:51,271 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:54:53,272 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:54:55,273 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:54:57,274 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:54:59,275 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:55:01,276 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:55:03,277 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:55:03,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:55:03,325 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:55:05,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:55:07,279 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:55:08,440 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:55:09,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:55:11,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:55:13,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:55:15,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:55:17,285 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:55:18,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:55:18,556 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:55:19,286 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:55:21,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:55:23,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:55:25,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:55:27,290 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:55:29,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:55:32,293 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:55:33,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:55:33,829 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:55:34,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:55:36,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:55:38,296 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:55:38,515 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:55:40,297 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:55:42,298 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:55:44,299 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:55:46,300 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:55:48,301 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:55:49,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:55:49,172 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:55:50,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:55:52,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:55:54,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:55:56,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:55:58,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:56:00,306 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:56:02,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:56:04,308 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:56:04,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:56:04,424 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:56:06,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:56:08,310 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:56:08,582 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:56:10,311 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:56:12,311 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:56:14,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:56:16,313 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:56:18,314 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:56:19,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:56:19,651 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:56:20,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:56:22,316 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:56:24,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:56:26,318 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:56:28,319 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:56:30,319 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:56:33,321 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:56:34,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:56:34,944 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:56:35,322 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:56:37,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:56:38,660 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:56:39,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:56:41,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:56:43,326 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:56:45,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:56:47,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:56:49,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:56:50,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:56:50,182 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:56:51,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:56:53,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:56:55,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:56:57,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:56:59,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:57:01,335 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:57:03,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:57:05,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:57:05,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:57:05,495 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:57:07,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:57:08,735 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:57:09,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:57:11,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:57:13,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:57:15,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:57:17,342 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:57:19,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:57:20,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:57:20,727 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:57:21,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:57:23,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:57:25,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:57:27,346 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:57:29,348 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:57:32,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:57:34,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:57:36,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:57:36,020 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:57:36,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:57:38,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:57:38,809 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:57:40,354 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:57:42,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:57:44,356 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:57:46,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:57:48,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:57:50,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:57:51,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:57:51,280 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:57:52,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:57:54,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:57:56,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:57:58,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:58:00,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:58:02,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:58:04,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:58:06,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:58:06,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:58:06,505 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:58:08,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:58:08,882 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:58:10,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:58:12,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:58:14,371 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:58:16,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:58:18,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:58:20,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:58:21,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:58:21,791 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:58:22,376 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:58:24,377 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:58:26,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:58:28,379 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:58:30,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:58:32,381 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:58:34,382 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:58:36,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:58:37,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:58:37,066 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:58:38,384 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:58:38,959 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:58:40,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:58:42,386 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:58:44,387 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:58:46,388 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:58:48,389 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:58:50,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:58:52,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:58:52,297 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:58:52,391 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:58:55,393 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:58:57,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:58:59,395 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:59:01,396 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:59:03,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:59:05,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:59:07,399 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:59:07,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:59:07,682 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:59:09,037 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:59:09,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:59:11,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:59:13,402 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:59:15,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:59:17,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:59:19,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:59:21,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:59:22,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:59:22,979 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:59:23,406 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:59:25,406 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:59:27,407 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:59:29,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:59:31,409 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:59:33,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:59:35,411 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:59:37,412 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:59:38,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:59:38,430 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:59:39,111 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 20:59:39,413 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:59:41,414 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:59:43,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:59:45,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:59:47,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:59:49,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:59:51,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:59:53,419 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:59:53,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 20:59:53,698 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 20:59:55,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:59:57,421 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 20:59:59,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:00:01,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:00:03,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:00:05,425 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:00:07,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:00:08,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:00:08,959 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:00:09,183 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:00:09,427 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:00:11,428 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:00:14,429 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:00:16,430 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:00:18,431 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:00:20,432 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:00:22,433 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:00:24,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:00:24,181 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:00:24,434 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:00:26,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:00:28,436 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:00:30,437 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:00:32,437 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:00:34,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:00:36,439 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:00:38,441 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:00:39,259 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:00:39,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:00:39,407 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:00:40,442 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:00:42,442 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:00:44,443 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:00:46,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:00:48,445 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:00:50,446 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:00:52,447 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:00:54,448 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:00:54,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:00:54,633 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:00:56,449 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:00:58,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:01:00,451 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:01:09,337 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:01:09,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:01:09,857 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:01:25,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:01:25,123 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:01:39,412 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:01:40,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:01:40,547 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:01:55,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:01:55,815 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:02:00,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:02:00,451 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 21:02:00,504 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 21:02:00,583 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 21:02:01,521 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 21:02:02,521 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:02:09,508 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:02:09,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:02:11,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:02:11,083 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:02:26,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:02:26,320 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:02:31,539 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:02:39,588 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:02:41,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:02:41,550 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:02:56,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:02:56,808 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:03:09,664 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:03:12,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:03:12,087 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:03:27,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:03:27,321 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:03:39,741 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:03:42,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:03:42,579 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:03:57,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:03:57,836 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:04:09,818 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:04:13,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:04:13,064 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:04:28,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:04:28,295 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:04:39,894 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:04:43,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:04:43,520 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:04:58,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:04:58,784 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:05:09,970 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:05:14,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:05:14,079 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:05:24,617 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:05:25,617 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:05:29,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:05:29,323 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:05:40,044 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:05:44,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:05:44,554 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:05:59,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:05:59,778 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:06:10,122 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:06:15,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:06:15,006 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:06:22,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:06:23,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:06:25,643 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:06:30,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:06:30,290 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:06:30,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:30,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:30,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:30,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:30,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:30,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:30,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:30,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:30,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:30,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:30,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:30,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:30,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:30,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:30,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:30,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:33,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:06:37,648 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:06:39,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:39,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:39,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:39,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:39,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:39,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:39,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:39,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:39,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:39,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:39,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:39,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:39,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:39,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:39,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:39,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:40,187 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:06:41,649 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:06:41,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:41,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:41,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:41,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:41,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:41,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:41,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:41,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:41,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:41,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:41,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:41,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:41,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:41,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:41,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:41,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:41,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:41,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:41,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:41,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:41,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:41,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:41,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:41,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:41,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:41,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:41,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:41,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:41,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:41,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:41,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:41,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:45,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:06:45,521 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:06:45,651 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:06:49,652 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:06:50,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:50,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:50,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:50,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:50,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:50,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:50,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:50,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:50,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:50,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:50,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:50,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:50,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:50,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:50,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:50,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:51,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:51,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:51,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:51,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:51,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:51,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:51,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:51,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:51,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:51,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:51,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:51,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:51,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:51,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:51,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:51,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:51,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:51,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:51,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:51,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:51,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:51,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:51,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:51,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:51,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:51,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:51,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:51,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:51,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:51,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:51,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:51,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:52,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:52,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:52,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:52,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:52,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:52,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:52,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:52,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:52,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:52,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:52,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:52,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:52,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:52,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:52,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:52,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:53,654 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:06:57,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:06:58,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:58,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:58,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:58,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:58,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:58,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:58,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:58,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:58,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:58,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:58,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:58,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:58,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:58,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:58,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:58,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:58,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:58,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:58,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:58,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:58,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:58,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:58,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:58,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:58,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:58,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:58,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:58,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:58,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:58,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:58,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:58,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:06:59,657 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:07:00,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:00,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:00,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:00,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:00,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:00,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:00,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:00,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:00,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:00,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:00,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:00,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:00,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:00,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:00,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:00,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:00,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:07:00,811 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:07:01,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:01,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:01,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:01,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:01,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:01,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:01,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:01,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:01,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:01,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:01,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:01,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:01,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:01,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:01,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:01,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,659 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:07:03,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:03,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:05,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:05,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:05,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:05,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:05,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:05,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:05,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:05,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:05,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:05,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:05,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:05,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:05,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:05,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:05,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:05,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:06,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:06,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:06,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:06,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:06,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:06,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:06,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:06,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:06,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:06,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:06,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:06,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:06,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:06,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:06,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:06,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:07,661 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:07:09,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:09,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:09,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:09,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:09,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:09,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:09,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:09,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:09,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:09,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:09,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:09,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:09,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:09,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:09,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:09,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:09,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:07:09,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:09,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:09,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:09,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:09,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:09,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:09,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:09,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:09,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:09,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:09,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:09,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:09,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:09,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:09,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:09,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:10,258 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:07:11,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:11,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:11,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:11,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:11,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:11,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:11,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:11,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:11,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:11,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:11,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:11,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:11,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:11,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:11,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:11,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:11,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:11,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:11,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:11,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:11,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:11,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:11,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:11,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:11,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:11,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:11,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:11,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:11,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:11,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:11,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:11,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:12,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:12,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:12,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:12,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:12,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:12,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:12,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:12,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:12,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:12,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:12,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:12,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:12,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:12,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:12,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:12,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:13,663 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:07:15,664 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:07:15,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:15,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:15,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:15,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:15,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:15,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:15,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:15,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:15,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:15,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:15,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:15,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:15,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:15,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:15,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:15,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:16,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:07:16,142 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:07:17,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:17,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:17,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:17,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:17,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:17,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:17,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:17,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:17,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:17,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:17,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:17,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:17,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:17,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:17,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:17,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:17,665 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:07:20,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:20,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:20,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:20,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:20,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:20,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:20,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:20,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:20,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:20,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:20,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:20,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:20,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:20,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:20,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:20,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:20,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:20,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:20,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:20,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:20,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:20,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:20,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:20,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:20,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:20,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:20,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:20,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:20,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:20,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:20,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:20,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:21,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:21,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:21,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:21,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:21,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:21,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:21,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:21,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:21,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:21,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:21,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:21,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:21,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:21,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:21,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:21,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:22,667 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:07:23,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:23,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:23,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:23,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:23,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:23,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:23,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:23,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:23,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:23,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:23,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:23,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:23,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:23,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:23,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:23,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:24,668 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:07:25,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:25,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:25,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:25,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:25,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:25,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:25,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:25,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:25,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:25,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:25,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:25,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:25,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:25,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:25,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:25,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:26,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:26,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:26,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:26,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:26,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:26,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:26,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:26,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:26,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:26,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:26,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:26,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:26,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:26,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:26,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:26,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:26,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:26,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:26,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:26,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:26,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:26,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:26,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:26,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:26,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:26,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:26,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:26,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:26,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:26,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:26,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:26,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:26,670 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:07:30,672 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:07:30,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:30,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:30,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:30,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:30,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:30,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:30,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:30,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:30,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:30,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:30,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:31,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:31,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:31,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:31,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:31,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:31,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:07:31,418 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:07:32,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:07:33,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:33,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:33,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:33,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:33,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:33,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:33,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:33,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:33,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:33,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:33,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:33,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:33,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:33,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:33,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:33,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:33,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:33,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:33,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:33,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:33,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:33,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:33,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:33,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:33,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:33,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:33,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:33,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:33,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:33,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:33,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:33,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:34,674 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:07:36,675 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:07:37,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:37,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:37,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:37,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:37,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:37,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:37,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:37,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:37,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:37,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:37,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:37,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:37,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:37,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:37,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:37,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:38,675 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:07:39,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:39,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:39,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:39,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:39,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:39,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:39,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:39,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:39,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:39,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:39,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:39,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:39,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:39,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:39,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:39,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:40,334 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:07:40,676 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:07:41,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:41,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:41,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:41,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:41,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:41,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:41,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:41,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:41,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:41,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:41,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:41,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:41,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:41,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:41,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:41,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:42,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:07:43,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:43,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:43,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:43,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:43,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:43,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:43,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:43,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:43,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:43,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:43,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:43,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:43,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:43,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:43,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:43,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:45,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:45,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:45,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:45,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:45,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:45,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:45,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:45,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:45,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:45,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:45,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:45,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:45,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:45,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:45,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:45,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:46,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:07:46,673 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:07:46,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:07:46,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:46,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:46,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:46,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:46,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:46,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:46,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:46,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:46,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:46,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:46,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:46,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:46,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:46,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:46,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:46,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:48,680 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:07:49,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:49,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:49,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:49,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:49,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:49,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:49,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:49,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:49,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:49,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:49,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:49,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:49,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:49,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:49,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:49,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:49,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:49,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:49,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:49,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:49,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:49,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:49,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:49,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:49,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:49,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:49,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:49,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:49,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:49,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:49,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:49,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:50,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:07:52,682 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:07:53,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:53,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:53,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:53,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:53,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:53,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:53,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:53,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:53,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:53,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:53,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:53,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:53,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:53,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:53,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:53,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:54,683 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:07:56,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:56,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:56,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:56,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:56,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:56,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:56,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:56,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:56,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:56,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:56,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:56,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:56,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:56,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:56,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:56,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:07:56,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:07:58,685 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:08:00,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:08:02,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:08:02,049 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:08:02,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:08:04,687 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:08:06,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:08:08,689 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:08:10,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:10,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:10,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:10,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:10,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:10,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:10,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:10,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:10,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:10,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:10,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:10,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:10,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:10,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:10,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:10,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:10,407 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:08:10,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:08:12,692 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:08:14,693 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:08:16,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:16,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:16,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:16,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:16,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:16,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:16,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:16,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:16,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:16,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:16,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:16,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:16,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:16,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:16,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:16,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:16,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:08:17,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:08:17,372 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:08:18,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:18,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:18,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:18,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:18,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:18,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:18,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:18,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:18,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:18,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:18,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:18,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:18,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:18,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:18,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:18,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:18,695 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:08:19,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:19,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:19,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:19,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:19,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:19,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:19,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:19,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:19,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:19,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:19,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:19,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:20,695 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:08:29,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:29,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:29,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:29,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:29,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:29,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:29,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:29,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:29,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:29,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:29,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:29,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:29,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:29,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:29,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:29,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:30,699 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:08:32,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:08:32,640 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:08:33,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:33,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:33,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:33,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:33,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:33,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:33,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:33,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:33,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:33,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:33,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:33,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:33,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:33,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:33,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:33,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:36,702 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:08:40,482 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:08:40,704 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:08:43,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:43,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:43,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:43,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:43,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:43,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:43,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:43,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:43,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:43,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:43,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:43,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:43,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:43,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:43,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:43,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:44,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:08:47,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:08:47,870 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:08:48,707 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:08:48,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:48,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:48,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:48,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:48,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:48,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:48,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:48,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:48,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:48,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:48,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:48,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:48,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:48,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:48,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:48,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:50,708 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:08:54,710 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:08:57,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:57,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:57,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:57,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:57,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:57,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:57,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:57,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:57,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:57,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:57,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:57,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:57,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:57,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:57,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:57,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:58,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:08:58,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:58,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:58,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:58,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:58,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:58,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:58,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:58,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:58,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:58,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:58,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:58,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:58,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:58,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:58,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:58,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:59,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:59,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:59,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:59,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:59,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:59,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:59,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:59,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:59,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:59,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:59,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:59,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:59,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:59,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:59,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:08:59,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:00,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:09:02,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:02,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:02,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:02,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:02,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:02,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:02,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:02,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:02,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:02,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:02,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:02,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:02,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:02,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:02,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:02,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:03,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:09:03,168 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:09:03,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:03,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:03,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:03,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:03,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:03,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:03,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:03,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:03,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:03,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:03,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:03,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:03,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:03,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:03,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:03,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:04,714 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:09:04,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:04,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:04,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:04,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:04,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:04,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:04,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:04,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:04,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:04,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:04,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:04,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:04,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:04,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:04,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:04,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:05,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:05,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:05,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:05,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:05,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:05,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:05,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:05,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:05,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:05,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:05,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:05,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:05,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:05,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:05,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:05,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:06,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:06,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:06,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:06,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:06,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:06,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:06,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:06,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:06,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:06,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:06,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:06,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:06,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:06,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:06,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:06,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:06,715 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:09:10,555 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:09:10,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:10,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:10,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:10,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:10,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:10,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:10,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:10,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:10,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:10,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:10,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:10,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:10,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:10,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:10,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:10,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:10,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:10,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:10,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:10,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:10,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:10,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:10,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:10,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:10,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:10,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:10,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:10,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:10,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:10,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:10,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:10,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:11,717 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:09:12,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:12,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:12,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:12,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:12,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:12,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:12,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:12,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:12,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:12,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:12,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:12,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:12,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:12,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:12,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:12,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:13,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:13,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:13,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:13,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:13,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:13,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:13,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:13,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:13,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:13,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:13,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:13,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:13,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:13,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:13,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:13,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:13,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:13,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:13,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:13,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:13,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:13,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:13,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:13,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:13,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:13,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:13,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:13,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:13,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:13,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:13,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:13,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:13,718 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:09:15,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:15,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:15,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:15,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:15,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:15,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:15,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:15,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:15,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:15,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:15,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:15,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:15,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:15,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:15,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:15,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:15,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:15,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:15,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:15,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:15,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:15,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:15,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:15,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:15,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:15,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:15,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:15,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:15,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:15,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:15,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:15,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:15,719 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:09:16,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:16,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:16,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:16,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:16,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:16,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:16,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:16,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:16,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:16,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:16,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:16,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:16,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:16,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:16,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:16,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:16,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:16,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:16,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:16,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:16,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:16,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:16,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:16,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:16,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:16,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:16,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:16,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:16,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:16,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:16,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:16,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:17,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:17,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:17,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:17,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:17,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:17,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:17,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:17,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:17,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:17,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:17,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:17,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:17,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:17,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:17,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:17,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:18,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:09:18,394 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:09:19,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:09:21,722 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:09:23,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,723 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:09:23,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:23,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:25,724 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:09:26,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:26,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:26,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:26,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:26,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:26,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:26,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:26,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:26,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:26,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:26,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:26,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:26,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:26,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:26,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:26,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:26,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:26,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:26,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:26,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:26,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:26,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:26,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:26,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:26,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:26,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:26,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:26,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:26,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:26,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:26,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:26,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:27,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:27,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:27,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:27,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:27,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:27,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:27,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:27,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:27,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:27,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:27,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:27,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:27,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:27,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:27,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:27,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:27,724 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:09:30,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:30,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:30,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:30,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:30,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:30,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:30,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:30,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:30,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:30,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:30,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:30,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:30,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:30,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:30,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:30,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:30,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:30,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:30,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:30,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:30,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:30,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:30,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:30,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:30,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:30,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:30,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:30,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:30,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:30,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:30,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:30,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:31,726 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:09:33,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:09:33,697 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:09:33,727 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:09:34,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:34,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:34,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:34,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:34,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:34,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:34,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:34,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:34,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:34,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:34,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:34,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:34,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:34,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:34,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:34,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:35,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:09:36,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:36,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:36,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:36,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:36,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:36,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:36,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:36,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:36,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:36,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:36,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:36,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:36,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:36,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:36,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:36,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:37,729 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:09:38,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:38,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:38,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:38,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:38,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:38,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:38,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:38,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:38,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:38,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:38,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:38,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:38,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:38,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:38,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:38,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:39,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:39,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:39,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:39,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:39,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:39,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:39,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:39,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:39,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:39,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:39,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:39,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:39,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:39,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:39,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:39,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:39,730 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:09:40,631 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:09:40,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:40,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:40,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:40,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:40,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:40,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:40,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:40,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:40,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:40,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:40,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:40,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:40,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:40,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:40,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:40,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:41,731 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:09:43,732 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:09:45,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:45,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:45,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:45,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:45,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:45,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:45,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:45,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:45,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:45,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:45,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:45,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:45,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:45,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:45,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:45,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:45,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:45,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:45,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:45,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:45,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:45,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:45,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:45,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:45,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:45,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:45,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:45,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:45,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:45,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:45,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:45,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:45,732 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:09:46,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:46,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:46,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:46,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:46,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:46,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:46,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:46,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:46,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:46,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:46,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:46,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:46,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:46,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:46,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:46,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:47,733 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:09:48,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:48,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:48,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:48,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:48,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:48,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:48,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:48,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:48,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:48,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:48,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:48,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:48,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:48,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:48,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:48,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:48,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:09:48,946 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:09:49,734 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:09:51,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:51,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:51,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:51,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:51,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:51,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:51,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:51,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:51,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:51,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:51,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:51,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:51,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:51,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:51,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:51,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:51,735 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:09:51,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:51,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:51,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:51,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:51,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:51,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:51,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:51,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:51,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:51,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:51,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:51,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:51,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:51,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:51,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:51,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:53,736 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:09:55,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:09:57,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:57,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:57,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:57,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:57,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:57,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:57,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:57,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:57,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:57,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:57,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:57,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:57,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:57,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:57,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:57,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:09:57,738 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:09:59,739 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:10:01,740 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:10:03,741 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:10:04,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:10:04,209 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:10:05,742 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:10:07,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:07,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:07,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:07,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:07,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:07,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:07,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:07,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:07,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:07,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:07,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:07,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:07,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:07,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:07,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:07,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:07,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:10:09,744 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:10:10,702 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:10:11,744 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:10:12,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:12,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:12,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:12,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:12,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:12,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:12,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:12,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:12,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:12,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:12,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:12,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:12,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:12,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:12,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:12,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:13,745 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:10:14,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:14,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:14,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:14,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:14,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:14,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:14,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:14,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:14,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:14,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:14,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:14,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:14,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:14,835 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 21:10:15,056 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 21:10:15,130 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 21:10:15,808 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 21:10:15,809 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:10:19,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:10:19,494 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:10:22,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:22,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:22,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:22,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:22,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:22,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:22,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:22,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:22,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:22,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:22,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:22,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:22,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:22,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:22,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:22,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:25,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:10:29,814 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:10:33,816 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:10:34,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:10:34,727 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:10:34,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:34,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:34,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:34,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:34,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:34,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:34,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:34,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:34,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:34,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:34,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:34,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:34,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:34,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:34,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:34,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:37,817 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:10:38,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:38,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:38,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:38,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:38,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:38,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:38,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:38,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:38,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:38,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:38,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:38,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:38,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:38,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:38,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:38,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:40,790 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:10:41,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:10:45,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:10:49,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:49,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:49,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:49,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:49,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:49,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:49,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:49,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:49,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:49,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:49,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:49,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:49,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:49,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:49,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:49,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:49,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:10:50,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:10:50,149 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:10:51,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:51,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:51,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:51,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:51,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:51,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:51,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:51,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:51,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:51,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:51,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:51,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:51,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:51,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:51,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:51,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:53,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:10:55,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:10:58,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:58,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:58,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:58,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:58,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:58,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:58,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:58,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:59,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:59,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:59,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:59,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:59,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:59,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:59,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:10:59,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:00,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:00,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:00,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:00,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:00,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:00,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:00,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:00,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:00,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:00,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:00,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:00,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:00,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:00,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:00,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:00,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:00,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:11:02,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:02,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:02,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:02,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:02,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:02,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:02,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:02,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:02,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:02,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:02,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:02,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:02,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:02,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:02,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:02,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:02,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:11:03,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:03,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:03,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:03,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:03,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:03,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:03,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:03,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:03,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:03,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:03,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:03,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:03,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:03,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:03,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:03,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:05,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:05,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:05,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:05,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:05,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:05,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:05,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:05,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:05,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:05,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:05,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:05,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:05,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:05,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:05,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:05,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:05,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:11:05,443 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:11:06,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:06,829 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:11:08,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:11:09,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:09,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:09,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:09,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:09,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:09,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:09,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:09,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:09,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:09,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:09,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:09,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:09,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:09,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:09,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:09,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:09,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:09,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:09,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:09,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:09,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:09,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:09,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:09,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:09,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:09,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:09,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:09,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:09,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:09,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:09,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:09,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:10,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:10,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:10,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:10,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:10,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:10,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:10,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:10,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:10,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:10,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:10,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:10,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:10,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:10,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:10,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:10,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:10,865 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:11:10,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:10,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:10,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:10,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:10,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:10,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:10,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:10,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:10,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:10,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:10,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:10,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:10,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:10,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:10,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:10,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:11,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:11,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:11,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:11,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:11,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:11,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:11,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:11,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:11,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:11,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:11,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:11,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:11,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:11,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:11,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:11,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:12,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:11:14,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:14,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:14,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:14,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:14,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:14,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:14,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:14,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:14,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:14,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:14,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:14,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:14,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:14,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:14,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:14,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:14,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:14,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:14,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:14,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:14,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:14,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:14,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:14,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:14,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:14,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:14,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:14,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:14,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:14,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:14,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:14,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:14,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:11:16,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:16,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:16,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:16,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:16,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:16,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:16,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:16,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:16,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:16,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:16,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:16,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:16,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:16,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:16,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:16,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:16,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:16,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:16,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:16,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:16,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:16,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:16,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:16,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:16,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:16,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:16,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:16,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:16,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:16,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:16,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:16,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:16,833 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:11:17,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:17,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:18,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:18,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:18,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:18,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:18,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:18,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:18,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:18,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:18,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:18,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:18,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:18,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:18,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:18,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:18,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:18,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:20,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:11:20,705 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:11:20,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:11:22,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:11:23,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:23,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:23,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:23,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:23,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:23,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:23,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:23,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:23,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:23,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:23,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:23,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:23,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:23,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:23,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:23,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:24,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:11:25,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:25,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:25,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:25,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:25,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:25,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:25,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:25,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:25,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:25,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:25,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:25,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:25,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:25,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:25,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:25,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:26,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:26,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:26,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:26,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:26,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:26,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:26,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:26,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:26,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:26,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:26,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:26,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:26,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:26,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:26,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:26,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:26,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:11:28,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:11:30,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:11:33,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:33,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:33,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:33,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:33,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:33,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:33,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:33,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:33,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:33,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:33,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:33,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:33,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:33,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:33,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:33,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:11:34,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:34,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:35,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:11:35,928 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:11:36,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:11:38,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:11:39,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:39,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:39,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:39,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:39,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:39,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:39,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:39,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:39,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:39,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:39,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:39,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:39,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:39,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:39,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:39,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:39,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:39,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:39,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:39,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:39,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:39,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:39,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:39,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:39,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:39,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:39,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:39,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:39,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:39,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:39,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:39,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:40,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:11:40,940 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:11:42,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:42,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:42,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:42,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:42,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:42,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:42,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:42,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:42,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:42,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:42,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:42,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:42,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:42,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:42,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:42,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:42,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:11:44,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:44,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:44,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:44,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:44,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:44,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:44,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:44,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:44,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:44,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:44,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:44,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:44,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:44,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:44,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:44,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:44,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:44,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:44,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:44,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:44,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:44,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:44,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:44,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:44,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:44,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:44,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:44,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:44,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:44,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:44,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:44,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:44,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:11:45,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:45,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:45,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:45,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:45,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:45,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:45,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:45,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:45,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:45,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:45,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:45,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:45,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:45,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:45,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:45,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:46,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:11:47,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:47,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:47,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:47,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:47,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:47,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:47,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:47,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:47,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:47,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:47,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:47,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:47,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:47,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:47,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:47,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:48,846 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:11:50,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:11:51,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:11:51,222 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:11:51,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:51,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:51,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:51,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:51,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:51,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:51,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:51,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:51,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:51,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:51,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:51,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:51,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:51,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:51,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:51,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:52,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:52,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:52,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:52,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:52,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:52,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:52,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:52,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:52,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:52,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:52,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:52,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:52,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:52,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:52,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:52,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:52,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:11:54,849 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:11:55,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:55,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:55,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:55,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:55,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:55,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:55,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:55,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:55,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:55,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:55,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:55,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:55,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:55,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:55,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:55,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:11:56,850 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:11:58,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:12:00,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:12:02,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:12:04,854 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:12:06,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:12:06,490 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:12:06,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:12:07,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:07,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:07,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:07,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:07,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:07,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:07,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:07,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:07,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:07,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:07,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:07,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:07,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:07,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:07,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:07,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:08,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:12:09,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:09,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:09,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:09,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:09,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:09,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:09,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:09,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:09,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:09,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:09,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:09,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:09,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:09,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:09,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:09,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:10,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:10,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:10,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:10,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:10,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:10,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:10,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:10,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:10,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:10,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:10,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:10,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:10,856 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:12:11,013 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:12:20,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:12:21,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:12:21,717 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:12:24,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:12:27,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:27,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:27,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:27,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:27,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:27,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:27,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:27,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:27,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:27,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:27,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:27,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:27,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:27,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:27,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:27,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:29,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:12:33,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:12:37,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:12:37,126 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:12:37,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:12:41,087 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:12:41,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:12:44,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:44,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:44,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:44,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:44,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:44,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:44,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:44,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:44,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:44,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:44,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:44,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:44,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:44,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:44,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:44,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:45,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:12:47,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:47,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:47,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:47,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:47,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:47,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:47,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:47,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:47,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:47,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:47,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:47,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:47,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:47,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:47,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:47,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:47,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:12:51,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:51,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:51,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:51,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:51,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:51,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:51,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:51,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:51,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:12:51,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:51,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:51,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:51,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:51,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:51,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:51,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:51,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:52,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:12:52,351 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:12:53,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:12:55,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:55,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:55,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:55,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:55,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:55,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:55,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:55,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:55,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:55,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:55,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:55,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:55,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:55,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:55,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:55,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:12:57,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:12:59,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:13:00,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:00,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:00,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:00,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:00,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:00,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:00,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:00,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:00,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:00,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:00,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:00,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:00,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:00,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:00,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:00,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:02,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:02,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:02,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:02,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:02,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:02,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:02,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:02,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:02,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:02,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:02,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:02,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:02,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:02,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:02,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:02,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:03,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:13:04,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:04,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:04,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:04,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:04,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:04,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:04,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:04,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:04,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:04,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:04,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:04,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:04,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:04,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:04,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:04,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:04,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:04,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:04,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:04,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:04,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:04,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:04,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:04,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:04,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:04,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:04,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:04,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:04,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:04,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:04,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:04,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:05,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:05,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:05,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:05,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:05,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:05,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:05,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:05,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:05,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:05,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:05,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:05,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:05,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:05,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:05,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:05,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:05,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:13:07,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:13:07,610 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:13:07,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:07,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:07,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:07,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:07,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:07,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:07,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:07,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:07,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:07,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:07,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:07,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:07,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:07,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:07,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:07,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:07,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:13:08,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:08,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:08,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:08,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:08,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:08,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:08,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:08,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:08,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:08,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:08,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:08,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:08,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:08,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:08,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:08,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:09,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:09,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:09,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:09,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:09,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:09,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:09,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:09,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:09,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:09,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:09,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:09,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:09,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:09,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:09,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:09,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:09,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:09,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:09,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:09,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:09,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:09,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:09,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:09,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:09,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:09,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:09,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:09,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:09,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:09,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:09,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:09,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:10,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:10,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:10,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:10,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:10,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:10,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:10,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:10,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:10,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:10,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:10,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:10,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:10,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:10,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:10,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:10,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:10,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:10,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:10,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:10,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:10,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:10,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:10,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:10,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:10,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:10,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:10,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:10,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:10,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:10,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:10,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:10,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:11,157 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:13:11,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:11,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:11,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:11,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:11,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:11,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:11,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:11,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:11,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:11,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:11,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:11,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:11,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:11,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:11,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:11,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:11,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:13:12,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:12,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:12,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:12,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:12,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:12,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:12,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:12,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:12,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:12,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:12,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:12,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:12,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:12,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:12,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:12,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:13,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:13,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:13,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:13,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:13,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:13,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:13,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:13,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:13,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:13,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:13,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:13,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:13,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:13,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:13,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:13,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:13,882 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:13:14,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:14,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:14,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:14,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:14,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:14,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:14,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:14,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:14,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:14,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:14,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:14,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:14,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:14,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:14,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:14,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:15,882 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:13:17,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:17,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:17,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:17,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:17,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:17,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:17,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:17,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:17,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:17,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:17,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:17,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:17,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:17,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:17,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:17,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:19,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:13:21,885 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:13:22,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:22,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:22,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:22,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:22,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:22,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:22,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:22,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:22,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:22,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:22,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:22,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:22,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:22,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:22,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:22,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:22,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:13:22,839 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:13:23,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:13:23,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:23,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:25,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:25,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:25,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:25,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:25,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:25,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:25,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:25,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:25,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:25,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:25,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:25,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:25,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:25,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:25,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:25,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:25,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:13:26,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:26,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:26,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:26,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:26,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:26,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:26,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:26,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:26,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:26,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:26,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:26,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:26,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:26,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:26,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:26,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:27,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:27,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:27,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:27,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:27,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:27,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:27,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:27,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:27,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:27,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:27,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:27,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:27,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:27,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:27,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:27,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:27,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:13:29,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:29,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:29,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:29,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:29,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:29,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:29,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:29,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:29,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:29,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:29,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:29,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:29,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:29,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:29,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:29,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:29,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:13:31,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:13:33,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:13:34,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:34,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:34,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:34,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:34,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:34,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:34,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:34,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:34,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:34,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:34,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:34,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:34,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:34,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:34,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:34,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:35,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:35,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:35,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:35,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:35,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:35,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:35,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:35,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:35,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:35,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:35,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:35,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:35,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:35,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:35,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:35,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:35,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:13:37,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:37,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:37,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:37,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:37,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:37,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:37,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:37,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:37,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:37,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:37,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:37,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:37,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:37,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:37,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:37,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:37,894 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:13:38,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:13:38,171 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:13:38,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:38,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:38,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:38,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:38,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:38,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:38,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:38,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:38,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:38,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:38,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:38,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:38,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:38,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:38,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:38,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:39,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:13:41,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:41,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:41,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:41,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:41,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:41,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:41,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:41,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:41,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:41,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:41,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:41,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:41,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:41,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:41,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:41,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:41,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:41,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:41,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:41,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:41,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:41,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:41,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:41,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:41,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:41,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:41,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:41,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:41,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:41,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:41,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:41,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:41,224 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:13:41,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:13:42,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:42,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:42,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:42,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:42,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:42,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:42,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:42,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:42,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:42,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:42,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:42,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:42,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:42,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:42,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:42,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:43,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:43,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:43,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:43,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:43,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:43,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:43,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:43,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:43,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:43,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:43,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:43,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:43,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:43,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:43,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:43,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:43,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:13:45,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:45,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:45,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:45,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:45,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:45,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:45,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:45,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:45,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:45,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:45,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:45,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:45,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:45,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:45,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:45,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:45,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:13:47,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:47,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:47,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:47,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:47,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:47,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:47,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:47,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:47,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:47,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:47,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:47,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:47,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:47,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:47,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:47,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:47,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:13:48,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:48,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:48,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:48,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:48,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:48,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:48,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:48,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:48,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:48,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:48,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:48,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:48,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:48,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:48,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:48,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:49,900 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:13:51,901 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:13:52,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:52,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:52,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:52,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:52,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:52,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:52,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:52,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:52,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:52,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:52,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:52,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:52,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:52,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:52,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:52,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:53,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:13:53,402 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:13:53,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:53,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:53,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:53,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:53,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:53,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:53,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:53,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:53,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:53,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:53,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:53,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:53,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:53,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:53,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:53,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:13:53,901 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:13:55,902 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:13:57,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:13:59,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:14:01,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:14:03,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:03,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:03,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:03,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:03,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:03,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:03,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:03,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:03,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:03,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:03,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:03,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:03,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:03,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:03,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:03,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:03,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:14:05,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:05,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:05,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:05,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:05,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:05,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:05,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:05,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:05,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:05,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:05,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:05,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:05,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:05,507 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 21:14:05,651 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 21:14:05,731 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 21:14:05,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 21:14:05,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:14:06,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:14:08,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:14:08,736 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:14:11,345 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:14:15,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:15,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:15,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:15,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:15,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:15,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:15,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:15,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:15,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:15,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:15,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:15,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:15,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:15,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:15,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:15,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:18,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:14:22,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:14:24,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:14:24,245 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:14:27,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:27,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:27,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:27,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:27,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:27,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:27,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:27,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:27,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:27,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:27,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:27,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:27,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:27,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:27,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:27,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:28,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:14:32,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:14:36,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:14:38,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:14:39,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:14:39,518 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:14:41,418 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:14:42,921 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:14:46,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:46,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:46,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:46,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:46,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:46,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:46,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:46,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:46,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:46,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:46,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:46,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:46,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:46,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:46,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:46,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:46,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:14:48,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:14:52,925 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:14:54,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:14:54,879 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:14:55,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:55,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:55,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:55,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:55,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:55,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:55,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:55,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:55,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:55,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:55,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:55,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:55,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:55,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:55,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:55,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:56,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:56,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:56,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:56,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:56,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:56,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:56,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:56,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:56,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:56,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:56,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:56,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:56,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:56,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:56,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:56,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:14:56,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:14:58,927 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:15:00,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:15:03,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:03,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:03,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:03,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:03,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:03,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:03,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:03,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:03,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:03,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:03,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:03,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:03,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:03,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:03,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:03,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:04,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:04,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:04,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:04,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:04,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:04,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:04,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:04,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:04,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:04,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:04,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:04,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:04,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:04,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:04,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:04,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:04,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:15:04,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:04,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:04,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:04,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:04,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:04,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:04,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:04,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:04,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:04,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:04,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:04,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:04,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:04,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:04,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:05,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:06,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:06,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:06,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:06,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:06,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:06,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:06,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:06,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:06,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:06,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:06,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:06,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:06,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:06,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:06,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:06,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:06,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:15:07,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:07,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:07,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:07,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:07,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:07,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:07,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:07,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:07,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:07,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:07,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:07,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:07,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:07,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:07,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:07,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:08,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:15:10,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:10,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:10,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:10,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:10,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:10,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:10,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:10,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:10,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:10,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:10,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:10,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:10,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:10,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:10,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:10,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:10,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:15:10,144 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:15:11,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:11,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:11,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:11,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:11,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:11,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:11,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:11,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:11,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:11,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:11,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:11,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:11,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:11,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:11,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:11,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:11,494 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:15:11,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:11,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:11,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:11,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:11,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:11,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:11,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:11,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:11,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:11,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:11,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:11,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:11,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:11,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:11,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:11,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:12,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:12,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:12,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:12,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:12,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:12,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:12,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:12,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:12,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:12,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:12,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:12,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:12,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:12,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:12,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:12,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:12,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:15:13,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:13,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:13,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:13,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:13,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:13,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:13,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:13,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:13,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:13,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:13,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:13,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:13,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:13,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:13,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:13,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:14,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:14,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:14,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:14,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:14,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:14,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:14,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:14,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:14,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:15:14,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:14,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:14,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:14,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:14,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:14,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:14,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:14,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:15,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:15,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:15,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:15,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:15,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:15,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:15,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:15,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:15,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:15,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:15,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:15,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:15,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:15,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:15,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:15,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:16,935 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:15:17,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:17,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:18,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:18,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:18,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:18,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:18,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:18,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:18,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:18,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:18,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:18,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:18,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:18,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:18,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:18,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:18,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:18,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:18,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:15:19,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:19,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:19,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:19,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:19,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:19,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:19,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:19,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:19,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:19,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:19,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:19,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:19,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:19,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:19,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:19,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:20,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:15:22,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:22,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:22,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:22,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:22,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:22,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:22,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:22,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:22,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:22,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:22,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:22,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:22,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:22,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:22,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:22,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:22,937 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:15:24,938 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:15:25,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:15:25,371 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:15:25,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:25,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:27,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:27,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:27,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:27,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:27,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:27,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:27,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:27,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:27,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:27,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:27,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:27,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:27,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:27,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:27,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:27,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:28,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:28,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:28,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:28,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:28,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:28,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:28,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:28,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:28,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:28,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:28,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:28,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:28,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:28,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:28,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:28,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:28,940 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:15:29,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:29,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:29,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:29,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:29,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:29,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:29,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:29,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:29,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:29,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:29,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:29,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:29,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:29,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:29,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:29,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:30,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:30,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:30,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:30,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:30,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:30,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:30,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:30,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:30,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:30,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:30,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:30,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:30,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:30,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:30,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:30,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:31,941 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:15:33,942 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:15:34,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:34,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:34,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:34,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:34,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:34,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:34,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:34,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:34,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:34,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:34,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:34,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:34,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:34,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:34,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:34,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:35,943 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:15:37,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:37,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:37,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:37,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:37,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:37,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:37,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:37,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:37,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:37,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:37,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:37,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:37,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:37,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:37,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:37,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:37,943 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:15:39,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:39,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:39,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:39,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:39,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:39,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:39,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:39,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:39,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:39,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:39,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:39,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:39,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:39,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:39,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:39,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:39,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:39,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:39,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:39,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:39,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:39,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:39,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:39,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:39,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:39,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:39,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:39,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:39,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:39,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:39,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:39,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:39,944 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:15:40,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:15:40,599 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:15:40,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:40,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:40,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:40,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:40,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:40,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:40,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:40,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:40,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:40,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:40,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:40,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:40,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:40,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:40,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:40,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:40,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:40,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:40,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:40,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:40,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:40,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:40,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:40,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:40,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:40,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:40,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:40,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:40,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:40,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:40,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:40,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:41,566 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:15:41,945 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:15:43,946 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:15:45,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:45,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:45,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:45,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:45,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:45,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:45,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:45,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:45,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:45,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:45,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:45,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:45,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:45,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:45,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:45,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:45,946 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:15:46,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:46,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:46,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:46,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:46,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:46,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:46,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:46,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:46,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:46,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:46,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:46,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:46,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:46,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:46,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:46,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:46,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:46,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:46,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:46,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:46,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:46,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:46,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:46,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:46,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:46,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:46,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:46,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:46,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:46,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:46,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:46,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:47,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:47,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:47,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:47,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:47,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:47,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:47,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:47,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:47,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:47,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:47,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:47,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:47,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:47,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:47,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:47,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:47,947 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:15:49,948 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:15:51,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:51,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:51,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:51,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:51,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:51,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:51,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:51,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:51,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:51,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:51,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:51,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:51,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:51,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:51,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:51,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:51,949 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:15:53,949 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:15:54,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:54,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:54,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:54,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:54,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:54,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:54,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:54,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:54,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:54,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:54,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:54,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:54,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:54,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:54,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:54,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:55,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:55,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:55,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:55,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:55,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:55,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:55,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:55,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:55,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:55,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:55,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:55,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:55,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:55,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:55,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:55,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:15:55,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:15:55,822 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:15:55,950 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:15:57,950 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:15:59,951 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:16:01,952 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:16:02,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:02,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:02,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:02,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:02,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:02,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:02,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:02,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:02,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:02,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:02,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:02,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:02,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:02,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:02,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:02,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:03,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:03,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:03,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:03,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:03,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:03,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:03,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:03,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:03,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:03,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:03,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:03,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:03,953 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:16:05,954 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:16:11,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:16:11,050 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:16:11,641 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:16:13,957 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:16:19,959 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:16:23,961 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:16:24,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:24,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:24,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:24,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:24,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:24,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:24,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:24,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:24,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:24,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:24,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:24,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:24,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:24,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:24,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:24,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:26,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:16:26,283 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:16:27,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:16:31,964 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:16:32,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:32,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:32,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:32,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:32,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:32,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:32,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:32,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:32,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:32,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:32,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:32,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:32,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:32,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:32,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:32,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:35,966 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:16:39,968 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:16:41,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:16:41,634 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:16:41,856 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:16:41,969 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:16:45,970 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:16:49,972 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:16:49,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:49,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:49,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:49,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:49,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:49,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:49,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:49,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:49,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:50,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:50,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:50,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:50,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:50,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:50,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:50,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:51,973 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:16:53,974 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:16:56,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:16:56,858 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:16:57,976 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:16:58,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:58,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:58,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:58,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:58,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:58,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:58,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:58,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:58,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:58,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:58,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:58,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:58,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:58,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:58,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:58,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:16:59,977 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:17:00,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:00,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:00,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:00,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:00,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:00,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:00,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:00,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:00,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:00,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:00,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:00,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:00,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:00,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:00,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:00,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:03,979 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:17:05,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:05,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:05,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:05,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:05,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:05,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:05,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:05,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:05,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:05,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:05,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:05,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:05,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:05,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:05,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:05,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:05,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:05,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:05,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:05,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:05,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:05,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:05,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:05,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:05,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:05,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:05,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:05,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:05,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:05,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:05,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:05,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:05,980 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:17:07,980 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:17:09,981 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:17:10,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:10,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:10,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:10,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:10,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:10,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:10,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:10,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:10,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:10,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:10,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:10,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:10,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:10,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:10,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:10,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:11,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:11,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:11,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:11,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:11,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:11,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:11,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:11,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:11,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:11,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:11,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:11,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:11,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:11,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:11,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:11,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:11,792 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:17:12,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:17:12,177 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:17:12,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:12,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:12,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:12,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:12,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:12,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:12,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:12,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:12,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:12,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:12,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:12,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:12,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:12,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:12,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:12,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:12,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:12,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:12,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:12,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:12,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:12,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:12,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:12,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:12,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:12,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:12,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:12,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:12,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:12,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:12,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:12,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:13,983 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:17:14,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:14,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:14,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:14,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:14,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:14,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:14,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:14,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:14,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:14,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:14,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:14,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:14,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:14,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:14,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:14,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:15,984 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:17:16,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:16,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:16,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:16,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:16,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:16,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:16,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:16,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:16,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:16,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:16,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:16,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:16,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:16,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:16,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:16,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:16,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:16,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:16,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:16,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:16,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:16,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:16,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:16,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:16,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:16,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:16,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:16,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:16,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:16,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:16,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:16,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:18,985 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:17:19,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:19,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:20,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:20,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:20,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:20,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:20,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:20,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:20,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:20,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:20,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:20,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:20,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:20,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:20,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:20,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:20,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:20,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:20,986 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:17:21,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:21,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:21,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:21,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:21,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:21,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:21,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:21,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:21,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:21,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:21,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:21,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:21,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:21,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:21,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:21,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:22,987 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:17:24,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:24,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:24,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:24,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:24,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:24,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:24,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:24,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:24,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:24,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:24,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:24,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:24,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:24,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:24,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:24,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:24,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:24,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:24,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:24,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:24,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:24,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:24,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:24,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:24,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:24,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:24,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:24,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:24,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:24,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:24,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:24,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:24,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:17:25,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:25,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:25,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:25,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:25,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:25,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:25,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:25,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:25,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:25,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:25,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:25,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:25,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:25,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:25,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:25,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:26,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:26,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:26,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:26,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:26,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:26,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:26,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:26,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:26,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:26,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:26,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:26,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:26,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:26,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:26,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:26,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:26,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:26,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:26,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:26,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:26,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:26,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:26,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:26,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:26,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:26,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:26,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:26,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:26,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:26,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:26,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:26,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:26,989 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:17:27,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:17:27,403 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:17:27,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:27,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:27,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:27,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:27,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:27,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:27,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:27,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:27,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:27,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:27,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:27,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:27,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:27,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:27,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:27,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:28,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:28,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:28,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:28,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:28,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:28,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:28,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:28,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:28,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:28,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:28,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:28,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:28,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:28,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:28,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:28,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:28,990 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:17:29,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:29,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:29,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:29,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:29,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:29,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:29,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:29,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:29,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:29,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:29,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:29,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:29,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:29,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:29,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:29,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:30,991 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:17:31,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:31,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:31,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:31,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:31,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:31,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:31,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:31,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:31,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:31,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:31,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:31,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:31,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:31,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:31,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:31,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:32,992 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:17:34,992 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:17:35,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:35,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:35,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:35,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:35,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:35,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:35,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:35,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:35,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:35,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:35,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:35,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:35,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:35,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:35,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:35,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:36,994 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:17:38,994 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:17:39,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:39,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:40,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:40,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:40,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:40,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:40,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:40,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:40,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:40,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:40,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:40,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:40,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:40,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:40,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:40,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:40,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:40,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:40,995 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:17:41,871 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:17:42,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:42,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:42,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:42,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:42,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:42,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:42,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:42,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:42,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:42,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:42,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:42,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:42,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:42,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:42,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:42,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:42,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:17:42,692 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:17:42,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:17:43,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:43,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:43,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:43,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:43,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:43,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:43,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:43,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:43,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:43,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:43,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:43,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:43,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:43,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:43,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:43,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:44,997 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:17:46,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:46,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:46,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:46,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:46,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:46,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:46,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:46,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:46,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:46,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:46,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:46,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:46,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:46,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:46,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:46,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:46,998 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:17:47,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:47,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:47,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:47,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:47,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:47,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:47,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:47,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:47,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:47,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:47,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:47,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:47,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:47,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:47,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:47,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:48,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:17:49,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:49,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:49,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:49,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:49,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:49,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:49,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:49,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:49,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:49,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:49,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:49,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:49,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:49,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:49,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:49,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:50,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:50,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:50,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:50,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:50,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:50,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:50,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:50,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:50,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:50,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:50,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:50,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:50,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:50,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:50,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:50,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:51,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:17:53,001 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:17:53,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:53,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:53,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:53,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:53,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:53,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:53,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:53,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:53,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:53,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:53,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:53,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:53,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:53,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:53,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:53,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:53,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:53,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:53,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:53,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:53,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:53,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:53,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:53,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:53,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:53,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:53,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:53,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:53,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:53,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:53,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:53,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:17:55,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:17:57,003 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:17:57,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:17:57,910 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:17:59,004 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:18:00,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:00,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:00,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:00,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:01,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:18:01,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:01,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:01,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:01,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:01,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:01,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:01,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:01,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:01,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:01,333 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 21:18:01,577 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 21:18:01,656 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 21:18:02,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 21:18:02,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:18:03,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:18:04,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:04,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:04,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:04,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:04,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:04,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:04,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:04,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:04,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:04,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:04,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:04,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:04,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:04,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:04,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:04,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:11,980 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:18:13,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:18:13,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:18:13,432 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:18:17,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:18:21,013 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:18:25,014 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:18:28,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:18:28,731 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:18:29,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:18:31,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:31,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:31,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:31,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:31,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:31,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:31,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:31,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:31,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:31,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:31,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:31,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:31,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:31,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:31,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:31,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:33,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:33,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:33,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:18:33,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:33,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:33,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:33,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:33,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:33,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:33,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:33,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:33,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:33,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:33,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:33,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:33,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:33,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:37,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:18:41,021 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:18:42,055 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:18:43,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:18:43,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:18:43,956 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:18:47,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:18:49,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:18:50,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:50,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:50,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:50,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:50,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:50,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:50,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:50,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:50,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:50,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:50,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:50,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:50,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:50,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:50,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:50,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:18:53,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:18:55,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:18:59,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:18:59,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:18:59,181 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:19:01,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:19:03,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:19:04,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:04,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:04,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:04,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:04,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:04,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:04,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:04,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:04,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:04,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:04,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:04,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:04,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:04,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:04,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:04,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:06,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:06,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:06,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:06,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:06,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:06,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:06,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:06,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:06,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:06,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:06,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:06,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:06,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:06,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:06,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:06,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:06,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:06,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:06,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:06,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:06,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:06,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:06,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:06,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:06,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:06,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:06,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:06,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:06,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:06,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:06,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:06,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:07,031 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:19:09,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:19:11,034 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:19:12,127 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:19:12,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:12,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:12,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:12,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:12,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:12,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:12,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:12,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:12,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:12,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:12,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:12,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:12,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:12,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:12,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:12,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:12,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:12,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:12,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:12,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:12,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:12,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:12,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:12,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:12,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:12,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:12,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:12,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:12,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:12,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:12,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:12,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:13,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:13,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:13,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:19:13,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:13,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:13,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:13,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:13,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:13,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:13,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:13,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:13,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:13,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:13,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:13,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:13,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:13,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:14,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:19:14,475 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:19:15,038 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:19:16,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:16,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:17,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:17,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:17,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:17,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:17,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:17,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:17,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:17,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:17,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:17,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:17,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:17,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:17,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:17,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:17,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:17,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:17,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:17,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:17,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:17,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:17,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:17,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:17,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:17,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:17,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:17,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:17,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:17,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:17,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:17,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:17,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:17,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:18,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:18,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:18,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:18,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:18,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:18,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:18,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:18,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:18,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:18,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:18,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:18,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:18,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:18,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:18,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:18,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:19:19,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:19,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:20,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:20,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:20,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:20,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:20,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:20,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:20,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:20,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:20,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:20,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:20,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:20,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:20,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:20,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:20,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:20,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:20,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:20,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:20,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:20,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:20,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:20,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:20,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:20,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:20,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:20,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:20,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:20,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:20,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:20,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:20,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:20,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:21,041 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:19:21,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:21,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:21,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:21,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:21,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:21,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:21,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:21,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:21,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:21,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:21,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:21,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:21,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:21,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:21,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:21,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:22,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:22,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:22,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:22,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:22,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:22,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:22,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:22,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:22,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:22,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:22,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:22,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:22,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:22,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:22,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:22,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:23,042 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:19:23,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:23,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:23,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:23,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:23,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:23,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:23,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:23,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:23,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:23,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:23,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:23,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:23,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:23,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:23,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:23,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:23,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:23,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:23,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:23,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:23,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:23,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:23,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:23,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:23,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:23,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:23,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:23,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:23,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:23,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:23,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:23,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:25,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:19:25,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:25,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:25,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:25,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:25,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:25,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:25,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:25,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:25,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:25,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:25,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:25,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:25,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:25,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:25,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:25,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:27,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:27,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:27,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:27,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:27,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:27,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:27,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:27,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:27,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:27,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:27,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:27,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:27,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:27,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:27,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:27,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:27,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:19:27,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:27,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:27,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:27,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:27,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:27,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:27,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:27,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:27,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:27,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:27,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:27,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:27,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:27,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:27,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:27,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:28,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:28,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:28,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:28,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:28,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:28,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:28,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:28,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:28,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:28,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:28,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:28,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:28,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:28,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:28,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:28,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:29,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:19:29,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:19:29,747 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:19:29,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:29,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:29,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:29,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:29,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:29,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:29,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:29,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:29,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:29,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:29,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:29,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:29,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:29,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:29,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:29,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:29,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:29,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:29,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:29,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:29,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:29,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:30,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:30,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:30,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:30,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:30,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:30,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:30,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:30,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:30,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:30,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:31,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:19:32,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:32,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:32,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:32,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:32,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:32,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:32,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:32,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:32,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:32,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:32,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:32,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:32,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:32,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:32,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:32,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:33,047 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:19:33,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:33,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:33,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:33,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:33,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:33,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:33,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:33,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:33,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:33,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:33,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:33,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:33,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:33,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:33,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:33,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:33,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:33,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:33,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:33,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:33,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:33,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:33,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:33,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:33,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:33,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:33,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:33,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:33,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:33,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:33,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:33,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:36,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:19:36,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:36,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:36,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:36,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:36,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:36,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:36,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:36,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:36,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:36,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:36,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:36,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:36,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:36,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:36,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:36,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:37,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:37,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:37,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:37,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:37,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:37,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:37,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:37,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:37,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:37,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:37,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:37,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:37,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:37,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:37,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:37,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:38,049 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:19:38,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:38,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:38,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:38,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:38,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:38,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:38,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:38,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:38,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:38,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:38,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:38,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:38,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:38,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:38,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:38,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:39,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:39,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:39,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:39,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:39,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:39,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:39,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:39,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:39,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:39,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:39,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:39,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:39,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:39,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:39,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:39,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:39,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:39,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:39,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:39,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:39,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:39,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:39,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:39,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:39,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:39,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:39,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:39,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:39,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:39,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:39,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:39,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:40,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:19:40,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:40,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:40,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:40,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:40,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:40,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:40,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:40,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:40,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:40,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:40,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:40,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:40,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:40,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:40,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:40,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:42,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:19:42,198 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:19:42,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:42,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:42,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:42,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:42,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:42,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:42,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:42,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:42,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:42,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:42,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:42,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:42,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:42,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:42,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:42,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:44,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:19:44,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:44,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:44,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:44,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:44,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:44,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:44,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:44,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:44,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:44,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:44,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:44,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:44,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:44,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:44,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:44,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:44,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:19:44,972 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:19:46,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:19:47,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:47,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:47,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:47,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:47,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:47,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:47,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:47,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:47,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:47,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:47,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:47,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:47,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:47,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:47,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:47,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:48,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:19:48,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:48,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:48,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:48,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:48,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:48,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:48,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:48,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:48,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:48,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:48,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:48,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:48,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:48,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:48,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:48,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:50,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:19:51,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:51,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:51,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:51,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:51,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:51,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:51,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:51,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:51,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:51,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:51,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:51,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:51,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:51,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:51,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:51,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:52,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:19:53,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:53,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:53,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:53,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:53,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:53,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:53,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:53,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:53,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:53,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:53,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:53,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:53,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:53,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:53,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:53,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:54,056 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:19:54,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:54,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:54,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:54,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:54,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:54,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:54,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:54,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:54,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:54,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:54,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:54,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:54,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:54,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:54,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:54,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:56,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:19:57,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:57,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:57,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:57,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:57,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:57,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:57,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:57,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:57,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:57,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:57,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:57,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:19:58,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:20:00,059 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:20:00,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:20:00,195 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:20:09,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:09,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:09,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:09,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:09,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:09,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:09,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:09,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:09,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:09,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:09,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:09,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:09,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:09,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:09,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:09,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:10,063 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:20:12,267 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:20:15,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:20:15,463 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:20:16,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:20:20,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:20:24,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:20:26,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:20:30,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:20:30,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:20:30,820 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:20:34,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:20:36,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:36,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:36,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:36,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:36,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:36,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:36,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:36,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:36,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:36,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:36,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:36,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:36,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:36,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:36,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:36,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:38,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:38,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:38,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:38,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:38,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:38,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:38,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:38,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:38,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:38,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:38,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:38,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:38,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:38,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:38,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:38,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:38,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:20:40,074 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:20:42,339 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:20:44,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:20:46,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:20:46,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:20:46,210 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:20:50,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:20:51,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:51,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:51,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:51,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:51,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:51,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:51,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:51,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:51,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:51,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:51,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:51,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:51,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:51,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:51,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:51,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:20:52,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:20:54,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:20:58,081 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:21:00,081 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:21:01,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:21:01,438 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:21:01,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:01,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:01,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:01,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:01,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:01,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:01,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:01,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:01,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:01,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:01,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:01,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:01,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:01,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:01,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:01,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:02,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:21:04,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:21:05,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:05,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:05,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:05,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:05,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:05,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:05,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:05,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:05,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:05,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:05,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:05,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:05,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:05,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:05,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:05,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:06,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:21:08,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:08,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:08,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:08,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:08,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:08,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:08,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:08,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:08,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:08,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:08,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:08,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:08,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:08,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:08,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:08,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:10,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:21:10,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:10,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:10,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:10,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:10,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:10,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:10,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:10,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:10,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:10,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:10,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:10,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:10,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:10,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:10,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:10,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:12,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:21:12,412 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:21:13,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:13,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:13,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:13,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:13,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:13,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:13,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:13,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:13,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:13,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:13,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:13,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:13,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:13,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:13,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:13,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:13,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:13,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:13,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:13,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:13,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:13,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:13,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:13,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:13,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:13,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:13,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:13,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:13,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:13,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:13,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:13,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:14,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:21:15,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:15,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:15,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:15,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:15,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:15,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:15,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:15,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:15,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:15,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:15,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:15,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:15,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:15,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:15,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:15,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:16,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:21:16,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:16,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:16,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:16,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:16,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:16,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:16,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:16,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:16,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:16,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:16,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:16,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:16,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:16,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:16,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:16,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:16,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:16,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:16,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:16,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:16,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:16,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:16,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:16,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:16,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:16,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:16,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:16,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:16,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:16,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:16,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:16,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:16,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:21:16,882 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:21:17,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:17,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:17,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:17,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:17,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:17,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:17,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:17,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:17,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:17,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:17,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:17,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:17,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:17,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:17,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:17,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:18,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:21:19,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:19,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:20,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:21:20,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:20,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:20,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:20,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:20,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:20,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:20,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:20,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:20,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:20,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:20,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:20,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:20,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:20,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:20,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:20,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:20,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:20,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:20,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:20,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:20,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:20,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:20,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:20,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:20,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:20,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:20,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:20,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:20,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:20,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:20,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:20,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:21,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:22,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:21:22,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:22,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:22,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:22,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:22,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:22,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:22,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:22,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:22,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:22,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:22,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:22,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:22,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:22,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:22,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:22,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:22,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:22,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:22,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:22,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:22,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:22,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:22,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:22,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:22,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:22,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:22,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:22,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:22,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:22,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:22,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:22,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:23,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:23,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:23,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:23,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:23,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:23,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:23,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:23,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:23,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:23,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:23,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:23,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:23,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:23,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:23,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:23,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:23,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:23,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:23,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:23,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:23,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:23,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:23,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:23,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:23,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:23,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:23,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:23,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:23,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:23,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:23,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:23,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:24,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:21:25,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:25,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:25,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:25,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:25,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:25,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:25,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:25,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:25,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:25,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:25,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:25,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:25,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:25,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:25,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:25,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:25,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:25,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:25,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:25,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:25,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:25,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:25,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:25,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:25,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:25,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:25,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:25,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:25,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:25,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:25,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:25,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:26,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:21:27,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:27,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:27,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:27,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:27,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:27,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:27,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:27,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:27,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:27,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:27,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:27,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:27,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:27,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:27,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:27,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:28,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:21:29,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:29,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:30,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:21:30,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:30,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:30,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:30,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:30,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:30,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:30,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:30,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:30,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:30,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:30,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:30,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:30,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:30,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:30,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:30,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:31,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:31,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:31,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:31,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:31,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:31,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:31,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:31,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:31,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:31,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:31,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:31,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:31,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:31,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:31,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:31,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:32,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:21:32,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:21:32,107 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:21:33,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:33,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:33,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:33,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:33,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:33,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:33,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:33,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:33,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:33,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:33,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:33,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:33,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:33,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:33,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:33,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:34,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:21:34,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:34,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:34,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:34,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:34,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:34,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:34,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:34,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:34,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:34,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:34,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:34,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:34,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:34,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:34,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:34,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:35,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:35,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:35,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:35,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:35,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:35,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:35,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:35,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:35,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:35,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:35,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:35,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:35,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:35,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:35,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:35,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:36,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:21:37,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:37,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:38,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:21:38,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:38,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:38,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:38,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:38,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:38,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:38,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:38,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:38,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:38,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:38,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:38,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:38,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:38,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:38,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:38,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:40,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:21:41,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:41,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:41,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:41,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:41,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:41,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:41,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:41,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:41,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:41,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:41,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:41,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:41,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:41,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:41,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:41,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:42,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:21:42,487 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:21:42,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:42,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:42,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:42,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:42,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:42,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:42,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:42,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:42,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:42,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:42,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:42,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:42,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:42,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:42,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:42,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:44,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:21:46,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:21:47,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:21:47,381 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:21:47,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:47,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:47,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:47,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:47,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:47,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:47,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:47,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:47,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:47,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:47,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:47,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:47,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:47,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:47,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:47,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:48,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:21:48,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:48,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:48,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:48,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:48,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:48,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:48,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:48,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:48,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:48,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:48,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:48,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:48,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:48,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:48,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:48,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:49,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:49,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:49,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:49,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:49,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:49,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:49,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:49,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:49,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:49,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:49,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:49,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:49,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:49,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:49,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:49,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:51,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:21:51,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:51,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:51,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:51,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:51,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:51,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:51,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:51,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:51,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:51,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:51,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:51,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:51,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:51,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:51,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:51,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:52,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:52,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:52,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:52,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:52,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:52,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:52,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:52,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:52,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:52,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:52,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:52,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:52,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:52,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:52,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:52,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:53,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:21:53,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:53,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:53,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:53,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:53,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:53,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:53,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:53,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:53,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:53,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:53,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:53,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:53,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:21:53,652 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 21:21:53,833 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 21:21:53,931 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 21:21:54,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 21:21:55,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:22:02,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:22:02,849 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:22:05,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:22:09,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:22:12,579 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:22:13,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:22:15,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:15,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:15,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:15,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:15,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:15,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:15,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:15,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:15,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:15,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:15,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:15,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:15,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:15,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:15,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:15,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:17,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:22:18,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:22:18,273 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:22:21,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:22:25,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:22:29,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:22:31,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:22:33,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:22:33,812 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:22:35,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:22:36,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:36,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:36,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:36,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:36,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:36,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:36,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:36,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:36,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:36,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:36,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:36,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:36,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:36,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:36,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:36,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:36,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:36,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:36,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:36,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:36,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:36,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:36,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:36,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:36,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:36,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:36,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:36,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:36,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:36,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:36,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:36,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:39,121 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:22:41,121 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:22:42,681 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:22:45,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:22:47,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:22:49,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:22:49,041 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:22:51,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:22:53,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:22:54,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:54,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:54,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:54,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:54,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:54,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:54,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:54,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:54,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:54,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:54,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:54,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:54,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:54,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:54,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:54,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:22:55,128 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:22:57,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:23:01,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:23:01,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:01,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:01,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:01,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:01,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:01,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:01,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:01,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:01,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:01,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:01,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:01,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:01,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:01,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:01,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:01,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:03,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:23:04,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:23:04,371 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:23:05,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:23:07,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:23:09,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:23:10,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:10,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:10,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:10,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:10,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:10,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:10,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:10,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:10,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:10,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:10,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:10,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:10,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:10,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:10,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:10,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:10,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:10,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:10,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:10,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:10,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:10,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:10,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:10,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:10,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:10,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:10,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:10,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:10,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:10,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:10,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:10,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:11,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:23:11,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:11,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:11,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:11,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:11,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:11,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:11,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:11,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:11,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:11,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:11,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:11,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:11,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:11,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:11,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:11,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:11,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:11,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:11,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:11,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:11,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:11,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:11,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:11,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:11,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:11,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:11,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:11,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:11,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:11,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:11,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:11,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:12,756 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:23:13,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:23:13,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:13,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:13,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:13,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:13,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:13,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:13,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:13,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:13,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:13,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:13,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:13,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:13,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:13,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:13,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:13,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:23:15,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:15,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:16,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:16,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:16,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:16,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:16,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:16,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:16,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:16,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:16,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:16,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:16,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:16,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:16,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:16,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:16,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:16,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:17,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:23:17,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:17,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:17,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:17,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:17,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:17,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:17,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:17,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:17,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:17,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:17,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:17,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:17,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:17,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:17,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:17,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:18,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:18,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:18,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:18,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:18,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:18,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:18,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:18,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:18,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:18,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:18,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:18,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:18,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:18,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:18,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:18,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:19,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:23:19,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:19,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:19,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:19,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:19,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:19,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:19,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:19,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:19,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:19,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:19,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:19,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:19,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:19,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:19,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:19,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:19,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:23:19,644 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:23:19,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:19,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:19,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:19,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:19,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:19,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:19,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:19,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:19,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:19,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:19,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:19,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:19,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:19,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:19,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:19,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:20,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:20,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:20,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:20,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:20,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:20,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:20,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:20,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:20,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:20,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:20,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:20,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:20,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:20,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:20,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:20,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:20,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:20,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:20,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:20,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:20,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:20,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:20,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:20,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:20,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:20,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:20,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:20,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:20,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:20,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:20,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:20,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:23:21,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:21,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:22,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:22,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:22,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:22,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:22,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:22,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:22,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:22,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:22,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:22,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:22,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:22,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:22,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:22,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:22,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:22,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:22,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:22,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:22,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:22,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:22,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:22,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:22,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:22,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:22,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:22,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:22,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:22,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:22,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:22,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:22,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:22,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:23,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:23,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:23,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:23,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:23,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:23,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:23,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:23,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:23,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:23,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:23,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:23,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:23,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:23,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:23,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:23,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:24,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:23:25,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:25,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:25,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:25,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:25,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:25,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:25,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:25,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:25,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:25,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:25,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:25,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:25,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:25,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:25,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:25,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:23:26,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:26,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:27,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:27,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:27,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:27,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:27,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:27,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:27,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:27,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:27,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:27,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:27,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:27,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:27,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:27,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:27,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:27,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:28,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:23:29,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:29,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:29,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:29,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:29,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:29,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:29,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:29,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:29,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:29,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:29,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:29,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:29,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:29,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:29,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:29,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:30,145 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:23:30,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:31,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:31,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:31,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:31,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:31,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:31,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:31,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:31,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:31,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:31,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:31,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:31,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:31,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:31,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:31,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:32,146 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:23:32,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:32,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:32,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:32,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:32,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:32,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:32,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:32,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:32,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:32,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:32,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:32,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:32,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:32,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:32,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:32,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:33,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:33,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:33,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:33,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:33,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:33,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:33,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:33,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:33,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:33,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:33,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:33,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:33,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:33,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:33,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:33,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:34,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:34,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:34,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:34,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:34,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:34,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:34,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:34,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:34,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:34,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:34,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:34,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:34,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:34,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:34,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:34,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:34,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:34,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:34,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:34,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:34,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:34,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:34,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:34,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:34,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:34,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:34,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:34,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:34,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:34,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:34,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:34,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:34,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:23:34,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:23:34,929 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:23:35,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:35,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:36,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:23:36,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:36,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:36,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:36,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:36,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:36,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:36,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:36,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:36,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:36,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:36,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:36,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:36,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:36,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:36,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:36,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:38,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:23:39,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:39,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:39,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:39,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:39,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:39,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:39,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:39,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:39,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:39,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:39,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:39,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:39,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:39,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:39,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:39,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:39,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:39,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:39,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:39,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:39,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:39,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:39,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:39,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:39,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:39,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:39,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:39,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:39,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:39,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:39,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:39,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:40,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:23:42,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:23:42,833 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:23:44,153 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:23:45,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:45,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:45,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:45,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:45,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:45,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:45,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:45,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:45,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:45,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:45,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:45,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:45,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:45,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:45,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:45,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:46,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:23:46,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:46,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:46,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:46,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:46,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:46,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:46,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:46,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:46,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:46,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:46,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:46,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:46,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:46,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:46,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:46,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:46,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:46,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:46,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:46,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:46,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:46,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:46,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:46,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:46,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:46,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:46,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:46,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:46,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:46,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:46,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:46,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:48,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:48,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:48,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:48,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:48,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:48,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:48,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:48,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:48,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:48,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:48,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:48,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:48,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:48,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:48,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:48,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:48,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:23:48,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:48,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:48,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:48,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:48,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:48,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:48,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:48,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:48,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:48,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:48,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:48,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:50,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:23:50,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:23:50,212 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:23:52,157 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:23:53,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:53,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:53,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:53,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:53,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:53,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:53,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:53,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:53,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:53,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:53,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:53,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:53,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:53,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:53,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:23:53,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:00,160 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:24:04,162 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:24:05,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:24:05,527 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:24:10,164 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:24:12,905 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:24:14,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:24:16,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:24:19,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:19,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:19,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:19,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:19,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:19,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:19,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:19,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:19,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:19,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:19,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:19,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:19,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:19,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:19,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:19,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:20,168 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:24:20,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:24:20,758 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:24:24,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:24:28,172 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:24:30,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:24:31,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:31,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:31,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:31,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:31,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:31,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:31,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:31,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:31,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:31,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:31,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:31,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:31,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:31,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:31,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:31,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:34,175 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:24:36,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:24:36,004 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:24:36,176 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:24:39,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:39,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:39,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:39,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:39,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:39,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:39,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:39,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:39,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:39,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:39,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:39,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:39,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:39,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:39,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:39,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:24:40,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:24:42,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:24:42,980 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:24:46,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:24:48,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:24:50,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:24:51,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:24:51,449 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:24:54,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:24:56,184 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:24:58,185 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:25:00,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:00,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:00,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:00,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:00,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:00,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:00,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:00,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:00,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:00,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:00,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:00,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:00,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:00,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:00,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:00,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:02,186 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:25:02,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:02,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:02,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:02,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:02,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:02,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:02,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:02,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:02,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:02,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:02,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:02,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:02,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:02,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:02,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:02,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:04,187 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:25:06,188 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:25:06,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:25:06,671 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:25:09,189 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:25:10,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:10,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:10,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:10,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:10,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:10,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:10,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:10,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:10,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:10,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:10,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:10,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:10,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:10,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:10,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:10,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:11,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:25:13,054 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:25:13,191 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:25:13,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:13,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:13,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:13,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:13,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:13,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:13,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:13,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:13,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:13,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:13,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:13,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:13,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:13,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:13,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:13,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:13,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:13,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:13,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:13,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:13,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:13,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:13,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:13,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:13,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:13,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:13,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:13,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:13,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:13,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:13,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:13,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:14,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:14,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:14,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:14,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:14,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:14,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:14,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:14,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:14,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:14,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:14,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:14,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:14,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:14,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:14,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:14,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:14,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:14,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:14,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:14,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:14,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:14,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:14,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:14,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:14,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:14,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:14,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:14,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:14,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:14,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:14,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:14,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:15,192 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:25:15,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:15,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:15,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:15,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:15,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:15,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:15,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:15,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:15,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:15,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:15,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:15,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:15,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:15,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:15,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:15,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:16,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:16,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:16,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:16,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:16,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:16,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:16,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:16,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:16,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:16,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:16,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:16,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:16,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:16,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:16,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:16,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:17,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:17,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:17,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:17,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:17,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:17,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:17,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:17,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:17,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:17,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:17,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:17,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:17,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:17,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:17,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:17,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:17,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:17,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:17,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:17,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:17,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:17,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:17,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:17,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:17,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:17,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:17,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:17,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:17,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:17,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:17,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:17,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:19,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:25:19,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:19,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:19,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:19,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:19,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:19,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:19,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:19,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:19,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:19,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:19,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:19,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:19,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:19,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:19,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:19,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:20,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:21,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:21,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:21,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:21,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:21,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:21,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:21,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:21,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:21,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:21,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:21,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:21,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:21,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:21,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:21,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:21,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:21,194 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:25:21,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:21,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:21,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:21,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:21,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:21,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:21,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:21,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:21,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:21,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:21,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:21,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:21,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:21,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:21,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:21,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:21,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:25:21,955 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:25:23,195 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:25:23,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:23,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:23,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:23,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:23,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:23,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:23,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:23,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:23,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:23,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:23,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:23,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:23,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:23,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:23,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:23,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:24,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:24,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:24,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:24,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:24,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:24,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:24,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:24,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:24,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:24,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:24,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:24,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:24,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:24,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:24,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:24,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:24,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:24,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:24,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:24,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:24,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:24,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:24,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:24,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:24,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:24,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:24,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:24,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:24,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:24,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:24,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:24,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:25,196 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:25:25,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:25,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:25,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:25,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:25,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:25,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:25,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:25,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:25,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:25,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:25,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:25,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:25,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:25,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:25,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:25,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:26,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:27,197 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:25:27,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:27,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:27,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:27,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:27,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:27,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:27,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:27,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:27,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:27,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:27,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:27,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:27,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:27,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:27,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:27,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:28,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:28,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:28,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:28,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:28,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:28,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:28,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:28,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:28,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:28,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:28,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:28,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:28,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:28,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:28,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:28,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:28,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:28,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:28,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:28,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:28,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:28,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:28,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:28,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:28,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:28,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:28,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:28,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:28,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:28,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:28,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:28,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:29,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:29,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:29,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:29,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:29,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:29,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:29,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:29,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:29,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:29,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:29,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:29,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:29,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:29,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:29,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:29,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:29,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:25:29,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:29,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:29,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:29,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:29,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:29,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:29,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:29,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:29,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:29,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:29,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:29,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:29,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:29,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:29,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:29,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:31,199 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:25:32,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:32,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:32,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:32,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:32,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:32,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:32,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:32,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:32,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:32,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:32,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:32,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:32,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:32,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:32,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:32,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:33,200 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:25:35,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:25:35,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:35,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:36,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:36,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:36,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:36,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:36,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:36,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:36,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:36,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:36,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:36,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:36,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:36,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:36,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:36,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:36,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:36,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:37,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:25:37,187 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:25:37,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:25:37,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:37,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:37,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:37,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:37,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:37,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:37,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:37,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:37,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:37,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:37,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:37,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:37,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:37,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:37,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:37,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:38,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:38,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:38,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:38,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:38,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:38,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:38,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:38,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:38,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:38,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:38,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:38,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:38,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:38,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:38,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:38,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:38,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:38,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:38,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:38,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:38,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:38,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:38,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:38,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:38,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:38,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:38,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:38,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:38,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:38,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:38,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:38,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:39,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:39,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:39,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:39,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:39,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:39,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:39,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:39,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:39,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:39,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:39,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:39,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:39,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:39,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:39,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:39,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:39,202 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:25:40,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:40,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:40,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:40,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:40,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:40,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:40,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:40,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:40,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:40,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:40,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:40,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:40,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:40,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:40,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:40,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:41,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:41,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:41,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:41,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:41,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:41,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:41,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:41,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:41,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:41,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:41,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:41,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:41,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:41,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:41,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:41,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:41,203 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:25:43,126 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:25:43,204 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:25:45,205 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:25:45,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:45,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:45,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:45,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:45,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:45,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:45,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:45,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:45,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:45,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:45,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:45,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:45,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:45,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:45,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:45,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:47,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:47,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:47,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:47,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:47,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:47,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:47,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:47,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:47,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:47,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:47,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:47,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:47,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:47,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:47,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:47,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:47,206 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:25:48,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:48,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:48,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:48,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:48,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:48,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:48,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:48,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:48,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:48,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:48,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:48,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:48,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:48,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:48,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:48,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:48,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:48,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:48,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:48,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:48,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:48,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:48,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:48,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:48,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:48,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:48,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:48,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:48,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 21:25:48,640 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 21:25:48,874 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 21:25:48,946 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 21:25:49,207 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 21:25:49,207 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:25:50,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:25:51,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:25:52,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:25:52,417 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:25:53,209 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:25:55,210 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:25:57,211 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:25:59,212 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:26:01,213 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:26:03,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:26:05,215 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:26:07,216 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:26:07,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:26:07,670 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:26:09,217 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:26:11,218 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:26:13,204 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:26:13,219 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:26:15,220 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:26:17,220 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:26:19,221 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:26:21,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:26:23,224 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:26:23,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:26:23,324 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:26:25,225 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:26:27,226 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:26:29,227 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:26:31,228 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:26:33,229 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:26:35,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:26:37,231 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:26:38,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:26:38,551 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:26:39,232 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:26:42,233 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:26:43,278 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:26:44,234 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:26:46,235 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:26:48,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:26:50,237 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:26:52,238 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:26:53,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:26:53,775 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:26:54,239 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:26:56,240 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:26:58,241 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:27:00,242 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:27:02,242 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:27:04,243 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:27:06,244 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:27:08,245 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:27:09,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:27:09,161 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:27:10,246 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:27:12,247 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:27:13,351 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:27:14,248 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:27:16,249 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:27:18,249 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:27:20,250 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:27:22,251 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:27:24,252 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:27:24,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:27:24,388 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:27:26,253 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:27:28,254 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:27:30,255 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:27:32,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:27:34,257 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:27:36,257 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:27:38,258 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:27:39,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:27:39,605 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:27:40,259 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:27:42,260 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:27:43,425 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:27:44,260 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:27:46,261 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:27:48,262 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:27:51,263 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:27:53,264 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:27:54,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:27:54,904 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:27:55,265 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:27:57,265 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:27:59,266 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:28:01,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:28:03,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:28:05,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:28:07,270 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:28:09,271 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:28:10,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:28:10,131 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:28:11,272 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:28:13,273 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:28:13,499 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:28:15,274 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:28:17,275 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:28:19,276 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:28:21,277 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:28:23,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:28:25,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:28:25,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:28:25,548 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:28:27,279 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:28:29,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:28:31,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:28:33,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:28:35,283 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:28:37,283 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:28:39,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:28:40,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:28:40,926 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:28:41,285 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:28:43,286 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:28:43,574 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:28:45,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:28:47,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:28:49,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:28:51,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:28:54,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:28:56,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:28:56,149 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:28:56,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:28:58,292 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:29:00,293 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:29:02,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:29:04,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:29:06,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:29:08,296 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:29:10,297 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:29:11,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:29:11,480 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:29:12,298 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:29:13,650 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:29:14,299 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:29:16,299 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:29:18,300 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:29:20,301 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:29:22,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:29:24,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:29:26,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:29:26,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:29:26,801 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:29:28,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:29:30,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:29:32,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:29:34,306 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:29:36,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:29:38,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:29:40,308 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:29:42,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:29:42,071 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:29:42,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:29:43,725 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:29:44,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:29:46,310 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:29:48,311 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:29:51,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:29:53,313 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:29:55,314 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:29:57,314 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:29:57,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:29:57,404 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:29:59,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:30:01,316 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:30:03,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:30:05,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:30:07,318 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:30:09,319 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:30:11,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:30:12,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:30:12,664 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:30:13,321 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:30:13,802 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:30:15,322 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:30:17,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:30:19,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:30:21,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:30:23,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:30:25,326 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:30:27,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:30:27,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:30:27,979 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:30:29,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:30:31,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:30:33,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:30:35,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:30:37,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:30:39,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:30:41,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:30:43,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:30:43,259 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:30:43,335 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:30:43,878 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:30:45,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:30:47,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:30:49,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:30:51,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:30:53,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:30:55,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:30:57,342 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:30:58,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:30:58,530 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:30:59,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:31:01,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:31:03,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:31:05,346 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:31:08,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:31:10,348 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:31:12,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:31:13,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:31:13,790 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:31:14,053 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:31:14,350 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:31:16,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:31:18,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:31:20,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:31:22,354 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:31:24,354 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:31:26,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:31:28,356 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:31:29,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:31:29,055 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:31:30,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:31:32,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:31:34,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:31:36,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:31:38,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:31:40,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:31:42,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:31:44,028 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:31:44,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:31:44,330 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:31:44,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:31:46,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:31:48,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:31:50,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:31:52,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:31:54,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:31:56,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:31:58,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:31:59,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:31:59,729 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:32:00,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:32:02,371 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:32:04,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:32:06,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:32:08,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:32:10,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:32:12,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:32:14,102 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:32:14,376 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:32:14,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:32:14,954 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:32:17,377 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:32:19,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:32:21,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:32:23,379 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:32:25,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:32:27,381 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:32:29,382 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:32:30,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:32:30,245 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:32:31,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:32:33,384 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:32:35,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:32:37,386 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:32:39,387 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:32:41,388 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:32:43,389 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:32:44,179 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:32:45,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:32:45,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:32:45,555 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:32:47,391 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:32:49,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:32:51,393 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:32:53,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:32:55,395 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:32:57,395 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:32:59,396 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:33:00,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:33:00,835 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:33:01,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:33:03,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:33:05,399 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:33:07,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:33:09,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:33:11,402 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:33:13,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:33:14,255 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:33:15,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:33:16,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:33:16,060 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:33:17,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:33:19,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:33:21,406 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:33:23,407 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:33:25,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:33:27,409 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:33:29,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:33:31,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:33:31,407 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:33:31,411 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:33:33,412 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:33:35,413 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:33:37,414 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:33:39,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:33:41,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:33:43,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:33:44,333 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:33:45,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:33:46,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:33:46,738 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:33:47,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:33:49,419 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:33:52,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:33:54,421 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:33:56,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:33:58,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:34:00,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:34:01,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:34:01,964 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:34:02,425 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:34:04,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:34:06,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:34:08,427 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:34:10,428 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:34:12,429 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:34:14,408 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:34:14,430 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:34:16,431 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:34:17,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:34:17,478 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:34:18,432 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:34:20,433 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:34:22,434 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:34:24,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:34:26,436 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:34:28,437 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:34:30,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:34:32,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:34:32,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:34:32,719 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:34:34,439 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:34:36,440 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:34:38,440 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:34:40,441 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:34:42,442 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:34:44,442 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:34:44,482 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:34:46,443 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:34:48,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:34:48,040 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:34:48,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:34:50,445 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:34:52,446 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:34:54,447 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:34:56,448 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:34:58,448 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:35:00,449 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:35:03,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:35:03,270 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:35:03,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:35:05,451 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:35:07,452 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:35:09,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:35:11,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:35:13,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:35:14,556 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:35:15,455 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:35:17,456 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:35:18,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:35:18,578 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:35:19,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:35:21,458 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:35:23,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:35:25,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:35:27,460 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:35:29,461 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:35:31,461 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:35:33,462 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:35:34,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:35:34,042 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:35:35,463 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:35:37,463 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:35:39,464 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:35:41,465 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:35:43,466 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:35:44,632 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:35:45,467 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:35:47,468 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:35:49,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:35:49,442 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:35:49,468 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:35:51,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:35:53,470 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:35:55,471 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:35:57,472 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:35:59,473 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:36:01,474 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:36:03,475 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:36:04,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:36:04,734 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:36:05,476 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:36:08,477 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:36:10,478 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:36:12,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:36:14,480 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:36:14,711 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:36:16,481 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:36:18,481 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:36:20,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:36:20,060 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:36:20,482 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:36:22,483 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:36:24,484 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:36:26,485 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:36:28,486 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:36:30,486 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:36:32,488 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:36:34,488 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:36:35,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:36:35,284 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:36:36,489 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:36:38,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:36:40,491 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:36:42,492 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:36:44,493 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:36:44,789 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:36:46,494 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:36:48,495 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:36:50,496 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:36:50,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:36:50,693 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:36:52,497 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:36:54,498 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:36:56,498 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:36:58,499 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:37:00,500 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:37:02,501 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:37:04,502 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:37:06,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:37:06,165 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:37:06,503 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:37:08,504 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:37:10,505 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:37:12,506 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:37:14,507 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:37:14,866 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:37:16,508 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:37:18,509 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:37:20,510 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:37:21,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:37:21,434 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:37:22,511 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:37:24,512 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:37:27,513 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:37:29,514 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:37:31,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:37:33,516 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:37:35,517 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:37:36,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:37:36,658 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:37:37,518 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:37:39,519 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:37:41,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:37:43,521 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:37:44,940 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:37:45,522 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:37:47,523 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:37:49,524 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:37:51,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:37:51,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:37:51,948 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:37:53,526 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:37:55,527 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:37:57,528 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:37:59,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:38:01,530 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:38:03,532 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:38:05,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:38:07,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:38:07,370 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:38:07,534 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:38:09,534 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:38:11,535 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:38:13,536 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:38:15,013 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:38:15,537 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:38:17,538 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:38:19,539 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:38:21,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:38:22,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:38:22,616 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:38:23,541 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:38:25,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:38:27,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:38:30,545 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:38:32,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:38:34,547 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:38:36,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:38:37,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:38:37,881 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:38:38,549 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:38:40,549 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:38:42,550 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:38:44,551 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:38:45,089 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:38:46,552 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:38:48,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:38:50,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:38:52,555 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:38:53,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:38:53,151 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:38:54,555 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:38:56,556 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:38:58,557 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:39:00,558 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:39:02,559 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:39:04,559 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:39:06,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:39:08,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:39:08,374 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:39:08,561 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:39:10,561 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:39:12,562 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:39:14,563 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:39:15,166 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:39:16,564 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:39:18,564 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:39:20,565 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:39:22,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:39:23,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:39:23,739 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:39:24,567 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:39:26,568 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:39:28,568 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:39:30,569 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:39:32,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:39:34,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:39:36,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:39:38,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:39:38,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:39:38,974 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:39:40,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:39:42,574 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:39:44,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:39:45,241 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:39:46,576 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:39:48,576 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:39:50,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:39:52,578 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:39:54,579 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:39:54,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:39:54,581 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:39:56,580 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:39:58,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:40:01,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:40:03,583 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:40:05,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:40:07,585 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:40:09,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:40:09,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:40:09,809 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:40:11,587 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:40:13,588 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:40:15,316 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:40:15,589 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:40:17,590 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:40:19,591 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:40:21,592 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:40:23,593 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:40:25,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:40:25,065 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:40:25,594 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:40:27,595 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:40:29,596 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:40:31,596 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:40:33,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:40:35,598 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:40:37,599 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:40:39,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:40:40,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:40:40,506 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:40:41,601 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:40:43,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:40:45,393 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:40:45,603 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:40:47,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:40:49,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:40:51,605 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:40:53,606 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:40:55,607 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:40:55,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:40:55,872 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:40:57,608 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:40:59,608 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:41:01,609 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:41:03,610 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:41:05,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:41:07,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:41:09,613 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:41:11,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:41:11,139 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:41:11,614 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:41:13,614 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:41:15,468 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:41:15,615 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:41:17,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:41:19,617 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:41:21,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:41:23,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:41:25,619 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:41:26,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:41:26,483 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:41:27,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:41:29,621 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:41:31,621 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:41:33,622 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:41:35,623 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:41:37,624 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:41:39,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:41:41,626 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:41:41,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:41:41,713 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:41:43,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:41:45,545 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:41:45,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:41:47,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:41:49,629 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:41:52,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:41:54,631 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:41:56,632 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:41:57,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:41:57,032 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:41:58,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:42:00,634 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:42:02,635 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:42:04,635 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:42:06,636 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:42:08,637 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:42:10,638 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:42:12,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:42:12,273 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:42:12,639 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:42:14,640 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:42:15,618 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:42:16,641 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:42:18,641 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:42:20,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:42:22,643 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:42:24,644 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:42:26,645 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:42:27,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:42:27,642 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:42:28,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:42:30,648 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:42:32,649 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:42:34,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:42:36,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:42:38,651 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:42:40,652 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:42:42,653 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:42:42,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:42:42,920 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:42:44,653 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:42:45,695 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:42:46,654 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:42:48,655 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:42:50,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:42:52,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:42:54,657 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:42:56,658 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:42:58,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:42:58,166 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:42:59,660 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:43:01,661 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:43:03,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:43:05,663 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:43:07,664 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:43:09,665 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:43:11,665 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:43:13,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:43:13,504 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:43:13,666 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:43:15,667 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:43:15,771 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:43:17,668 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:43:19,668 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:43:21,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:43:23,670 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:43:25,671 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:43:27,672 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:43:28,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:43:28,734 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:43:29,672 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:43:31,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:43:33,674 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:43:35,675 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:43:37,675 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:43:39,676 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:43:41,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:43:43,678 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:43:44,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:43:44,106 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:43:45,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:43:45,847 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:43:47,680 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:43:49,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:43:51,682 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:43:53,683 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:43:55,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:43:57,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:43:59,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:43:59,449 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:43:59,685 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:44:01,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:44:03,687 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:44:05,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:44:07,689 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:44:09,690 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:44:11,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:44:13,692 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:44:14,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:44:14,746 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:44:15,693 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:44:15,924 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:44:17,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:44:19,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:44:21,695 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:44:24,697 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:44:26,698 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:44:28,699 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:44:30,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:44:30,040 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:44:30,700 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:44:32,701 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:44:34,702 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:44:36,702 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:44:38,703 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:44:40,704 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:44:42,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:44:44,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:44:45,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:44:45,717 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:44:46,000 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:44:46,706 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:44:48,707 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:44:50,708 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:44:52,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:44:54,710 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:44:56,711 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:44:58,711 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:45:00,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:45:00,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:45:00,940 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:45:02,713 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:45:04,714 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:45:06,715 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:45:08,716 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:45:10,716 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:45:12,717 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:45:14,718 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:45:16,074 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:45:16,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:45:16,228 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:45:16,719 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:45:18,720 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:45:20,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:45:22,722 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:45:24,723 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:45:26,724 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:45:28,725 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:45:31,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:45:31,495 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:45:31,726 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:45:33,727 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:45:35,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:45:37,729 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:45:39,730 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:45:41,731 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:45:43,732 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:45:45,733 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:45:46,147 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:45:46,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:45:46,848 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:45:47,734 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:45:49,735 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:45:51,736 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:45:53,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:45:55,738 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:45:57,739 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:45:59,740 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:46:01,741 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:46:02,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:46:02,083 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:46:03,742 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:46:05,742 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:46:07,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:46:09,744 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:46:11,745 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:46:13,746 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:46:15,747 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:46:16,223 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:46:17,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:46:17,301 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:46:17,748 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:46:19,748 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:46:21,749 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:46:23,750 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:46:25,751 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:46:27,752 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:46:29,753 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:46:31,754 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:46:32,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:46:32,569 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:46:33,755 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:46:35,756 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:46:37,757 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:46:39,758 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:46:41,759 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:46:43,759 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:46:45,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:46:46,298 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:46:48,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:46:48,002 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:46:48,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:46:50,763 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:46:52,764 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:46:54,765 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:46:56,766 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:46:58,767 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:47:00,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:47:02,769 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:47:03,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:47:03,226 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:47:04,770 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:47:06,771 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:47:08,772 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:47:10,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:47:12,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:47:14,775 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:47:16,373 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:47:16,776 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:47:18,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:47:18,469 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:47:18,777 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:47:20,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:47:22,779 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:47:24,780 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:47:26,780 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:47:28,781 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:47:30,782 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:47:32,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:47:33,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:47:33,689 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:47:34,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:47:36,785 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:47:38,786 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:47:40,787 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:47:42,788 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:47:45,792 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:47:46,449 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:47:47,793 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:47:48,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:47:48,981 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:47:49,794 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:47:51,795 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:47:53,796 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:47:55,797 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:47:57,798 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:47:59,799 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:48:01,800 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:48:03,801 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:48:04,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:48:04,264 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:48:05,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:48:07,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:48:09,804 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:48:11,805 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:48:13,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:48:15,807 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:48:16,520 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:48:17,808 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:48:19,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:48:19,618 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:48:19,808 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:48:21,809 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:48:23,810 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:48:25,811 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:48:27,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:48:29,813 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:48:31,813 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:48:33,814 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:48:34,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:48:34,861 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:48:35,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:48:37,816 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:48:39,816 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:48:41,817 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:48:43,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:48:45,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:48:46,597 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:48:47,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:48:49,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:48:50,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:48:50,258 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:48:51,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:48:53,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:48:55,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:48:57,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:48:59,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:49:01,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:49:03,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:49:05,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:49:05,486 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:49:05,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:49:07,826 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:49:09,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:49:11,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:49:14,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:49:16,672 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:49:16,829 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:49:18,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:49:20,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:49:20,707 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:49:20,831 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:49:22,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:49:24,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:49:26,833 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:49:28,834 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:49:30,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:49:32,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:49:34,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:49:36,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:49:36,084 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:49:36,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:49:38,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:49:40,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:49:42,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:49:44,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:49:46,745 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:49:46,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:49:48,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:49:50,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:49:51,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:49:51,317 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:49:52,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:49:54,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:49:56,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:49:58,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:50:00,846 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:50:02,846 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:50:04,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:50:06,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:50:06,566 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:50:06,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:50:08,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:50:10,849 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:50:12,850 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:50:14,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:50:16,821 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:50:16,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:50:19,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:50:21,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:50:21,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:50:21,878 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:50:23,854 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:50:25,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:50:27,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:50:29,856 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:50:31,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:50:33,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:50:35,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:50:37,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:50:37,106 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:50:37,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:50:39,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:50:41,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:50:43,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:50:45,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:50:46,896 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:50:47,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:50:49,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:50:51,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:50:52,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:50:52,441 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:50:53,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:50:55,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:50:57,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:50:59,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:51:01,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:51:03,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:51:05,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:51:07,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:51:08,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:51:08,013 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:51:09,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:51:11,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:51:13,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:51:15,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:51:16,969 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:51:17,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:51:20,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:51:22,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:51:23,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:51:23,241 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:51:24,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:51:26,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:51:28,882 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:51:30,883 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:51:32,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:51:34,885 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:51:36,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:51:38,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:51:38,701 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:51:38,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:51:40,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:51:42,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:51:44,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:51:46,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:51:47,043 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:51:48,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:51:50,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:51:52,894 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:51:53,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:51:53,924 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:51:54,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:51:56,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:51:58,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:52:00,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:52:02,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:52:04,900 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:52:06,901 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:52:08,902 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:52:09,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:52:09,186 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:52:10,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:52:12,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:52:14,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:52:16,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:52:17,116 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:52:18,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:52:20,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:52:22,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:52:24,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:52:24,536 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:52:24,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:52:26,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:52:28,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:52:30,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:52:32,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:52:34,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:52:36,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:52:38,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:52:39,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:52:39,756 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:52:40,916 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:52:42,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:52:44,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:52:47,190 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:52:47,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:52:49,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:52:51,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:52:53,921 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:52:55,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:52:55,064 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:52:55,922 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:52:57,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:52:59,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:53:01,925 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:53:03,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:53:05,927 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:53:07,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:53:09,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:53:10,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:53:10,291 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:53:11,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:53:13,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:53:15,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:53:17,267 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:53:17,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:53:19,937 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:53:21,938 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:53:23,939 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:53:25,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:53:25,526 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:53:25,940 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:53:27,941 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:53:29,941 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:53:31,942 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:53:33,943 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:53:35,944 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:53:37,945 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:53:39,946 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:53:40,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:53:40,844 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:53:41,947 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:53:43,947 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:53:45,948 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:53:47,345 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:53:47,949 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:53:49,950 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:53:51,951 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:53:53,952 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:53:55,953 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:53:56,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:53:56,178 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:53:58,955 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:54:00,955 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:54:02,956 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:54:04,957 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:54:06,958 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:54:08,959 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:54:10,960 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:54:11,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:54:11,664 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:54:12,961 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:54:14,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:54:16,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:54:17,421 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:54:18,963 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:54:20,964 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:54:22,965 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:54:24,966 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:54:26,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:54:26,943 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:54:26,967 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:54:28,968 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:54:30,968 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:54:32,969 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:54:34,970 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:54:36,971 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:54:38,972 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:54:40,973 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:54:42,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:54:42,229 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:54:42,973 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:54:44,974 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:54:46,975 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:54:47,496 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:54:48,976 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:54:50,976 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:54:53,978 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:54:55,979 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:54:57,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:54:57,610 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:54:57,980 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:54:59,981 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:55:01,982 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:55:03,983 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:55:05,983 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:55:07,984 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:55:09,985 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:55:11,987 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:55:12,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:55:12,839 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:55:13,987 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:55:15,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:55:17,569 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:55:17,989 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:55:19,990 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:55:21,991 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:55:23,992 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:55:25,993 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:55:27,994 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:55:28,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:55:28,151 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:55:29,994 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:55:31,995 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:55:33,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:55:35,997 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:55:37,998 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:55:39,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:55:41,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:55:43,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:55:43,449 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:55:44,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:55:46,001 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:55:47,644 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:55:49,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:55:51,003 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:55:53,004 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:55:55,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:55:57,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:55:58,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:55:58,833 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:55:59,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:56:01,007 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:56:03,008 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:56:05,009 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:56:07,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:56:09,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:56:11,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:56:13,012 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:56:14,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:56:14,072 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:56:15,013 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:56:17,014 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:56:17,720 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:56:19,014 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:56:21,015 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:56:23,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:56:25,017 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:56:27,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:56:29,019 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:56:29,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:56:29,506 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:56:31,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:56:33,021 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:56:35,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:56:38,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:56:40,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:56:42,025 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:56:44,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:56:45,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:56:45,048 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:56:46,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:56:47,796 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:56:48,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:56:50,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:56:52,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:56:54,031 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:56:56,032 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:56:58,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:57:00,034 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:57:00,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:57:00,386 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:57:02,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:57:04,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:57:06,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:57:08,038 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:57:10,038 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:57:12,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:57:14,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:57:15,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:57:15,690 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:57:16,041 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:57:17,871 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:57:18,042 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:57:20,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:57:22,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:57:24,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:57:26,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:57:28,047 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:57:30,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:57:30,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:57:30,989 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:57:32,049 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:57:34,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:57:36,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:57:38,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:57:40,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:57:43,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:57:45,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:57:46,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:57:46,280 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:57:47,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:57:47,947 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:57:49,056 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:57:51,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:57:53,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:57:55,059 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:57:57,060 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:57:59,061 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:58:01,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:58:01,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:58:01,611 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:58:03,063 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:58:05,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:58:07,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:58:09,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:58:11,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:58:13,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:58:15,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:58:16,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:58:16,840 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:58:17,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:58:18,022 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:58:19,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:58:21,071 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:58:23,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:58:25,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:58:27,074 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:58:29,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:58:31,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:58:32,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:58:32,075 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:58:33,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:58:35,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:58:37,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:58:39,081 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:58:41,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:58:43,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:58:45,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:58:47,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:58:47,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:58:47,396 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:58:48,099 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:58:50,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:58:52,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:58:54,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:58:56,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:58:58,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:59:00,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:59:02,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:59:02,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:59:02,894 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:59:04,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:59:06,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:59:08,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:59:10,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:59:12,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:59:14,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:59:16,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:59:18,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:59:18,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:59:18,149 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:59:18,376 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:59:20,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:59:22,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:59:24,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:59:26,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:59:28,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:59:30,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:59:32,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:59:33,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:59:33,378 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:59:34,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:59:36,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:59:38,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:59:40,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:59:42,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:59:44,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:59:46,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:59:48,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:59:48,234 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 21:59:48,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 21:59:48,692 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 21:59:50,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:59:53,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:59:55,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:59:57,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 21:59:59,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:00:01,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:00:03,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:00:04,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:00:04,381 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:00:05,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:00:07,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:00:09,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:00:11,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:00:13,121 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:00:15,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:00:17,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:00:18,307 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:00:19,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:00:19,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:00:19,681 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:00:21,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:00:23,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:00:25,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:00:27,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:00:29,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:00:31,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:00:33,128 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:00:34,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:00:34,904 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:00:35,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:00:37,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:00:39,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:00:41,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:00:43,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:00:45,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:00:47,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:00:48,377 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:00:49,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:00:50,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:00:50,196 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:00:51,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:00:53,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:00:55,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:00:57,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:00:59,140 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:01:01,140 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:01:03,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:01:05,142 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:01:05,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:01:05,598 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:01:07,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:01:09,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:01:11,145 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:01:13,146 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:01:16,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:01:18,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:01:18,448 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:01:20,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:01:20,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:01:20,963 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:01:22,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:01:24,150 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:01:26,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:01:28,152 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:01:30,153 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:01:32,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:01:34,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:01:36,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:01:36,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:01:36,254 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:01:38,157 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:01:40,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:01:42,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:01:44,159 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:01:46,160 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:01:48,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:01:48,525 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:01:50,162 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:01:51,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:01:51,527 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:01:52,162 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:01:54,163 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:01:56,164 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:01:58,165 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:02:00,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:02:02,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:02:04,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:02:06,168 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:02:06,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:02:06,820 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:02:08,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:02:10,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:02:12,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:02:14,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:02:16,172 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:02:18,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:02:18,606 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:02:20,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:02:22,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:02:22,109 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:02:23,175 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:02:25,176 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:02:27,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:02:29,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:02:31,179 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:02:33,179 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:02:35,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:02:37,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:02:37,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:02:37,332 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:02:39,182 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:02:41,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:02:43,184 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:02:45,185 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:02:47,186 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:02:48,681 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:02:49,187 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:02:51,188 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:02:52,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:02:52,558 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:02:53,189 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:02:55,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:02:57,191 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:02:59,192 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:03:01,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:03:03,194 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:03:05,195 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:03:07,196 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:03:07,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:03:07,784 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:03:09,197 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:03:11,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:03:13,199 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:03:15,200 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:03:17,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:03:18,756 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:03:19,202 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:03:21,203 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:03:23,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:03:23,103 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:03:23,203 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:03:25,204 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:03:27,205 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:03:29,206 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:03:31,207 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:03:33,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:03:35,209 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:03:38,211 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:03:38,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:03:38,388 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:03:40,212 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:03:42,213 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:03:44,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:03:46,215 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:03:48,216 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:03:48,834 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:03:50,217 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:03:52,218 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:03:53,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:03:53,613 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:03:54,219 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:03:56,220 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:03:58,221 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:04:00,222 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:04:02,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:04:04,224 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:04:06,225 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:04:08,226 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:04:09,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:04:09,128 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:04:10,227 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:04:12,228 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:04:14,229 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:04:16,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:04:18,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:04:18,911 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:04:20,231 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:04:22,232 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:04:24,233 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:04:24,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:04:24,444 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:04:26,234 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:04:28,235 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:04:30,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:04:32,237 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:04:35,238 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:04:37,239 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:04:39,240 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:04:39,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:04:39,790 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:04:41,241 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:04:43,242 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:04:45,243 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:04:47,244 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:04:48,988 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:04:49,245 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:04:51,246 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:04:53,247 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:04:55,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:04:55,014 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:04:55,248 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:04:57,249 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:04:59,250 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:05:01,251 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:05:03,252 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:05:05,253 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:05:07,254 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:05:09,255 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:05:10,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:05:10,342 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:05:11,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:05:13,257 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:05:15,258 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:05:17,259 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:05:19,063 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:05:19,260 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:05:21,261 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:05:23,262 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:05:25,263 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:05:25,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:05:25,569 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:05:27,264 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:05:29,265 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:05:31,266 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:05:33,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:05:35,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:05:37,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:05:39,270 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:05:40,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:05:40,862 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:05:41,271 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:05:43,272 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:05:45,273 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:05:47,273 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:05:49,139 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:05:49,274 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:05:51,275 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:05:53,276 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:05:55,277 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:05:56,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:05:56,084 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:05:58,279 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:06:00,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:06:02,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:06:04,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:06:06,283 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:06:08,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:06:10,285 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:06:11,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:06:11,372 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:06:12,286 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:06:14,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:06:16,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:06:18,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:06:19,217 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:06:20,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:06:22,290 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:06:24,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:06:26,292 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:06:26,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:06:26,626 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:06:28,293 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:06:30,293 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:06:32,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:06:34,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:06:36,296 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:06:38,297 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:06:40,297 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:06:41,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:06:41,854 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:06:42,298 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:06:44,299 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:06:46,300 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:06:48,301 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:06:49,297 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:06:50,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:06:52,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:06:54,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:06:56,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:06:57,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:06:57,326 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:06:58,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:07:00,306 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:07:02,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:07:04,308 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:07:06,308 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:07:08,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:07:10,310 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:07:12,311 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:07:12,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:07:12,555 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:07:14,311 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:07:16,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:07:19,314 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:07:19,372 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:07:21,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:07:23,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:07:25,316 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:07:27,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:07:27,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:07:27,901 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:07:29,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:07:31,318 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:07:33,319 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:07:35,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:07:37,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:07:39,321 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:07:41,322 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:07:43,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:07:43,232 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:07:43,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:07:45,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:07:47,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:07:49,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:07:49,446 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:07:51,326 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:07:53,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:07:55,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:07:57,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:07:58,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:07:58,450 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:07:59,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:08:01,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:08:03,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:08:05,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:08:07,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:08:09,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:08:11,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:08:13,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:08:13,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:08:13,678 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:08:15,335 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:08:17,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:08:19,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:08:19,523 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:08:21,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:08:23,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:08:25,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:08:27,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:08:29,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:08:29,001 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:08:29,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:08:31,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:08:33,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:08:35,342 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:08:37,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:08:39,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:08:41,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:08:43,346 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:08:44,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:08:44,266 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:08:46,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:08:48,348 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:08:49,597 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:08:50,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:08:52,350 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:08:54,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:08:56,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:08:58,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:08:59,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:08:59,564 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:09:00,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:09:02,354 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:09:04,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:09:06,356 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:09:08,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:09:10,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:09:12,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:09:14,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:09:14,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:09:14,837 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:09:16,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:09:18,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:09:19,668 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:09:20,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:09:22,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:09:24,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:09:26,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:09:28,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:09:30,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:09:30,141 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:09:30,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:09:32,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:09:34,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:09:36,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:09:38,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:09:40,371 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:09:42,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:09:45,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:09:45,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:09:45,598 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:09:47,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:09:49,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:09:49,740 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:09:51,376 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:09:53,377 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:10:00,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:10:00,820 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:10:16,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:10:16,101 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:10:19,816 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:10:31,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:10:31,424 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:10:46,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:10:46,691 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:10:49,890 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:10:53,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:10:53,230 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 22:10:53,283 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 22:10:53,381 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 22:10:53,396 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 22:10:54,396 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:10:55,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:11:01,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:11:02,000 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:11:03,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:11:17,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:11:17,312 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:11:19,973 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:11:25,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:11:32,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:11:32,539 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:11:47,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:11:47,778 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:11:50,050 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:12:03,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:12:03,001 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:12:18,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:12:18,226 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:12:20,129 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:12:33,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:12:33,635 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:12:48,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:12:48,863 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:12:50,209 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:13:04,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:13:04,088 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:13:19,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:13:19,654 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:13:20,288 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:13:34,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:13:34,904 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:13:50,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:13:50,131 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:13:50,369 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:14:05,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:14:05,356 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:14:20,446 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:14:20,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:14:20,714 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:14:35,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:14:35,961 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:14:50,525 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:14:51,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:14:51,188 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:15:06,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:15:06,408 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:15:16,509 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:15:17,509 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:15:19,510 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:15:20,600 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:15:21,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:15:21,634 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:15:27,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:15:27,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:15:27,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:15:27,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:15:27,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:15:27,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:15:27,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:15:27,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:15:27,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:15:27,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:15:27,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:15:27,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:15:27,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:15:27,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:15:27,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:15:27,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:15:29,514 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:15:35,516 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:15:36,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:15:36,878 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:15:37,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:15:37,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:15:37,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:15:37,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:15:37,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:15:37,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:15:37,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:15:37,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:15:37,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:15:37,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:15:37,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:15:37,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:15:37,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:15:37,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:15:37,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:15:37,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:15:39,518 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:15:44,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:15:48,521 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:15:50,672 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:15:52,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:15:52,317 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:15:52,523 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:15:54,523 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:15:58,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:16:00,526 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:16:03,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:03,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:03,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:03,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:03,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:03,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:03,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:03,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:03,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:03,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:03,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:03,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:03,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:03,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:03,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:03,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:04,527 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:16:07,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:16:07,542 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:16:08,528 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:16:10,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:16:10,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:10,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:10,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:10,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:10,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:10,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:10,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:10,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:10,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:10,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:10,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:10,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:10,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:10,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:10,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:10,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:12,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:12,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:12,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:12,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:12,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:12,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:12,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:12,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:12,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:12,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:12,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:12,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:12,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:12,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:12,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:12,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:12,530 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:16:16,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:16:18,532 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:16:20,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:16:20,744 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:16:22,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:16:22,807 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:16:24,534 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:16:26,535 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:16:28,536 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:16:30,537 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:16:34,538 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:16:35,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:35,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:35,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:35,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:35,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:35,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:35,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:35,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:35,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:35,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:35,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:35,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:35,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:35,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:35,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:35,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:36,539 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:16:37,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:37,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:37,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:37,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:37,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:37,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:37,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:37,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:37,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:37,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:37,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:37,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:37,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:37,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:37,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:37,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:38,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:16:38,030 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:16:38,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:16:40,541 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:16:42,541 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:16:43,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:43,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:43,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:43,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:43,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:43,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:43,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:43,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:43,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:43,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:43,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:43,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:43,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:43,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:43,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:43,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:44,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:16:46,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:46,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:46,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:46,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:46,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:46,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:46,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:46,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:46,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:46,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:46,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:46,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:46,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:46,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:46,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:46,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:46,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:46,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:46,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:46,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:46,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:46,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:46,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:46,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:46,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:46,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:46,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:46,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:46,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:46,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:46,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:46,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:46,543 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:16:47,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:47,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:47,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:47,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:47,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:47,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:47,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:47,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:47,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:47,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:47,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:47,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:47,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:47,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:47,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:47,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:48,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:48,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:48,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:48,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:48,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:48,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:48,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:48,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:48,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:48,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:48,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:48,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:48,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:48,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:48,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:48,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:48,544 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:16:49,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:49,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:49,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:49,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:49,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:49,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:49,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:49,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:49,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:49,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:49,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:49,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:49,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:49,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:49,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:49,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:50,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:50,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:50,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:50,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:50,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:50,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:50,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:50,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:50,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:50,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:50,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:50,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:50,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:50,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:50,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:50,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:50,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:50,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:50,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:50,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:50,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:50,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:50,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:50,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:50,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:50,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:50,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:50,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:50,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:50,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:50,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:50,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:50,544 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:16:50,815 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:16:51,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:51,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:52,545 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:16:52,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:52,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:52,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:52,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:52,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:52,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:52,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:52,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:52,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:52,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:52,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:52,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:52,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:52,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:52,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:52,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:53,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:16:53,253 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:16:53,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:53,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:53,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:53,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:53,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:53,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:53,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:53,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:53,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:53,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:53,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:53,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:53,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:53,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:53,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:53,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:54,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:16:55,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:55,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:56,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:56,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:56,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:56,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:56,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:56,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:56,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:56,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:56,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:56,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:56,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:56,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:56,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:56,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:56,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:56,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:56,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:56,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:56,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:56,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:56,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:56,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:56,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:56,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:56,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:56,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:56,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:56,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:56,547 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:16:56,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:56,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:56,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:56,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:57,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:57,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:57,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:57,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:57,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:57,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:57,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:57,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:57,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:57,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:57,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:57,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:57,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:57,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:57,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:57,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:57,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:57,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:57,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:57,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:57,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:57,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:57,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:57,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:57,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:57,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:57,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:57,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:57,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:57,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:57,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:57,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:16:58,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:58,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:59,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:59,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:59,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:59,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:59,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:59,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:59,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:59,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:59,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:59,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:59,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:59,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:59,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:59,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:59,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:16:59,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:00,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:00,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:00,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:00,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:00,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:00,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:00,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:00,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:00,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:00,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:00,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:00,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:00,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:00,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:00,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:00,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:00,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:17:02,549 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:17:03,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:03,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:03,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:03,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:03,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:03,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:03,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:03,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:03,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:03,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:03,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:03,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:03,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:03,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:03,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:03,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:04,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:04,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:04,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:04,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:04,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:04,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:04,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:04,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:04,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:04,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:04,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:04,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:04,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:04,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:04,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:04,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:04,550 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:17:05,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:05,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:06,551 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:17:07,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:07,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:07,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:07,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:07,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:07,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:07,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:07,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:07,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:07,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:07,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:07,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:07,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:07,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:07,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:07,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:07,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:07,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:07,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:07,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:07,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:07,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:07,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:07,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:07,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:07,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:07,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:07,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:07,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:07,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:07,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:07,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:08,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:08,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:08,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:08,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:08,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:08,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:08,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:08,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:08,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:08,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:08,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:08,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:08,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:08,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:08,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:08,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:08,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:17:08,477 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:17:08,551 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:17:09,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:09,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:09,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:09,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:09,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:09,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:09,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:09,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:09,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:09,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:09,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:09,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:09,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:09,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:09,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:09,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:09,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:09,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:09,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:09,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:09,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:09,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:09,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:09,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:09,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:09,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:09,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:09,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:09,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:09,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:09,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:09,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:10,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:10,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:10,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:10,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:10,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:10,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:10,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:10,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:10,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:10,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:10,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:10,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:10,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:10,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:10,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:10,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:10,552 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:17:11,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:11,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:11,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:11,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:11,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:11,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:11,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:11,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:11,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:11,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:11,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:11,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:11,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:11,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:11,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:11,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:12,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:17:14,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:17:16,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:16,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:16,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:16,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:16,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:16,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:16,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:16,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:16,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:16,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:16,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:16,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:16,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:16,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:16,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:16,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:16,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:16,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:16,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:16,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:16,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:16,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:16,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:16,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:16,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:16,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:16,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:16,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:16,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:17:18,555 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:17:20,883 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:17:23,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:17:23,886 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:17:25,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:25,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:25,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:25,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:25,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:25,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:25,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:25,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:25,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:25,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:25,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:25,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:25,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:25,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:25,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:25,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:28,559 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:17:30,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:30,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:30,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:30,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:30,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:30,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:30,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:30,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:30,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:30,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:30,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:30,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:30,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:30,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:30,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:30,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:32,561 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:17:36,562 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:17:39,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:17:39,116 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:17:40,564 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:17:43,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:43,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:43,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:43,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:43,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:43,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:43,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:43,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:43,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:43,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:43,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:43,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:43,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:43,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:43,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:43,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:43,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:43,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:43,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:43,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:43,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:43,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:43,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:43,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:43,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:43,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:43,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:43,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:43,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:43,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:43,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:43,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:17:44,565 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:17:48,567 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:17:50,955 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:17:52,569 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:17:54,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:17:54,385 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:17:56,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:17:58,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:18:02,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:18:06,574 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:18:08,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:08,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:08,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:08,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:08,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:08,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:08,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:08,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:08,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:08,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:08,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:08,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:08,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:08,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:08,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:08,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:08,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:18:09,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:18:09,688 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:18:12,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:18:14,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:18:15,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:15,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:15,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:15,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:15,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:15,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:15,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:15,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:15,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:15,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:15,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:15,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:15,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:15,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:15,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:15,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:16,578 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:18:18,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:18,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:18,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:18,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:18,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:18,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:18,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:18,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:18,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:18,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:18,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:18,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:18,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:18,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:18,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:18,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:20,580 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:18:21,030 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:18:22,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:18:24,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:18:24,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:18:24,914 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:18:28,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:18:30,585 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:18:32,585 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:18:34,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:18:36,587 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:18:39,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:39,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:39,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:39,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:39,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:39,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:39,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:39,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:39,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:39,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:39,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:39,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:39,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:39,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:39,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:39,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:40,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:18:40,137 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:18:40,588 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:18:42,589 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:18:43,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:43,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:43,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:43,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:43,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:43,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:43,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:43,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:43,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:43,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:43,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:43,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:43,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:43,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:43,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:43,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:44,589 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:18:46,590 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:18:46,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:46,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:46,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:46,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:46,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:46,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:46,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:46,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:46,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:46,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:46,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:46,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:46,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:46,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:46,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:46,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:48,591 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:18:48,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:48,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:48,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:48,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:48,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:48,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:48,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:48,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:48,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:48,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:48,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:48,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:48,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:48,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:48,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:48,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:50,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:50,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:50,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:50,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:50,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:50,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:50,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:50,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:50,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:50,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:50,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:50,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:50,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:50,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:50,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:50,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:50,592 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:18:51,102 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:18:51,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:51,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:51,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:51,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:51,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:51,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:51,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:51,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:51,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:51,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:51,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:51,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:51,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:51,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:51,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:51,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:52,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:52,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:52,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:52,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:52,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:52,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:52,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:52,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:52,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:52,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:52,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:52,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:52,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:52,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:52,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:52,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:52,592 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:18:54,593 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:18:54,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:54,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:54,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:54,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:54,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:54,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:54,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:54,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:54,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:54,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:54,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:54,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:54,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:54,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:54,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:54,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:54,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:54,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:54,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:54,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:54,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:54,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:54,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:54,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:54,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:54,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:54,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:54,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:54,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:54,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:54,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:54,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:55,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:18:55,363 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:18:55,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:55,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:55,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:55,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:55,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:55,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:55,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:55,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:55,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:55,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:55,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:55,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:55,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:55,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:55,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:55,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:56,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:56,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:56,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:56,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:56,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:56,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:56,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:56,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:56,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:56,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:56,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:56,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:56,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:56,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:56,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:56,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:56,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:56,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:56,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:56,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:56,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:56,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:56,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:56,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:56,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:56,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:56,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:56,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:56,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:56,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:56,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:56,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:56,594 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:18:57,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:57,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:57,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:57,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:57,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:57,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:57,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:57,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:57,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:57,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:57,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:57,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:57,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:57,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:57,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:57,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:57,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:57,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:57,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:57,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:57,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:57,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:57,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:57,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:57,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:57,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:57,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:57,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:57,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:57,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:57,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:57,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:58,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:58,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:58,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:58,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:58,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:58,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:58,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:58,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:58,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:58,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:58,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:58,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:58,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:58,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:58,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:58,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,595 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:18:59,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:18:59,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:00,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:00,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:00,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:00,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:00,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:00,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:00,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:00,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:00,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:00,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:00,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:00,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:00,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:00,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:00,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:00,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:01,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:01,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:01,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:01,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:01,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:01,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:01,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:01,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:01,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:01,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:01,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:01,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:01,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:01,596 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:19:01,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:01,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:01,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:02,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:02,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:02,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:02,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:02,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:02,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:02,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:02,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:02,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:02,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:02,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:02,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:02,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:02,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:02,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:02,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:03,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:19:04,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:04,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:05,598 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:19:07,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:07,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:07,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:07,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:07,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:07,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:07,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:07,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:07,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:07,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:07,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:07,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:07,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:07,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:07,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:07,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:07,598 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:19:08,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:08,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:08,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:08,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:08,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:08,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:08,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:08,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:08,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:08,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:08,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:08,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:08,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:08,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:08,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:08,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:08,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:08,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:08,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:08,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:08,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:08,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:08,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:08,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:08,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:08,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:08,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:08,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:08,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:08,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:08,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:08,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:09,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:09,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:09,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:09,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:09,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:09,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:09,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:09,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:09,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:09,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:09,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:09,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:09,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:09,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:09,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:09,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:09,599 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:19:10,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:19:10,704 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:19:10,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:10,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:10,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:10,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:10,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:10,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:10,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:10,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:10,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:10,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:10,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:10,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:10,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:10,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:10,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:10,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:11,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:19:13,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:13,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:19:15,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:15,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:15,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:15,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:15,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:15,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:15,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:15,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:15,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:15,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:15,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:15,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:15,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:15,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:15,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:15,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:15,601 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:19:17,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:19:18,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:18,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:18,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:18,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:18,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:18,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:18,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:18,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:18,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:18,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:18,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:18,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:18,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:18,816 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 22:19:19,044 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 22:19:19,110 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 22:19:19,603 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 22:19:19,603 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:19:21,217 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:19:21,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:19:26,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:19:26,010 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:19:29,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:29,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:29,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:29,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:29,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:29,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:29,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:29,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:29,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:29,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:29,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:29,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:29,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:29,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:29,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:29,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:29,607 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:19:35,609 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:19:38,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:38,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:38,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:38,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:38,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:38,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:38,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:38,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:38,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:38,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:38,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:38,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:38,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:38,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:38,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:38,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:39,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:19:41,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:19:41,527 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:19:43,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:19:44,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:44,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:44,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:44,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:44,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:44,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:44,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:44,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:44,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:44,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:44,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:44,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:44,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:44,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:44,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:44,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:47,614 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:19:48,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:48,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:48,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:48,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:48,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:48,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:48,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:48,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:48,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:48,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:48,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:48,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:48,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:48,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:48,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:48,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:51,289 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:19:51,615 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:19:52,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:52,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:52,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:52,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:52,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:52,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:52,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:52,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:52,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:52,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:52,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:52,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:52,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:52,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:52,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:52,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:19:53,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:19:56,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:19:56,802 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:19:57,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:20:01,619 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:20:03,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:20:07,621 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:20:09,622 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:20:12,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:20:12,056 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:20:13,624 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:20:13,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:13,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:13,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:13,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:13,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:13,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:13,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:13,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:13,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:13,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:13,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:13,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:13,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:13,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:13,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:13,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:15,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:20:19,626 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:20:21,363 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:20:21,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:20:23,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:23,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:23,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:23,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:23,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:23,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:23,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:23,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:23,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:23,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:23,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:23,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:23,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:23,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:23,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:23,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:23,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:20:24,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:24,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:24,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:24,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:24,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:24,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:24,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:24,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:24,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:24,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:24,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:24,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:24,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:24,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:24,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:24,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:25,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:20:27,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:20:27,274 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:20:29,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:20:31,631 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:20:33,631 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:20:35,632 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:20:37,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:20:39,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:20:41,634 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:20:42,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:20:42,604 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:20:45,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:45,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:45,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:45,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:45,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:45,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:45,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:45,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:45,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:45,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:45,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:45,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:45,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:45,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:45,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:45,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:45,636 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:20:48,637 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:20:49,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:49,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:49,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:49,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:49,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:49,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:49,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:49,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:49,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:49,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:49,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:49,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:49,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:49,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:49,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:49,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:50,638 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:20:51,435 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:20:52,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,638 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:20:52,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:52,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:54,639 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:20:56,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:56,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:56,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:56,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:56,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:56,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:56,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:56,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:56,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:56,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:56,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:56,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:56,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:56,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:56,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:56,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:56,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:56,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:56,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:56,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:56,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:56,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:56,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:56,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:56,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:56,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:56,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:56,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:56,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:56,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:56,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:56,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:56,640 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:20:57,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:57,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:57,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:57,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:57,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:57,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:57,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:57,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:57,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:57,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:57,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:57,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:57,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:57,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:57,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:57,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:57,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:20:57,865 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:20:58,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:58,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:58,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:58,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:58,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:58,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:58,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:58,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:58,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:58,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:58,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:58,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:58,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:58,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:58,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:58,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:58,641 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:20:59,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:59,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:59,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:59,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:59,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:59,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:59,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:59,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:59,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:59,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:59,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:59,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:59,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:59,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:59,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:20:59,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:00,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:21:00,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:00,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:00,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:00,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:00,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:00,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:00,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:00,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:00,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:00,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:00,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:00,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:00,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:00,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:00,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:00,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:00,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:00,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:00,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:00,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:00,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:00,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:00,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:00,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:00,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:00,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:00,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:00,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:00,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:00,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:00,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:00,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:01,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:01,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:01,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:01,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:01,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:01,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:01,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:01,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:01,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:01,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:01,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:01,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:01,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:01,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:01,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:01,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:01,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:01,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:01,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:01,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:01,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:01,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:01,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:01,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:01,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:01,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:01,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:01,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:01,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:01,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:01,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:01,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:02,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:02,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:02,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:02,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:02,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:02,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:02,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:02,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:02,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:02,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:02,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:02,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:02,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:02,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:02,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:02,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:02,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:21:03,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:03,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:04,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:04,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:04,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:04,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:04,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:04,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:04,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:04,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:04,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:04,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:04,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:04,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:04,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:04,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:04,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:04,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:04,643 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:21:04,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:04,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:04,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:04,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:04,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:04,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:04,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:04,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:04,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:04,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:04,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:04,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:04,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:04,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:04,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:04,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:06,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:06,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:06,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:06,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:06,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:06,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:06,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:06,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:06,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:06,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:06,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:06,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:06,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:06,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:06,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:06,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:06,644 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:21:06,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:06,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:06,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:06,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:06,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:06,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:06,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:06,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:06,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:06,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:06,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:06,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:06,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:06,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:06,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:06,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:07,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:08,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:08,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:08,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:08,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:08,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:08,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:08,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:08,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:08,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:08,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:08,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:08,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:08,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:08,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:08,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:08,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:08,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:08,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:08,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:08,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:08,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:08,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:08,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:08,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:08,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:08,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:08,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:08,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:08,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:08,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:08,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:08,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:08,645 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:21:09,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:09,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:09,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:09,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:09,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:09,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:09,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:09,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:09,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:09,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:09,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:09,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:09,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:09,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:09,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:09,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:10,646 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:21:11,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:12,646 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:21:13,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:21:13,181 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:21:13,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:13,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:21:14,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:14,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:16,648 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:21:17,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:17,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:17,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:17,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:17,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:17,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:17,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:17,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:17,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:17,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:17,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:17,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:17,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:17,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:17,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:17,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:18,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:18,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:18,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:18,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:18,648 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:21:18,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:18,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:18,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:18,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:18,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:18,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:18,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:18,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:20,649 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:21:21,509 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:21:28,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:21:28,484 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:21:30,652 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:21:36,654 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:21:40,655 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:21:43,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:21:43,746 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:21:44,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:44,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:44,657 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:21:44,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:44,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:44,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:44,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:44,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:44,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:44,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:44,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:44,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:44,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:44,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:44,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:44,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:44,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:48,659 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:21:50,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:50,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:50,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:50,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:50,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:50,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:50,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:50,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:50,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:50,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:50,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:50,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:50,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:50,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:50,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:50,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:51,579 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:21:52,660 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:21:53,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:53,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:53,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:53,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:53,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:53,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:53,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:53,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:53,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:53,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:53,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:53,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:53,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:53,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:53,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:53,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:54,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:54,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:54,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:54,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:54,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:54,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:54,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:54,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:54,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:54,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:54,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:54,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:54,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:54,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:54,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:54,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:21:56,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:21:58,663 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:21:58,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:21:58,983 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:22:02,664 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:22:05,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:05,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:05,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:05,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:05,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:05,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:05,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:05,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:05,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:05,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:05,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:05,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:05,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:05,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:05,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:05,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:06,666 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:22:08,667 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:22:12,668 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:22:14,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:22:14,320 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:22:14,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:22:18,671 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:22:20,672 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:22:21,654 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:22:22,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:22:22,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:22,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:22,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:22,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:22,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:22,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:22,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:22,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:22,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:22,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:22,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:22,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:22,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:22,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:22,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:22,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:26,674 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:22:28,675 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:22:29,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:29,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:29,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:29,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:29,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:29,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:29,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:29,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:29,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:29,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:29,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:29,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:29,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:29,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:29,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:29,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:29,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:22:29,546 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:22:30,676 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:22:31,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:31,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:31,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:31,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:31,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:31,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:31,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:31,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:31,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:31,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:31,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:31,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:31,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:31,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:31,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:31,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:34,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:22:36,678 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:22:38,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:22:41,680 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:22:43,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:22:44,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:22:44,772 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:22:45,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:22:47,682 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:22:49,683 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:22:51,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:22:51,730 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:22:51,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:51,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:51,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:51,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:51,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:51,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:51,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:51,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:51,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:51,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:51,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:51,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:51,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:51,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:51,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:51,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:53,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:22:54,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:54,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:54,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:54,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:54,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:54,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:54,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:54,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:54,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:54,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:54,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:54,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:54,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:54,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:54,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:54,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:55,685 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:22:57,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:22:58,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:58,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:58,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:58,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:58,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:58,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:58,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:58,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:58,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:58,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:58,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:58,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:58,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:58,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:58,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:58,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:58,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:58,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:58,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:58,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:58,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:58,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:58,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:58,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:58,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:58,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:58,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:58,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:58,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:58,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:58,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:58,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:22:59,687 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:22:59,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:22:59,997 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:23:00,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:00,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:01,687 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:23:02,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:02,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:02,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:02,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:02,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:02,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:02,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:02,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:02,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:02,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:02,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:02,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:02,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:02,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:02,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:02,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:03,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:03,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:03,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:03,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:03,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:03,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:03,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:03,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:03,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:03,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:03,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:03,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:03,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:03,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:03,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:03,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:03,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:03,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:03,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:03,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:03,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:03,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:03,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:03,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:03,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:03,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:03,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:03,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:03,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:03,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:03,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:03,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:03,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:23:04,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:04,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:04,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:04,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:04,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:04,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:04,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:04,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:04,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:04,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:04,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:04,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:04,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:04,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:04,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:04,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:05,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:05,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:05,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:05,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:05,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:05,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:05,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:05,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:05,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:05,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:05,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:05,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:05,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:05,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:05,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:05,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:05,689 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:23:06,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:06,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:06,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:06,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:06,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:06,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:06,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:06,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:06,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:06,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:06,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:06,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:06,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:06,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:06,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:06,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:06,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:06,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:06,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:06,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:06,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:06,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:06,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:06,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:06,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:06,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:06,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:06,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:06,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:06,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:06,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:06,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:07,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:07,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:07,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:07,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:07,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:07,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:07,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:07,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:07,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:07,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:07,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:07,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:07,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:07,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:07,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:07,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:07,689 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:23:08,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:08,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:08,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:08,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:08,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:08,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:08,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:08,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:08,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:08,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:08,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:08,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:08,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:08,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:08,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:08,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:08,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:08,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:08,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:08,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:08,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:08,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:08,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:08,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:08,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:08,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:08,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:08,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:08,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:08,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:08,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:08,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:09,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:09,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:09,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:09,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:09,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:09,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:09,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:09,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:09,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:09,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:09,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:09,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:09,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:09,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:09,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:09,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:09,690 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:23:10,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:10,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:23:11,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:11,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:12,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:13,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:13,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:13,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:13,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:13,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:13,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:13,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:13,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:13,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:13,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:13,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:13,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:13,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:13,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:13,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:13,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:13,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:13,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:13,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:13,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:13,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:13,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:13,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:13,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:13,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:13,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:13,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:13,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:13,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:13,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:13,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:13,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:13,692 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:23:15,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:23:15,260 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:23:15,692 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:23:16,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:16,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:17,693 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:23:18,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:18,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:18,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:18,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:18,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:18,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:18,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:18,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:18,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:18,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:18,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:18,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:18,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:18,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:18,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:18,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:18,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:18,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:18,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:18,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:18,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:18,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:18,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:18,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:18,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:18,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:18,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:18,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:18,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:18,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:18,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:18,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:19,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:19,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:19,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:19,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:19,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:19,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:19,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:19,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:19,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:19,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:19,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:19,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:19,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:19,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:19,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:19,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:19,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:23:20,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:20,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:20,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:20,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:20,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:20,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:20,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:20,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:20,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:20,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:20,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:20,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:21,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:21,207 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 22:23:21,423 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 22:23:21,516 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 22:23:21,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 22:23:21,695 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:23:21,821 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:23:22,695 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:23:23,695 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:23:27,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:27,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:27,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:27,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:27,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:27,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:27,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:27,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:27,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:27,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:27,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:27,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:27,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:27,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:27,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:27,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:30,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:23:30,492 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:23:33,699 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:23:39,701 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:23:43,703 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:23:45,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:23:45,720 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:23:47,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:23:51,706 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:23:51,890 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:23:55,708 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:23:59,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:59,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:59,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:59,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:59,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:59,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:59,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:59,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:59,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:59,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:59,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:59,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:59,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:59,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:59,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:59,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:23:59,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:24:01,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:24:01,332 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:24:03,711 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:24:04,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:04,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:04,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:04,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:04,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:04,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:04,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:04,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:04,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:04,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:04,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:04,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:04,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:04,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:04,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:04,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:06,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:06,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:06,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:06,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:06,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:06,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:06,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:06,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:06,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:06,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:06,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:06,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:06,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:06,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:06,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:06,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:07,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:24:09,713 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:24:09,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:09,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:09,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:09,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:09,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:09,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:09,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:09,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:09,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:09,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:09,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:09,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:09,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:09,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:09,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:09,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:13,715 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:24:15,716 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:24:16,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:24:16,659 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:24:19,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:19,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:19,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:19,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:19,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:19,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:19,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:19,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:19,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:19,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:19,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:19,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:19,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:19,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:19,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:19,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:19,717 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:24:21,718 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:24:21,962 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:24:25,719 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:24:27,720 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:24:29,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:24:31,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:31,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:31,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:31,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:31,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:31,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:31,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:31,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:31,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:31,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:31,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:31,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:31,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:31,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:31,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:31,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:31,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:24:31,989 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:24:33,722 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:24:35,723 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:24:37,724 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:24:37,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:37,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:37,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:37,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:37,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:37,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:37,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:37,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:37,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:37,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:37,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:37,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:37,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:37,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:37,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:37,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:41,726 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:24:42,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:42,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:42,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:42,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:42,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:42,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:42,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:42,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:42,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:42,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:42,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:42,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:42,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:42,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:42,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:42,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:43,727 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:24:45,727 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:24:47,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:24:47,258 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:24:47,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:24:50,729 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:24:52,034 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:24:52,730 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:24:54,731 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:24:56,732 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:24:58,733 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:24:59,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:59,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:59,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:59,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:59,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:59,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:59,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:59,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:59,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:59,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:59,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:59,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:59,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:59,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:59,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:24:59,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:00,734 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:25:02,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:25:02,543 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:25:02,735 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:25:03,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:03,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:03,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:03,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:03,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:03,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:03,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:03,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:03,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:03,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:03,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:03,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:03,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:03,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:03,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:03,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:04,736 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:25:06,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:06,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:06,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:06,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:06,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:06,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:06,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:06,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:06,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:06,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:06,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:06,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:06,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:06,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:06,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:06,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:06,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:06,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:06,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:06,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:06,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:06,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:06,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:06,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:06,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:06,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:06,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:06,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:06,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:06,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:06,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:06,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:06,736 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:25:08,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:08,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:08,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:08,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:08,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:08,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:08,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:08,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:08,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:08,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:08,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:08,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:08,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:08,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:08,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:08,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:08,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:08,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:08,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:08,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:08,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:08,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:08,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:08,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:08,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:08,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:08,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:08,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:08,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:08,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:08,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:08,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:08,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:25:09,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:09,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:09,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:09,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:09,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:09,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:09,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:09,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:09,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:09,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:09,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:09,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:09,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:09,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:09,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:09,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:09,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:09,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:09,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:09,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:09,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:09,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:09,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:09,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:09,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:09,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:09,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:09,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:09,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:09,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:09,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:09,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:10,738 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:25:10,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:10,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:10,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:10,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:10,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:10,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:10,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:10,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:10,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:10,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:10,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:10,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:10,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:10,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:10,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:10,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:10,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:10,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:10,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:10,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:10,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:10,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:10,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:10,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:10,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:10,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:10,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:10,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:10,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:10,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:10,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:10,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:11,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:11,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:11,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:11,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:11,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:11,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:11,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:11,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:11,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:11,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:11,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:11,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:11,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:11,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:11,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:11,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:12,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:12,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:12,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:12,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:12,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:12,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:12,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:12,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:12,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:12,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:12,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:12,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:12,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:12,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:12,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:12,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:12,740 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:25:13,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:13,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:14,741 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:25:14,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:14,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:14,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:14,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:14,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:14,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:14,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:14,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:14,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:14,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:14,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:14,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:14,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:14,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:14,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:14,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:16,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:16,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:16,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:16,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:16,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:16,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:16,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:16,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:16,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:16,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:16,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:16,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:16,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:16,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:16,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:16,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:16,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:16,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:16,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:16,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:16,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:16,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:16,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:16,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:16,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:16,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:16,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:16,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:16,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:16,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:16,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:16,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:16,742 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:25:17,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:17,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:17,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:17,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:17,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:17,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:17,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:17,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:17,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:17,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:17,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:17,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:17,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:17,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:17,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:17,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:17,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:17,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:17,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:17,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:17,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:17,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:17,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:17,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:17,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:17,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:17,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:17,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:17,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:17,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:17,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:17,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:17,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:25:17,846 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:25:18,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,742 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:25:18,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:18,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:19,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:19,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:19,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:19,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:19,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:19,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:19,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:19,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:19,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:19,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:19,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:19,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:19,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:19,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:19,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:19,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:19,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:19,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:19,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:19,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:19,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:19,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:19,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:19,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:19,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:19,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:19,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:19,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:19,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:19,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:19,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:19,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:20,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:25:22,100 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:25:22,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:22,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:22,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:22,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:22,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:22,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:22,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:22,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:22,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:22,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:22,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:22,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:22,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:22,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:22,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:22,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:22,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:22,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:22,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:22,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:22,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:22,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:22,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:22,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:22,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:22,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:22,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:22,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:22,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:22,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:22,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:22,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:22,744 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:25:23,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:23,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:24,745 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:25:25,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:25,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:25,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:25,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:25,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:25,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:25,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:25,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:25,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:25,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:25,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:25,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:25,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:25,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:25,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:25,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:25,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:25,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:25,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:25,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:25,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:25,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:25,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:25,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:25,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:25,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:25,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:25,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:26,746 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:25:33,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:25:33,157 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:25:38,749 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:25:42,751 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:25:46,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:46,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:46,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:46,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:46,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:46,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:46,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:46,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:46,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:46,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:46,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:46,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:46,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:46,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:46,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:46,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:25:48,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:25:48,433 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:25:48,752 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:25:52,167 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:25:52,754 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:25:56,755 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:25:59,757 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:26:03,758 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:26:03,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:26:03,931 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:26:07,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:26:11,761 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:26:13,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:13,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:13,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:13,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:13,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:13,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:13,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:13,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:13,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:13,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:13,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:13,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:13,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:13,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:13,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:13,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:13,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:26:14,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:14,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:14,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:14,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:14,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:14,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:14,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:14,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:14,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:14,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:14,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:14,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:14,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:14,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:14,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:14,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:16,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:16,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:16,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:16,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:16,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:16,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:16,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:16,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:16,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:16,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:16,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:16,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:16,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:16,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:16,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:16,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:17,764 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:26:19,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:26:19,233 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:26:19,765 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:26:20,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:20,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:20,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:20,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:20,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:20,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:20,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:20,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:20,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:20,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:20,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:20,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:20,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:20,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:20,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:20,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:22,234 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:26:23,766 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:26:24,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:24,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:24,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:24,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:24,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:24,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:24,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:24,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:24,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:24,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:24,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:24,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:24,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:24,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:24,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:24,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:25,767 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:26:27,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:26:31,769 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:26:33,770 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:26:34,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:26:34,698 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:26:35,771 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:26:37,772 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:26:38,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:38,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:38,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:38,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:38,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:38,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:38,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:38,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:38,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:38,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:38,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:38,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:38,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:38,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:38,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:38,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:41,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:26:43,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:43,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:43,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:43,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:43,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:43,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:43,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:43,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:43,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:43,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:43,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:43,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:43,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:43,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:43,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:43,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:43,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:26:45,775 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:26:47,775 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:26:48,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:48,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:48,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:48,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:48,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:48,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:48,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:48,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:48,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:48,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:48,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:48,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:48,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:48,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:48,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:48,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:26:49,777 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:26:49,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:26:49,998 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:26:51,777 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:26:52,310 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:26:53,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:26:55,779 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:26:59,780 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:27:01,781 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:27:03,782 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:27:04,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:04,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:04,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:04,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:04,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:04,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:04,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:04,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:04,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:04,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:04,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:04,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:04,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:04,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:04,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:04,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:05,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:27:05,255 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:27:05,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:27:07,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:27:09,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:09,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:09,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:09,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:09,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:09,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:09,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:09,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:09,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:09,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:09,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:09,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:09,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:09,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:09,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:09,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:09,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:09,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:09,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:09,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:09,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:09,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:09,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:09,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:09,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:09,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:09,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:09,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:09,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:09,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:09,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:09,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:09,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:27:11,785 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:27:12,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:12,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:12,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:12,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:12,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:12,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:12,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:12,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:12,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:12,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:12,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:12,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:12,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:12,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:12,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:12,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:12,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:12,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:12,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:12,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:12,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:12,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:12,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:12,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:12,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:12,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:12,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:12,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:12,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:12,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:12,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:12,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:13,786 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:27:14,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:14,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:14,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:14,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:14,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:14,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:14,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:14,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:14,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:14,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:14,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:14,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:14,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:14,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:14,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:14,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:15,787 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:27:16,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:16,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:17,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:17,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:17,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:17,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:17,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:17,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:17,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:17,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:17,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:17,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:17,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:17,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:17,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:17,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:17,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:17,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:17,788 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:27:18,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:18,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:19,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:19,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:19,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:19,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:19,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:19,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:19,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:19,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:19,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:19,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:19,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:19,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:19,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:19,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:19,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:19,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:19,789 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:27:20,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:27:20,491 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:27:21,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:21,790 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:27:22,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:22,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:22,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:22,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:22,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:22,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:22,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:22,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:22,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:22,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:22,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:22,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:22,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:22,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:22,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:22,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:22,385 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:27:22,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:22,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:22,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:22,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:22,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:22,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:22,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:22,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:22,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:22,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:22,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:22,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:22,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:22,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:22,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:22,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:23,791 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:27:24,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:24,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:25,792 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:27:26,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:26,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,793 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:27:27,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:27,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:28,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:28,103 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 22:27:28,335 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 22:27:28,400 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 22:27:28,793 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 22:27:29,794 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:27:35,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:27:35,722 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:27:37,797 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:27:41,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:41,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:41,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:41,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:41,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:41,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:41,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:41,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:41,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:41,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:41,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:41,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:41,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:41,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:41,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:41,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:43,799 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:27:44,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:44,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:44,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:44,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:44,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:44,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:44,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:44,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:44,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:44,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:44,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:44,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:44,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:44,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:44,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:44,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:47,801 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:27:50,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:27:50,949 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:27:52,481 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:27:52,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:27:55,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:55,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:55,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:55,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:55,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:55,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:55,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:55,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:55,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:55,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:55,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:55,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:55,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:55,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:55,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:55,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:27:56,805 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:28:00,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:28:04,808 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:28:06,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:28:06,182 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:28:08,810 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:28:12,811 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:28:14,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:28:18,813 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:28:20,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:20,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:20,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:20,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:20,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:20,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:20,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:20,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:20,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:20,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:20,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:20,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:20,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:20,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:20,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:20,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:20,814 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:28:21,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:28:21,495 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:28:22,558 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:28:24,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:28:25,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:25,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:25,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:25,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:25,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:25,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:25,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:25,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:25,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:25,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:25,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:25,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:25,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:25,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:25,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:25,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:25,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:25,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:25,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:25,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:25,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:25,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:25,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:25,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:25,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:25,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:25,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:25,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:25,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:25,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:25,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:25,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:26,816 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:28:28,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:28,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:28,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:28,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:28,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:28,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:28,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:28,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:28,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:28,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:28,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:28,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:28,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:28,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:28,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:28,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:30,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:28:32,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:32,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:32,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:32,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:32,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:32,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:32,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:32,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:32,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:32,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:32,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:32,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:32,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:32,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:32,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:32,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:32,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:28:36,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:28:36,722 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:28:36,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:28:38,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:28:40,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:28:42,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:28:45,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:45,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:45,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:45,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:45,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:45,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:45,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:45,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:45,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:45,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:45,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:45,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:45,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:45,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:45,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:45,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:46,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:28:48,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:28:50,826 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:28:51,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:28:51,951 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:28:52,634 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:28:52,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:52,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:52,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:52,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:52,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:52,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:52,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:52,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:52,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:52,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:52,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:52,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:52,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:52,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:52,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:52,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:52,826 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:28:52,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:52,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:52,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:52,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:52,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:52,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:52,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:52,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:52,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:52,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:52,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:52,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:52,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:52,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:52,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:52,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:28:54,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:28:56,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:29:01,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:29:03,831 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:29:05,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:29:07,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:29:07,286 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:29:07,833 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:29:09,834 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:29:11,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:29:13,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:29:14,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:14,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:14,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:14,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:14,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:14,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:14,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:14,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:14,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:14,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:14,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:14,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:14,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:14,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:14,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:14,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:15,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:29:17,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:29:19,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:19,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:19,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:19,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:19,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:19,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:19,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:19,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:19,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:19,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:19,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:19,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:19,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:19,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:19,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:19,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:19,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:29:20,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:20,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:20,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:20,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:20,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:20,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:20,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:20,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:20,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:20,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:20,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:20,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:20,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:20,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:20,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:20,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:20,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:20,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:20,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:20,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:20,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:20,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:20,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:20,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:20,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:20,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:20,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:20,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:20,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:20,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:20,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:20,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:21,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:29:22,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:22,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:22,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:22,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:22,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:22,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:22,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:22,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:22,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:22,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:22,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:22,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:22,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:22,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:22,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:22,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:22,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:29:22,519 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:29:22,776 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:29:23,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:23,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:29:24,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:24,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:24,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:24,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:24,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:24,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:24,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:24,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:24,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:24,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:24,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:24,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:24,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:24,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:24,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:24,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:24,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:24,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:24,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:24,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:24,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:24,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:24,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:24,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:24,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:24,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:24,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:24,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:24,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:24,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:24,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:24,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:25,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:25,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:25,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:25,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:25,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:25,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:25,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:25,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:25,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:25,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:25,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:25,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:25,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:25,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:25,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:25,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:25,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:25,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:25,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:25,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:25,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:25,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:25,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:25,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:25,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:25,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:25,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:25,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:25,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:25,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:25,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:25,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:25,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:29:27,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:27,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:27,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:27,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:27,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:27,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:27,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:27,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:27,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:27,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:27,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:27,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:27,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:27,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:27,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:27,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:27,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:29:28,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:28,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:28,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:28,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:28,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:28,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:28,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:28,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:28,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:28,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:28,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:28,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:28,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:28,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:28,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:28,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:28,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:28,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:28,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:28,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:28,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:28,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:28,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:28,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:28,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:28,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:28,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:28,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:28,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:28,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:28,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:28,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:29,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:29,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:29,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:29,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:29,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:29,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:29,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:29,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:29,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:29,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:29,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:29,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:29,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:29,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:29,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:29,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:29,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:29,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:29,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:29,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:29,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:29,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:29,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:29,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:29,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:29,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:29,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:29,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:29,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:29,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:29,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:29,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:29,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:29:30,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:30,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:30,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:30,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:30,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:30,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:30,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:30,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:30,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:30,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:30,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:30,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:30,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:30,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:30,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:30,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:30,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:30,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:30,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:30,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:30,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:30,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:30,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:30,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:30,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:30,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:30,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:30,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:30,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:30,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:30,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:30,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:31,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:29:32,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:32,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:33,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:29:37,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:29:37,837 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:29:38,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:38,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:38,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:38,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:38,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:38,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:38,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:38,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:38,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:38,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:38,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:38,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:38,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:38,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:38,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:38,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:39,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:39,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:39,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:39,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:39,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:39,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:39,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:39,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:39,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:39,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:39,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:39,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:39,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:39,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:39,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:39,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:41,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:41,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:41,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:41,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:41,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:41,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:41,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:41,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:41,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:41,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:41,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:41,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:41,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:41,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:41,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:41,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:42,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:42,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:42,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:42,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:42,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:42,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:42,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:42,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:42,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:42,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:42,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:42,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:42,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:42,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:42,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:42,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:42,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:42,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:42,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:42,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:42,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:42,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:42,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:42,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:42,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:42,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:42,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:42,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:42,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:42,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:42,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:42,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:45,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:29:49,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:29:50,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:50,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:50,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:50,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:50,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:50,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:50,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:50,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:50,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:50,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:50,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:50,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:50,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:50,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:50,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:50,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:52,781 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:29:53,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:53,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:53,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:53,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:53,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:53,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:53,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:53,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:53,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:29:53,071 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:29:53,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:53,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:53,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:53,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:53,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:53,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:53,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:53,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:55,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:55,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:55,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:55,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:55,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:55,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:55,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:55,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:55,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:55,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:55,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:55,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:55,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:55,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:55,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:55,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:55,854 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:29:57,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:57,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:57,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:57,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:57,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:57,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:57,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:57,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:57,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:57,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:57,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:57,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:57,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:57,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:57,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:57,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:29:59,856 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:30:01,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:30:02,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:02,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:02,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:02,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:02,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:02,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:02,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:02,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:02,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:02,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:02,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:02,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:02,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:02,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:02,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:02,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:02,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:02,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:02,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:02,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:02,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:02,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:02,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:02,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:02,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:02,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:02,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:02,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:02,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:02,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:02,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:02,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:06,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:30:07,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:07,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:07,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:07,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:07,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:07,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:07,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:07,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:07,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:07,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:07,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:07,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:07,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:07,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:07,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:07,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:08,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:30:08,295 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:30:10,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:30:14,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:30:18,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:30:20,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:30:22,858 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:30:23,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:30:23,524 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:30:24,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:30:26,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:30:28,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:28,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:28,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:28,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:28,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:28,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:28,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:28,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:28,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:28,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:28,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:28,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:28,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:28,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:28,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:28,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:30,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:30:32,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:30:34,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:30:36,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:36,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:36,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:36,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:36,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:36,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:36,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:36,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:36,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:36,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:36,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:36,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:36,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:36,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:36,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:36,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:37,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:37,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:37,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:37,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:37,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:37,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:37,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:37,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:37,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:37,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:37,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:37,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:37,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:37,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:37,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:37,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:38,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:38,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:38,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:38,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:38,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:38,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:38,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:38,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:38,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:38,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:38,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:38,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:38,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:38,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:38,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:38,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:38,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:30:38,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:30:38,890 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:30:40,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:30:41,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:41,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:41,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:41,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:41,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:41,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:41,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:41,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:41,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:41,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:41,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:41,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:41,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:41,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:41,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:41,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:42,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:30:44,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:30:48,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:30:50,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:30:52,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:30:52,932 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:30:54,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:30:54,206 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:30:54,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:30:56,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:56,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:56,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:56,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:56,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:56,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:56,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:56,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:56,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:56,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:56,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:56,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:56,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:56,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:56,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:56,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:56,882 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:30:58,883 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:30:59,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:59,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:59,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:59,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:59,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:59,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:59,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:59,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:59,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:59,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:59,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:59,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:59,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:59,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:59,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:30:59,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:00,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:00,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:00,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:00,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:00,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:00,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:00,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:00,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:00,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:00,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:00,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:00,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:00,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:00,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:00,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:00,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:00,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:31:02,885 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:31:04,885 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:31:06,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:31:08,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:31:09,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:31:09,557 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:31:10,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:31:12,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:31:14,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:31:16,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:31:18,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:31:20,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:20,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:20,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:20,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:20,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:20,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:20,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:20,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:20,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:31:20,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:20,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:20,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:20,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:20,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:20,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:20,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:20,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:22,894 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:31:23,006 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:31:23,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:23,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:23,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:23,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:23,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:23,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:23,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:23,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:23,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:23,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:23,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:23,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:23,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:23,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:23,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:23,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:24,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:31:24,815 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:31:24,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:31:25,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:25,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:26,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:26,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:26,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:26,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:26,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:26,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:26,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:26,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:26,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:26,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:26,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:26,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:26,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:26,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:26,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:26,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:26,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:26,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:26,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:26,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:26,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:26,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:26,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:26,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:26,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:26,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:26,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:26,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:26,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:26,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:26,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:26,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:26,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:31:27,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:27,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:28,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:31:29,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:29,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:29,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:29,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:29,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:29,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:29,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:29,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:29,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:29,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:29,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:29,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:29,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:29,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:29,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:29,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:30,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:31:31,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:31,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:31,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:31,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:31,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:31,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:31,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:31,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:31,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:31,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:31,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:31,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:31,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:31,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:31,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:31,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:31,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:31,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:31,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:31,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:31,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:31,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:31,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:31,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:31,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:31,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:31,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:31,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:31,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:31,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:31,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:31,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:32,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:32,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:32,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:32,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:32,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:32,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:32,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:32,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:32,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:32,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:32,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:32,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:32,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:32,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:32,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:32,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:32,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:32,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:32,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:32,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:32,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:32,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:32,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:32,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:32,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:32,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:32,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:32,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:32,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:32,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:32,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:32,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:32,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:31:33,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:33,787 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 22:31:34,021 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 22:31:34,088 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 22:31:35,007 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 22:31:35,007 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:31:37,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:37,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:37,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:37,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:37,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:37,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:37,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:37,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:37,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:37,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:37,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:37,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:37,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:37,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:37,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:37,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:40,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:31:40,077 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:31:40,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:40,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:40,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:40,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:40,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:40,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:40,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:40,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:41,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:41,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:41,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:41,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:41,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:41,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:41,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:41,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:43,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:43,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:43,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:43,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:43,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:43,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:43,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:43,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:43,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:43,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:43,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:43,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:43,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:43,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:43,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:43,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:45,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:31:45,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:45,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:45,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:45,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:45,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:45,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:45,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:45,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:45,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:45,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:45,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:45,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:45,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:45,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:45,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:45,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:46,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:46,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:46,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:46,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:46,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:46,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:46,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:46,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:46,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:46,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:46,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:46,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:46,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:46,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:46,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:46,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:48,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:48,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:48,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:48,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:48,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:48,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:48,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:48,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:48,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:48,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:48,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:48,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:48,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:48,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:48,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:48,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:48,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:48,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:48,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:48,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:48,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:48,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:48,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:48,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:48,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:48,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:48,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:48,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:48,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:48,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:48,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:48,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:49,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:49,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:49,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:49,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:49,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:49,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:49,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:49,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:49,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:49,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:49,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:49,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:49,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:49,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:49,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:49,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:50,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:50,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:50,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:50,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:50,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:50,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:50,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:50,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:50,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:50,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:50,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:50,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:50,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:50,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:50,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:50,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:51,012 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:31:53,135 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:31:53,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:53,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:53,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:53,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:53,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:53,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:53,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:53,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:53,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:53,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:53,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:53,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:53,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:53,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:53,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:53,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:53,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:53,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:53,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:53,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:53,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:53,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:53,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:53,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:53,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:53,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:53,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:53,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:53,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:53,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:53,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:53,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:55,014 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:31:55,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:31:55,312 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:31:55,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:55,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:55,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:55,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:55,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:55,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:55,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:55,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:55,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:55,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:55,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:55,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:55,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:55,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:55,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:55,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:59,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:31:59,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:59,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:59,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:59,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:59,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:59,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:59,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:59,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:59,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:59,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:59,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:59,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:59,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:59,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:59,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:31:59,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:01,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:01,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:01,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:01,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:01,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:01,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:01,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:01,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:01,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:01,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:01,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:01,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:01,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:01,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:01,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:01,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:01,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:01,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:01,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:01,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:01,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:01,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:01,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:01,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:01,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:01,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:01,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:01,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:01,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:01,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:01,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:01,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:03,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:32:05,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:05,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:05,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:05,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:05,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:05,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:05,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:05,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:05,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:05,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:05,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:05,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:05,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:05,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:05,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:05,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:07,019 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:32:07,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:07,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:07,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:07,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:07,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:07,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:07,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:07,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:07,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:07,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:07,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:07,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:07,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:07,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:07,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:07,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:10,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:32:10,537 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:32:10,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:10,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:10,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:10,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:10,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:10,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:10,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:10,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:10,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:10,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:10,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:10,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:10,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:10,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:10,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:10,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:11,021 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:32:14,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:32:15,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:15,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:15,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:15,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:15,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:15,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:15,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:15,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:15,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:15,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:15,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:15,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:15,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:15,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:15,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:15,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:17,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:17,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:17,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:17,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:17,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:17,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:17,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:17,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:17,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:17,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:17,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:17,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:17,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:17,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:17,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:17,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:18,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:32:22,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:32:23,211 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:32:24,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:32:25,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:32:25,765 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:32:28,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:32:30,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:32:32,031 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:32:32,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:32,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:32,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:32,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:32,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:32,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:32,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:32,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:32,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:32,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:32,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:32,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:32,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:32,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:32,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:32,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:36,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:32:38,034 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:32:40,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:32:40,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:40,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:40,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:40,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:40,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:40,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:40,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:40,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:40,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:40,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:40,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:40,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:40,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:40,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:40,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:40,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:40,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:32:40,990 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:32:44,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:32:44,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:44,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:44,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:44,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:44,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:44,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:44,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:44,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:44,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:44,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:44,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:44,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:44,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:44,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:44,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:44,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:45,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:45,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:45,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:45,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:45,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:45,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:45,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:45,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:45,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:45,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:45,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:45,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:45,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:45,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:45,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:45,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:46,038 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:32:46,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:46,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:46,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:46,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:46,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:46,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:46,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:46,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:46,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:46,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:46,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:46,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:46,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:46,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:46,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:46,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:32:48,039 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:32:50,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:32:52,041 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:32:53,283 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:32:54,041 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:32:56,042 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:32:56,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:32:56,317 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:32:58,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:33:00,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:33:01,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:01,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:01,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:01,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:01,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:01,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:01,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:01,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:01,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:01,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:01,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:01,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:01,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:01,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:01,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:01,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:02,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:33:03,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:03,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:03,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:03,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:03,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:03,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:03,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:03,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:03,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:03,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:03,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:03,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:03,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:03,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:03,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:03,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:04,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:33:05,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:05,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:05,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:05,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:05,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:05,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:05,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:05,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:05,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:05,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:05,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:05,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:05,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:05,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:05,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:05,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:06,047 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:33:08,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:33:10,049 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:33:11,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:33:11,589 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:33:12,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:33:14,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:33:16,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:33:18,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:33:20,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:33:21,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:21,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:21,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:21,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:21,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:21,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:21,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:21,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:21,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:21,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:21,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:21,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:21,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:21,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:21,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:21,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:22,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:33:23,361 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:33:24,056 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:33:24,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:24,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:24,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:24,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:24,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:24,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:24,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:24,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:24,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:24,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:24,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:24,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:24,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:24,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:24,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:24,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:25,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:26,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:33:26,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:26,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:26,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:26,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:26,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:26,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:26,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:26,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:26,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:26,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:26,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:26,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:26,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:26,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:26,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:26,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:26,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:33:26,886 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:33:27,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:27,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:28,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:33:28,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:28,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:28,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:28,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:28,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:28,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:28,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:28,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:28,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:28,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:28,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:28,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:28,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:28,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:28,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:28,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:29,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:29,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:29,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:29,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:29,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:29,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:29,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:29,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:29,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:29,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:29,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:29,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:29,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:29,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:29,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:29,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:30,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:33:30,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:30,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:30,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:30,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:30,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:30,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:30,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:30,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:30,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:30,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:30,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:30,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:30,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:30,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:30,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:30,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:30,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:30,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:30,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:30,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:30,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:30,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:30,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:30,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:30,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:30,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:30,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:30,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:30,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:30,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:30,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:30,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:31,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:31,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:31,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:31,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:31,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:31,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:31,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:31,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:31,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:31,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:31,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:31,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:31,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:31,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:31,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:31,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:31,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:31,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:31,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:31,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:31,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:31,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:31,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:31,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:31,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:31,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:31,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:31,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:32,059 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:33:34,060 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:33:36,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:36,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:36,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:36,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:36,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:36,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:36,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:36,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:36,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:36,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:36,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:36,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:36,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:36,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:36,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:36,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:42,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:33:42,106 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:33:42,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:42,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:42,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:42,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:42,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:42,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:42,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:42,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:42,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:42,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:42,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:42,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:42,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:42,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:42,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:42,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:44,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:33:45,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:45,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:45,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:45,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:45,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:45,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:45,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:45,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:45,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:45,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:45,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:45,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:45,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:45,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:45,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:45,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:47,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:47,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:47,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:47,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:47,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:47,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:47,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:47,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:47,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:47,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:47,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:47,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:47,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:47,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:47,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:47,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:47,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:47,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:47,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:47,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:47,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:47,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:47,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:47,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:47,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:47,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:47,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:47,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:47,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:47,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:47,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:47,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:49,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:49,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:50,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:50,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:50,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:50,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:50,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:50,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:50,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:50,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:50,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:50,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:50,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:50,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:50,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:50,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:50,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:33:50,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:50,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:50,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:50,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:50,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:50,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:50,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:50,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:50,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:50,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:50,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:50,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:50,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:50,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:50,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:50,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:51,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:51,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:51,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:51,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:51,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:51,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:51,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:51,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:51,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:51,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:51,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:51,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:51,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:51,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:51,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:51,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:52,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:52,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:52,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:52,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:52,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:52,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:52,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:52,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:52,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:52,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:52,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:52,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:52,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:52,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:52,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:52,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:53,437 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:33:54,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:33:54,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:54,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:54,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:54,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:54,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:54,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:54,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:54,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:54,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:54,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:54,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:54,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:54,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:54,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:54,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:54,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:54,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:54,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:54,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:54,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:54,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:54,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:54,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:54,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:54,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:54,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:54,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:54,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:54,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:54,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:54,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:54,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:56,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:56,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:56,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:56,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:56,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:56,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:56,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:56,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:56,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:56,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:56,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:56,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:56,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:56,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:56,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:56,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:56,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:56,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:56,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:56,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:56,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:56,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:56,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:56,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:56,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:56,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:56,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:56,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:56,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:56,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:56,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:56,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:33:57,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:33:57,479 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:33:58,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:34:02,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:02,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:02,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:02,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:02,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:02,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:02,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:02,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:02,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:02,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:02,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:02,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:02,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:02,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:02,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:02,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:02,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:02,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:02,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:02,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:02,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:02,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:02,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:02,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:02,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:02,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:02,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:02,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:02,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:02,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:02,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:02,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:02,071 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:34:04,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:04,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:04,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:04,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:04,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:04,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:04,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:04,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:04,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:04,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:04,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:04,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:04,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:04,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:04,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:04,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:05,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:05,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:05,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:05,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:05,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:05,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:05,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:05,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:05,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:05,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:05,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:05,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:05,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:05,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:05,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:06,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:06,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:34:07,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:07,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:08,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:08,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:08,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:08,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:09,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:09,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:09,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:09,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:09,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:09,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:09,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:09,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:09,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:09,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:09,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:09,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:09,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:09,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:09,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:09,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:09,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:09,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:09,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:09,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:09,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:09,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:09,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:09,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:09,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:09,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:09,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:09,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:09,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:09,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:09,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:09,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:10,074 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:34:12,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:34:12,779 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:34:13,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:34:17,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:34:17,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:17,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:17,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:17,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:17,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:17,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:17,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:17,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:17,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:17,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:17,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:17,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:17,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:17,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:17,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:17,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:21,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:34:23,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:34:23,512 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:34:23,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:23,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:23,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:23,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:23,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:23,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:23,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:23,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:23,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:23,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:23,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:23,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:23,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:23,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:23,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:23,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:26,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:26,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:26,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:26,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:26,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:26,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:26,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:26,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:26,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:26,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:26,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:26,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:26,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:26,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:26,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:26,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:27,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:34:28,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:34:28,060 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:34:29,081 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:34:31,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:34:34,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:34,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:34,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:34,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:34,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:34,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:34,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:34,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:34,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:34,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:34,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:34,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:34,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:34,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:34,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:34,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:35,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:34:37,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:34:39,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:34:41,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:34:43,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:34:43,472 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:34:44,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:44,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:44,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:44,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:44,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:44,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:44,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:44,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:44,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:44,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:44,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:44,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:44,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:44,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:44,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:44,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:45,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:34:47,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:34:49,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:34:50,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:50,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:50,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:50,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:50,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:50,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:50,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:50,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:50,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:50,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:50,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:50,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:50,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:50,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:50,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:50,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:50,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:50,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:50,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:50,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:50,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:50,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:50,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:50,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:50,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:50,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:50,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:50,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:50,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:50,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:50,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:50,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:51,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:34:52,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:52,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:52,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:52,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:52,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:52,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:52,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:52,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:52,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:52,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:52,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:52,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:52,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:52,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:52,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:52,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:34:53,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:34:53,588 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:34:55,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:34:57,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:34:58,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:34:58,813 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:34:59,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:35:01,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:35:03,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:35:03,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:03,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:03,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:03,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:03,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:03,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:03,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:03,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:03,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:03,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:03,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:03,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:03,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:03,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:03,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:03,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:05,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:35:06,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:06,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:06,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:06,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:06,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:06,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:06,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:06,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:06,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:06,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:06,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:06,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:06,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:06,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:06,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:06,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:07,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:35:08,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:08,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:08,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:08,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:08,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:08,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:08,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:08,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:08,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:08,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:08,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:08,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:08,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:08,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:08,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:08,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:09,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:35:11,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:35:13,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:35:14,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:35:14,162 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:35:15,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:35:17,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:35:19,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:35:21,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:35:21,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:21,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:21,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:21,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:21,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:21,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:21,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:21,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:21,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:21,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:21,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:21,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:21,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:21,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:21,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:21,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:23,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:35:23,664 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:35:25,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:35:25,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:25,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:25,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:25,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:25,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:25,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:25,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:25,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:25,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:25,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:25,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:25,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:25,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:25,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:25,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:25,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:26,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:26,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:26,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:26,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:26,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:26,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:26,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:26,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:26,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:26,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:26,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:26,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:26,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:26,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:26,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:26,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:35:27,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:27,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:28,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:28,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:28,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:28,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:28,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:28,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:28,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:28,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:28,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:28,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:28,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:28,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:28,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:28,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:28,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:28,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:28,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:28,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:28,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:28,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:28,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:28,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:28,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:28,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:28,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:28,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:28,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:28,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:28,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:28,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:28,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:28,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:29,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:35:29,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:29,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:29,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:29,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:29,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:29,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:29,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:29,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:29,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:29,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:29,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:29,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:29,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:29,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:29,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:29,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:29,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:35:29,495 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:35:30,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:30,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:30,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:30,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:30,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:30,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:30,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:30,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:30,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:30,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:30,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:30,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:30,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:30,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:30,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:30,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:30,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:30,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:30,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:30,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:30,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:30,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:30,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:30,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:30,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:30,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:30,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:30,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:30,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:30,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:30,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:30,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:31,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:35:31,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:31,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:31,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:31,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:31,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:31,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:31,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:31,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:31,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:31,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:31,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:31,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:31,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:31,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:31,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:31,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:31,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:31,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:31,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:31,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:31,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:31,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:31,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:31,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:31,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:31,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:31,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:31,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:31,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 22:35:31,728 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 22:35:31,953 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 22:35:32,029 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 22:35:32,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 22:35:32,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:35:33,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:35:35,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:35:37,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:35:39,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:35:41,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:35:43,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:35:44,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:35:44,717 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:35:45,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:35:47,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:35:49,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:35:51,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:35:53,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:35:54,083 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:35:55,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:35:57,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:35:59,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:36:00,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:36:00,016 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:36:01,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:36:04,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:36:06,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:36:08,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:36:10,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:36:12,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:36:14,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:36:15,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:36:15,285 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:36:16,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:36:18,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:36:20,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:36:22,128 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:36:24,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:36:24,158 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:36:26,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:36:28,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:36:30,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:36:30,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:36:30,665 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:36:32,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:36:34,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:36:36,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:36:38,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:36:40,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:36:42,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:36:44,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:36:45,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:36:45,989 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:36:46,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:36:48,140 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:36:50,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:36:52,142 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:36:54,142 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:36:54,234 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:36:56,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:36:58,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:37:00,145 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:37:01,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:37:01,504 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:37:02,146 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:37:04,146 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:37:06,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:37:08,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:37:10,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:37:12,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:37:14,150 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:37:16,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:37:16,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:37:16,833 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:37:18,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:37:20,152 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:37:22,153 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:37:24,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:37:24,310 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:37:26,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:37:28,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:37:30,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:37:32,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:37:32,061 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:37:32,157 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:37:34,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:37:36,159 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:37:38,159 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:37:41,160 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:37:43,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:37:45,162 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:37:47,163 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:37:47,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:37:47,285 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:37:49,164 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:37:51,164 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:37:53,165 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:37:54,384 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:37:55,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:37:57,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:37:59,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:38:01,168 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:38:02,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:38:02,687 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:38:03,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:38:05,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:38:07,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:38:09,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:38:11,172 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:38:13,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:38:15,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:38:17,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:38:17,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:38:17,916 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:38:19,175 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:38:21,176 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:38:23,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:38:24,458 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:38:25,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:38:27,179 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:38:29,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:38:31,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:38:33,182 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:38:33,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:38:33,264 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:38:35,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:38:37,184 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:38:39,185 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:38:41,185 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:38:43,186 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:38:45,187 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:38:47,188 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:38:48,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:38:48,623 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:38:49,189 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:38:51,189 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:38:53,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:38:54,531 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:38:55,191 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:38:57,192 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:38:59,192 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:39:01,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:39:03,194 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:39:03,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:39:03,883 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:39:05,194 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:39:08,196 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:39:10,197 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:39:12,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:39:14,199 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:39:16,200 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:39:18,200 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:39:19,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:39:19,158 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:39:20,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:39:22,202 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:39:24,203 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:39:24,608 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:39:26,204 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:39:28,204 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:39:30,205 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:39:32,206 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:39:34,207 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:39:34,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:39:34,471 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:39:36,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:39:38,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:39:40,209 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:39:42,210 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:39:44,211 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:39:46,212 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:39:48,213 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:39:49,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:39:49,759 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:39:50,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:39:52,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:39:54,215 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:39:54,681 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:39:56,216 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:39:58,217 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:40:00,218 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:40:02,219 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:40:04,220 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:40:05,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:40:05,038 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:40:06,221 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:40:08,222 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:40:10,222 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:40:12,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:40:14,224 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:40:16,225 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:40:18,226 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:40:20,226 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:40:20,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:40:20,264 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:40:23,228 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:40:24,755 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:40:25,229 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:40:27,229 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:40:29,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:40:31,231 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:40:33,232 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:40:35,232 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:40:35,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:40:35,574 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:40:37,233 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:40:39,234 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:40:41,235 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:40:43,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:40:45,237 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:40:47,237 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:40:49,238 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:40:50,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:40:50,989 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:40:51,239 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:40:53,240 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:40:54,829 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:40:55,241 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:40:57,241 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:40:59,242 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:41:01,243 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:41:03,244 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:41:05,244 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:41:06,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:41:06,280 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:41:07,245 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:41:09,246 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:41:11,247 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:41:13,247 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:41:15,248 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:41:17,249 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:41:19,250 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:41:21,250 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:41:21,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:41:21,608 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:41:23,251 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:41:24,903 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:41:25,252 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:41:27,253 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:41:29,254 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:41:31,254 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:41:33,255 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:41:35,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:41:36,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:41:36,891 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:41:37,257 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:41:39,257 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:41:41,258 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:41:43,259 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:41:45,260 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:41:47,260 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:41:49,261 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:41:51,262 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:41:52,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:41:52,344 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:41:54,263 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:41:54,977 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:41:56,264 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:41:58,265 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:42:00,266 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:42:02,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:42:04,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:42:06,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:42:07,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:42:07,669 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:42:08,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:42:10,270 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:42:12,271 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:42:14,272 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:42:16,273 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:42:18,274 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:42:20,275 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:42:22,276 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:42:23,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:42:23,011 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:42:24,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:42:25,056 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:42:26,279 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:42:28,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:42:30,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:42:32,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:42:34,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:42:36,283 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:42:38,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:42:38,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:42:38,370 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:42:40,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:42:42,285 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:42:44,286 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:42:46,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:42:48,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:42:50,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:42:52,290 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:42:53,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:42:53,711 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:42:54,290 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:42:55,131 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:42:56,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:42:58,292 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:43:00,293 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:43:02,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:43:04,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:43:06,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:43:08,296 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:43:08,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:43:08,980 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:43:10,297 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:43:12,298 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:43:14,299 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:43:16,300 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:43:18,301 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:43:20,301 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:43:22,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:43:24,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:43:24,243 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:43:24,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:43:25,205 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:43:26,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:43:28,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:43:30,306 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:43:32,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:43:34,308 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:43:36,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:43:39,310 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:43:39,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:43:39,554 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:43:41,311 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:43:43,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:43:45,313 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:43:47,314 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:43:49,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:43:51,316 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:43:53,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:43:54,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:43:54,864 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:43:55,282 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:43:55,318 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:43:57,319 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:43:59,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:44:01,321 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:44:03,322 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:44:05,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:44:07,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:44:09,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:44:10,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:44:10,201 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:44:11,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:44:13,326 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:44:15,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:44:17,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:44:19,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:44:21,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:44:23,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:44:25,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:44:25,359 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:44:25,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:44:25,421 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:44:27,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:44:29,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:44:31,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:44:33,335 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:44:35,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:44:37,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:44:39,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:44:40,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:44:40,753 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:44:41,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:44:43,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:44:46,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:44:48,342 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:44:50,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:44:52,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:44:54,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:44:55,432 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:44:56,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:44:56,179 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:44:56,346 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:44:58,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:45:00,348 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:45:02,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:45:04,350 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:45:06,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:45:08,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:45:10,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:45:11,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:45:11,408 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:45:12,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:45:14,354 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:45:16,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:45:18,356 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:45:20,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:45:22,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:45:24,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:45:25,507 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:45:26,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:45:26,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:45:26,722 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:45:28,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:45:30,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:45:32,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:45:34,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:45:36,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:45:38,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:45:40,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:45:41,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:45:41,996 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:45:42,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:45:44,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:45:46,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:45:49,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:45:51,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:45:53,371 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:45:55,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:45:55,582 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:45:57,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:45:57,226 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:45:57,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:45:59,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:46:01,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:46:03,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:46:05,376 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:46:07,377 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:46:09,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:46:11,379 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:46:12,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:46:12,593 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:46:13,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:46:15,381 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:46:17,382 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:46:19,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:46:21,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:46:23,384 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:46:25,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:46:25,656 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:46:27,386 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:46:27,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:46:27,884 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:46:29,387 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:46:31,388 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:46:33,389 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:46:35,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:46:37,391 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:46:39,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:46:41,393 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:46:43,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:46:43,180 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:46:43,393 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:46:45,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:46:47,395 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:46:49,396 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:46:51,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:46:53,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:46:55,399 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:46:55,731 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:46:57,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:46:58,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:46:58,505 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:46:59,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:47:01,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:47:04,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:47:06,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:47:08,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:47:10,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:47:12,406 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:47:13,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:47:13,735 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:47:14,407 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:47:16,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:47:18,409 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:47:20,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:47:22,411 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:47:24,412 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:47:25,806 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:47:26,413 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:47:28,414 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:47:29,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:47:29,063 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:47:30,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:47:32,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:47:34,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:47:36,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:47:38,419 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:47:40,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:47:42,421 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:47:44,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:47:44,290 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:47:44,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:47:46,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:47:48,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:47:50,425 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:47:52,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:47:54,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:47:55,881 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:47:56,427 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:47:58,428 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:47:59,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:47:59,676 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:48:00,429 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:48:02,430 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:48:04,431 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:48:06,432 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:48:08,433 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:48:10,434 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:48:12,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:48:14,436 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:48:14,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:48:14,908 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:48:16,437 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:48:18,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:48:20,439 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:48:22,440 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:48:24,440 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:48:25,956 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:48:26,441 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:48:28,442 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:48:30,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:48:30,259 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:48:30,443 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:48:33,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:48:35,445 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:48:37,446 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:48:39,447 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:48:41,448 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:48:43,449 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:48:45,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:48:45,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:48:45,577 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:48:47,451 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:48:49,452 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:48:51,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:48:53,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:48:55,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:48:56,032 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:48:57,456 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:48:59,456 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:49:00,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:49:00,870 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:49:01,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:49:03,458 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:49:05,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:49:07,460 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:49:09,461 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:49:11,462 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:49:13,463 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:49:15,464 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:49:16,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:49:16,095 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:49:17,465 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:49:19,465 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:49:21,466 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:49:23,467 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:49:25,468 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:49:26,109 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:49:27,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:49:29,470 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:49:31,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:49:31,385 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:49:31,471 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:49:33,472 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:49:35,473 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:49:37,473 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:49:39,474 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:49:41,475 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:49:43,476 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:49:45,477 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:49:46,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:49:46,599 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:49:47,478 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:49:49,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:49:51,480 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:49:53,481 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:49:55,481 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:49:56,179 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:49:57,482 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:49:59,482 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:50:01,483 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:50:01,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:50:01,968 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:50:04,484 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:50:06,485 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:50:08,486 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:50:10,487 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:50:12,487 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:50:14,488 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:50:16,489 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:50:17,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:50:17,275 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:50:18,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:50:20,491 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:50:22,492 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:50:24,492 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:50:26,246 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:50:26,493 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:50:28,494 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:50:31,495 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:50:32,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:50:32,498 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:50:33,496 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:50:35,497 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:50:37,498 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:50:39,500 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:50:41,500 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:50:43,501 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:50:45,502 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:50:47,503 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:50:47,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:50:47,864 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:50:49,504 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:50:51,505 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:50:53,505 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:50:55,506 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:50:56,317 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:50:57,508 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:50:59,508 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:51:01,509 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:51:03,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:51:03,086 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:51:03,510 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:51:05,511 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:51:07,512 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:51:09,513 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:51:11,514 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:51:13,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:51:15,516 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:51:17,517 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:51:18,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:51:18,517 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:51:19,522 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:51:21,523 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:51:23,524 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:51:25,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:51:26,390 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:51:27,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:51:29,526 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:51:31,527 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:51:33,528 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:51:33,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:51:33,743 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:51:35,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:51:37,530 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:51:40,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:51:42,532 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:51:44,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:51:46,534 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:51:48,535 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:51:49,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:51:49,040 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:51:50,536 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:51:52,537 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:51:54,538 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:51:56,465 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:51:56,538 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:51:58,539 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:52:00,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:52:02,541 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:52:04,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:52:04,323 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:52:04,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:52:06,543 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:52:08,544 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:52:10,545 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:52:12,545 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:52:14,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:52:16,547 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:52:18,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:52:19,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:52:19,597 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:52:20,549 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:52:22,550 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:52:24,551 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:52:26,538 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:52:26,552 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:52:28,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:52:30,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:52:32,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:52:34,556 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:52:34,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:52:34,834 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:52:36,556 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:52:38,557 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:52:41,559 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:52:43,559 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:52:45,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:52:47,561 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:52:49,562 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:52:50,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:52:50,060 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:52:51,563 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:52:53,564 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:52:55,564 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:52:56,613 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:52:57,565 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:52:59,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:53:01,567 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:53:03,568 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:53:05,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:53:05,367 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:53:05,569 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:53:07,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:53:09,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:53:11,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:53:13,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:53:15,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:53:17,574 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:53:19,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:53:20,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:53:20,762 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:53:21,576 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:53:23,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:53:25,578 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:53:26,687 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:53:27,579 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:53:29,580 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:53:31,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:53:33,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:53:35,583 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:53:36,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:53:36,017 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:53:37,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:53:39,585 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:53:41,585 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:53:43,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:53:45,587 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:53:47,588 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:53:49,589 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:53:51,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:53:51,236 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:53:51,590 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:53:54,592 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:53:56,593 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:53:56,764 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:53:58,594 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:54:00,595 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:54:02,596 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:54:04,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:54:06,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:54:06,547 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:54:06,598 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:54:08,599 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:54:10,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:54:12,601 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:54:14,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:54:16,603 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:54:18,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:54:20,605 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:54:21,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:54:21,928 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:54:22,606 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:54:24,606 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:54:26,607 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:54:26,840 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:54:28,608 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:54:30,609 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:54:32,610 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:54:34,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:54:36,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:54:37,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:54:37,333 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:54:38,613 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:54:40,614 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:54:42,615 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:54:44,615 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:54:46,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:54:48,617 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:54:50,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:54:52,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:54:52,559 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:54:52,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:54:54,619 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:54:56,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:54:56,915 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:54:58,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:55:00,621 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:55:02,622 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:55:04,622 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:55:06,623 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:55:07,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:55:07,867 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:55:08,624 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:55:11,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:55:13,626 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:55:15,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:55:17,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:55:19,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:55:21,629 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:55:23,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:55:23,158 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:55:23,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:55:25,631 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:55:26,987 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:55:27,632 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:55:29,632 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:55:31,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:55:33,634 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:55:35,634 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:55:37,635 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:55:38,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:55:38,504 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:55:39,636 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:55:41,637 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:55:43,638 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:55:45,639 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:55:47,640 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:55:49,641 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:55:51,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:55:53,643 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:55:53,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:55:53,751 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:55:55,643 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:55:57,061 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:55:57,644 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:55:59,645 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:56:01,646 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:56:03,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:56:05,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:56:07,648 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:56:08,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:56:08,988 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:56:09,649 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:56:11,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:56:13,651 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:56:15,651 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:56:17,652 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:56:19,653 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:56:21,654 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:56:23,655 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:56:24,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:56:24,385 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:56:25,655 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:56:27,140 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:56:27,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:56:29,657 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:56:32,658 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:56:34,659 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:56:36,660 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:56:38,661 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:56:39,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:56:39,606 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:56:40,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:56:42,663 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:56:44,663 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:56:46,664 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:56:48,665 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:56:50,666 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:56:52,666 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:56:54,667 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:56:54,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:56:54,954 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:56:56,668 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:56:57,220 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:56:58,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:57:00,670 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:57:02,671 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:57:04,671 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:57:06,672 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:57:08,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:57:10,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:57:10,270 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:57:10,674 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:57:12,674 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:57:14,675 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:57:16,676 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:57:18,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:57:20,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:57:22,678 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:57:24,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:57:25,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:57:25,570 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:57:26,680 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:57:27,300 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:57:28,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:57:30,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:57:32,682 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:57:34,683 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:57:36,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:57:39,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:57:40,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:57:40,796 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:57:41,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:57:43,687 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:57:45,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:57:47,689 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:57:49,690 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:57:51,690 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:57:53,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:57:55,692 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:57:56,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:57:56,020 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:57:57,377 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:57:57,693 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:57:59,693 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:58:01,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:58:03,695 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:58:05,696 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:58:07,697 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:58:09,697 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:58:11,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:58:11,265 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:58:11,698 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:58:13,699 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:58:15,700 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:58:17,701 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:58:19,701 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:58:21,702 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:58:23,703 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:58:25,704 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:58:26,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:58:26,569 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:58:27,455 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:58:27,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:58:29,706 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:58:31,707 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:58:33,708 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:58:35,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:58:37,710 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:58:39,710 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:58:41,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:58:41,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:58:41,891 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:58:43,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:58:45,713 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:58:47,714 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:58:49,715 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:58:51,716 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:58:53,717 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:58:55,718 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:58:57,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:58:57,216 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:58:57,531 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:58:57,719 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:58:59,720 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:59:01,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:59:03,722 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:59:05,723 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:59:07,723 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:59:09,724 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:59:12,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:59:12,477 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:59:12,725 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:59:14,726 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:59:16,727 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:59:18,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:59:20,729 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:59:22,730 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:59:24,730 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:59:26,731 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:59:27,607 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:59:27,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:59:27,760 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:59:28,732 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:59:30,733 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:59:32,734 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:59:34,735 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:59:36,736 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:59:38,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:59:40,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:59:42,738 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:59:42,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:59:42,988 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:59:44,739 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:59:46,740 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:59:48,741 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:59:50,742 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:59:52,742 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:59:54,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:59:56,744 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 22:59:57,682 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 22:59:58,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 22:59:58,230 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 22:59:58,745 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:00:00,746 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:00:02,747 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:00:04,748 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:00:06,749 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:00:08,750 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:00:10,750 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:00:12,751 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:00:13,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:00:13,704 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:00:14,752 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:00:16,753 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:00:18,754 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:00:20,755 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:00:22,756 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:00:24,757 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:00:26,758 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:00:27,758 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:00:28,761 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:00:28,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:00:28,972 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:00:30,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:00:32,763 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:00:34,764 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:00:36,765 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:00:38,766 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:00:41,767 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:00:43,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:00:44,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:00:44,199 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:00:45,769 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:00:47,770 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:00:49,771 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:00:51,772 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:00:53,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:00:55,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:00:57,775 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:00:57,834 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:00:59,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:00:59,621 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:00:59,776 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:01:01,777 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:01:03,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:01:05,779 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:01:07,780 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:01:09,781 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:01:11,782 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:01:13,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:01:14,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:01:14,883 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:01:15,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:01:17,785 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:01:19,786 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:01:21,787 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:01:23,788 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:01:25,789 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:01:27,790 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:01:27,912 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:01:29,791 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:01:30,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:01:30,136 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:01:31,792 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:01:33,792 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:01:35,793 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:01:37,794 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:01:39,795 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:01:41,796 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:01:43,797 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:01:45,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:01:45,361 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:01:45,798 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:01:47,799 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:01:49,800 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:01:51,801 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:01:53,802 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:01:55,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:01:57,804 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:01:57,988 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:01:59,804 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:02:00,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:02:00,604 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:02:01,805 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:02:03,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:02:05,807 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:02:08,809 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:02:10,809 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:02:12,810 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:02:14,811 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:02:15,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:02:15,865 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:02:16,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:02:18,813 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:02:20,814 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:02:22,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:02:24,816 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:02:26,817 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:02:28,063 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:02:28,817 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:02:30,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:02:31,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:02:31,173 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:02:32,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:02:34,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:02:36,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:02:38,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:02:40,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:02:42,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:02:44,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:02:46,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:02:46,479 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:02:46,826 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:02:48,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:02:50,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:02:52,829 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:02:54,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:02:56,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:02:58,138 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:02:58,831 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:03:00,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:03:01,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:03:01,851 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:03:02,833 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:03:04,833 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:03:06,834 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:03:08,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:03:10,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:03:12,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:03:14,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:03:16,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:03:17,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:03:17,086 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:03:18,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:03:21,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:03:23,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:03:25,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:03:27,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:03:28,221 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:03:29,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:03:31,846 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:03:32,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:03:32,501 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:03:33,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:03:35,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:03:37,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:03:39,849 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:03:41,850 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:03:43,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:03:45,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:03:47,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:03:47,829 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:03:47,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:03:49,854 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:03:51,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:03:53,856 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:03:55,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:03:57,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:03:58,296 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:03:59,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:04:01,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:04:03,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:04:03,217 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:04:03,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:04:05,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:04:07,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:04:09,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:04:11,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:04:13,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:04:15,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:04:17,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:04:18,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:04:18,619 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:04:19,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:04:21,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:04:23,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:04:25,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:04:27,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:04:28,371 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:04:29,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:04:31,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:04:33,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:04:33,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:04:33,896 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:04:36,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:04:38,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:04:40,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:04:42,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:04:44,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:04:46,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:04:48,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:04:49,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:04:49,123 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:04:50,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:04:52,882 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:04:54,883 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:04:56,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:04:58,447 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:04:58,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:05:00,885 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:05:02,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:05:04,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:05:04,392 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:05:04,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:05:06,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:05:08,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:05:10,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:05:12,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:05:14,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:05:16,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:05:18,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:05:19,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:05:19,724 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:05:20,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:05:22,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:05:24,894 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:05:27,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:05:28,522 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:05:29,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:05:31,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:05:33,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:05:35,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:05:35,002 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:05:35,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:05:37,900 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:05:39,900 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:05:41,901 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:05:43,902 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:05:45,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:05:47,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:05:49,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:05:50,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:05:50,225 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:05:51,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:05:53,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:05:55,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:05:57,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:05:58,594 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:05:59,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:06:01,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:06:03,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:06:05,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:06:05,503 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:06:05,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:06:07,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:06:09,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:06:11,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:06:13,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:06:15,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:06:17,916 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:06:19,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:06:20,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:06:20,826 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:06:21,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:06:23,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:06:25,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:06:27,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:06:28,669 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:06:29,921 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:06:31,922 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:06:33,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:06:35,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:06:36,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:06:36,048 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:06:37,925 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:06:39,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:06:41,927 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:06:43,927 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:06:45,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:06:47,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:06:49,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:06:51,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:06:51,358 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:06:51,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:06:53,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:06:55,932 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:06:57,932 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:06:58,741 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:06:59,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:07:01,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:07:03,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:07:05,935 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:07:06,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:07:06,675 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:07:08,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:07:10,937 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:07:12,938 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:07:14,939 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:07:16,940 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:07:18,941 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:07:20,942 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:07:22,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:07:22,015 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:07:22,942 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:07:24,943 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:07:26,944 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:07:28,817 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:07:28,945 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:07:30,946 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:07:32,947 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:07:34,948 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:07:36,949 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:07:37,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:07:37,349 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:07:38,950 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:07:40,951 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:07:42,952 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:07:44,953 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:07:46,954 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:07:48,955 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:07:50,956 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:07:52,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:07:52,611 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:07:52,956 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:07:54,957 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:07:56,958 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:07:58,891 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:07:58,959 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:08:01,960 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:08:03,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:08:05,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:08:07,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:08:07,890 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:08:07,963 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:08:09,964 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:08:11,965 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:08:13,966 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:08:15,967 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:08:17,968 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:08:19,969 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:08:21,970 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:08:23,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:08:23,152 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:08:23,971 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:08:25,972 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:08:27,972 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:08:28,966 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:08:29,973 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:08:31,974 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:08:33,975 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:08:35,976 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:08:37,977 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:08:38,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:08:38,380 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:08:39,978 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:08:41,979 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:08:43,980 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:08:45,981 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:08:47,982 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:08:49,982 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:08:51,983 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:08:53,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:08:53,675 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:08:53,984 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:08:55,985 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:08:57,985 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:08:59,039 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:08:59,986 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:09:01,987 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:09:03,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:09:05,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:09:07,989 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:09:09,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:09:09,055 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:09:09,990 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:09:11,991 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:09:13,992 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:09:15,993 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:09:17,993 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:09:19,994 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:09:21,995 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:09:24,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:09:24,399 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:09:24,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:09:26,997 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:09:28,998 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:09:29,113 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:09:30,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:09:33,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:09:35,001 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:09:37,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:09:39,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:09:39,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:09:39,704 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:09:41,003 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:09:43,004 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:09:45,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:09:47,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:09:49,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:09:51,007 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:09:53,008 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:09:54,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:09:54,930 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:09:55,009 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:09:57,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:09:59,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:09:59,187 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:10:01,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:10:03,012 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:10:05,013 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:10:07,014 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:10:09,015 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:10:10,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:10:10,254 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:10:11,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:10:13,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:10:15,017 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:10:17,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:10:19,019 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:10:21,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:10:23,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:10:25,021 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:10:25,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:10:25,629 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:10:27,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:10:29,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:10:29,261 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:10:31,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:10:33,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:10:35,025 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:10:38,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:10:40,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:10:41,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:10:41,127 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:10:42,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:10:44,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:10:46,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:10:48,031 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:10:50,032 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:10:52,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:10:54,034 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:10:56,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:10:56,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:10:56,478 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:10:58,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:10:59,338 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:11:00,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:11:02,038 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:11:04,039 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:11:06,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:11:08,041 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:11:10,042 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:11:11,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:11:11,833 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:11:12,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:11:14,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:11:16,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:11:18,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:11:20,047 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:11:22,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:11:24,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:11:26,049 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:11:27,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:11:27,232 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:11:28,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:11:29,411 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:11:30,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:11:32,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:11:34,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:11:36,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:11:38,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:11:40,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:11:42,056 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:11:42,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:11:42,494 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:11:44,056 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:11:46,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:11:48,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:11:50,059 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:11:52,060 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:11:54,061 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:11:57,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:11:57,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:11:57,785 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:11:59,063 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:11:59,486 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:12:01,063 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:12:03,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:12:05,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:12:07,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:12:09,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:12:11,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:12:13,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:12:13,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:12:13,197 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:12:15,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:12:17,071 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:12:19,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:12:21,074 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:12:23,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:12:25,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:12:27,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:12:28,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:12:28,507 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:12:29,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:12:29,562 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:12:31,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:12:33,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:12:35,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:12:37,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:12:39,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:12:41,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:12:43,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:12:43,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:12:43,853 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:12:45,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:12:47,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:12:49,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:12:51,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:12:53,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:12:55,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:12:57,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:12:59,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:12:59,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:12:59,244 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:12:59,633 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:13:01,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:13:03,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:13:05,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:13:07,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:13:09,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:13:11,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:13:13,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:13:14,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:13:14,560 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:13:15,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:13:17,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:13:19,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:13:21,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:13:23,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:13:25,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:13:27,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:13:29,707 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:13:29,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:13:29,885 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:13:30,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:13:32,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:13:34,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:13:36,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:13:38,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:13:40,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:13:42,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:13:44,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:13:45,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:13:45,111 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:13:46,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:13:48,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:13:50,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:13:52,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:13:54,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:13:56,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:13:58,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:13:59,782 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:14:00,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:14:00,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:14:00,344 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:14:02,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:14:04,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:14:06,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:14:08,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:14:10,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:14:12,121 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:14:14,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:14:15,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:14:15,682 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:14:16,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:14:18,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:14:20,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:14:22,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:14:24,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:14:26,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:14:28,128 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:14:29,857 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:14:30,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:14:30,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:14:30,996 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:14:32,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:14:34,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:14:36,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:14:38,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:14:40,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:14:42,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:14:44,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:14:46,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:14:46,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:14:46,406 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:14:48,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:14:51,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:14:53,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:14:55,140 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:14:57,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:14:59,142 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:14:59,935 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:15:01,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:15:01,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:15:01,719 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:15:03,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:15:05,145 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:15:07,145 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:15:09,146 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:15:11,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:15:13,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:15:15,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:15:17,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:15:17,051 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:15:17,150 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:15:19,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:15:21,152 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:15:23,153 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:15:25,153 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:15:27,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:15:29,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:15:30,011 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:15:31,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:15:32,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:15:32,430 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:15:33,157 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:15:35,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:15:37,159 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:15:40,160 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:15:42,162 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:15:44,163 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:15:46,164 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:15:47,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:15:47,654 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:15:48,164 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:15:50,165 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:15:52,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:15:54,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:15:56,168 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:15:58,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:16:00,087 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:16:00,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:16:02,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:16:02,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:16:02,990 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:16:04,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:16:06,172 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:16:08,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:16:10,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:16:12,175 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:16:14,176 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:16:16,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:16:18,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:16:18,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:16:18,220 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:16:20,179 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:16:22,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:16:24,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:16:26,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:16:28,182 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:16:30,164 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:16:30,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:16:32,184 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:16:33,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:16:33,465 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:16:34,185 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:16:36,186 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:16:38,187 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:16:40,188 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:16:42,189 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:16:44,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:16:46,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:16:48,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:16:48,923 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:16:49,192 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:16:51,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:16:53,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:16:55,194 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:16:57,195 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:16:59,196 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:17:00,233 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:17:01,196 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:17:03,197 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:17:04,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:17:04,236 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:17:05,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:17:07,199 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:17:09,200 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:17:11,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:17:13,202 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:17:15,203 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:17:17,204 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:17:19,205 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:17:19,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:17:19,508 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:17:21,206 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:17:23,206 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:17:25,207 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:17:27,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:17:29,209 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:17:30,295 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:17:31,210 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:17:33,211 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:17:34,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:17:34,781 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:17:35,212 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:17:37,213 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:17:39,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:17:41,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:17:43,215 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:17:45,216 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:17:47,217 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:17:49,218 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:17:50,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:17:50,123 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:17:51,219 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:17:53,219 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:17:55,220 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:17:57,221 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:17:59,222 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:18:00,349 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:18:01,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:18:03,224 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:18:05,225 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:18:05,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:18:05,398 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:18:08,226 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:18:10,227 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:18:12,228 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:18:14,229 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:18:16,229 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:18:18,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:18:20,231 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:18:20,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:18:20,676 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:18:22,232 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:18:24,233 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:18:26,234 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:18:28,235 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:18:30,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:18:30,410 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:18:32,237 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:18:34,237 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:18:35,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:18:35,956 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:18:36,238 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:18:38,239 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:18:40,240 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:18:42,241 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:18:44,242 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:18:46,243 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:18:48,244 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:18:50,244 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:18:51,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:18:51,206 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:18:52,245 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:18:54,246 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:18:56,247 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:18:58,248 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:19:00,249 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:19:00,478 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:19:02,249 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:19:04,250 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:19:06,251 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:19:06,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:19:06,449 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:19:08,252 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:19:10,253 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:19:12,254 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:19:14,254 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:19:16,255 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:19:18,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:19:20,257 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:19:21,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:19:21,675 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:19:22,257 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:19:24,258 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:19:26,259 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:19:28,259 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:19:30,260 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:19:30,553 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:19:32,261 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:19:34,262 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:19:36,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:19:36,892 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:19:52,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:19:52,296 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:20:00,627 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:20:07,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:20:07,540 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:20:22,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:20:22,811 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:20:30,701 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:20:35,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:20:35,670 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 23:20:35,722 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 23:20:35,799 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 23:20:36,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 23:20:37,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:20:38,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:20:38,089 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:20:45,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:20:53,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:20:53,355 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:21:00,785 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:21:07,298 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:21:08,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:21:08,603 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:21:23,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:21:23,851 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:21:30,864 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:21:39,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:21:39,083 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:21:54,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:21:54,310 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:22:00,944 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:22:09,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:22:09,540 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:22:24,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:22:24,768 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:22:31,023 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:22:40,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:22:40,030 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:22:55,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:22:55,250 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:23:01,101 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:23:10,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:23:10,472 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:23:25,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:23:25,696 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:23:31,177 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:23:40,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:23:40,921 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:23:56,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:23:56,184 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:24:01,260 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:24:11,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:24:11,447 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:24:26,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:24:26,674 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:24:31,339 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:24:41,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:24:41,901 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:24:57,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:24:57,127 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:24:57,399 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:24:59,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:25:01,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:25:01,419 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:25:04,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:04,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:04,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:04,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:04,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:04,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:04,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:04,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:04,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:04,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:04,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:04,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:04,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:04,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:04,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:04,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:08,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:08,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:08,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:08,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:08,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:08,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:08,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:08,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:08,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:08,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:08,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:08,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:08,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:08,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:08,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:08,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:09,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:09,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:09,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:09,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:09,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:09,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:09,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:09,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:09,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:09,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:09,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:09,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:09,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:09,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:09,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:09,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:11,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:25:12,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:25:12,352 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:25:14,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:14,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:14,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:14,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:14,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:14,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:14,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:14,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:14,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:14,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:14,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:14,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:14,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:14,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:14,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:14,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:14,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:14,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:14,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:14,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:14,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:14,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:14,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:14,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:14,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:14,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:14,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:14,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:14,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:14,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:14,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:14,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:16,407 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:25:19,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:19,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:19,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:19,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:19,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:19,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:19,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:19,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:19,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:19,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:19,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:19,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:19,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:19,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:19,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:19,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:22,409 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:25:23,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:23,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:23,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:23,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:23,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:23,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:23,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:23,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:23,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:23,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:23,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:23,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:23,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:23,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:23,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:23,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:25,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:25,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:25,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:25,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:25,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:25,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:25,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:25,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:25,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:25,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:25,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:25,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:25,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:25,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:25,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:25,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:25,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:25,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:25,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:25,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:25,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:25,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:25,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:25,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:25,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:25,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:25,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:25,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:25,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:25,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:25,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:25,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:26,411 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:25:27,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:27,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:27,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:27,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:27,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:27,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:27,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:27,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:27,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:27,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:27,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:27,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:27,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:27,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:27,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:27,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:27,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:25:27,680 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:25:27,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:27,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:27,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:27,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:27,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:27,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:27,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:27,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:27,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:27,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:27,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:27,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:27,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:27,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:27,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:27,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:29,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:29,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:29,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:29,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:29,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:29,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:29,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:29,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:29,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:29,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:29,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:29,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:29,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:29,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:29,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:29,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:29,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:29,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:29,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:29,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:29,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:29,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:29,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:29,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:29,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:29,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:29,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:29,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:29,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:29,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:29,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:29,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:30,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:30,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:30,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:30,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:30,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:30,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:30,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:30,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:30,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:30,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:30,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:30,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:30,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:30,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:30,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:30,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:30,413 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:25:31,486 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:25:33,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:33,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:33,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:33,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:33,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:33,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:33,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:33,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:33,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:33,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:33,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:33,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:33,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:33,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:33,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:33,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:34,414 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:25:34,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:34,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:34,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:34,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:34,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:34,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:34,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:34,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:34,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:34,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:34,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:34,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:34,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:34,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:34,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:34,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:36,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:36,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:36,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:36,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:36,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:36,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:36,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:36,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:36,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:36,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:36,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:36,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:36,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:36,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:36,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:36,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:38,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:38,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:38,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:38,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:38,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:38,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:38,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:38,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:38,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:38,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:38,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:38,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:38,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:38,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:38,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:38,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:38,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:25:40,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:40,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:40,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:40,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:40,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:40,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:40,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:40,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:40,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:40,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:40,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:40,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:40,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:40,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:40,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:40,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:40,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:25:40,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:40,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:40,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:40,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:40,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:40,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:40,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:40,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:40,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:40,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:40,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:40,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:40,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:40,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:40,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:40,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:43,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:25:43,095 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:25:43,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:43,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:43,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:43,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:43,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:43,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:43,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:43,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:43,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:43,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:43,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:43,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:43,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:43,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:43,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:43,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:43,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:43,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:43,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:43,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:43,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:43,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:43,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:43,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:43,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:43,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:43,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:43,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:43,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:43,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:43,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:43,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:44,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:25:45,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:45,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:45,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:45,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:45,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:45,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:45,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:45,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:45,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:45,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:45,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:45,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:45,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:45,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:45,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:45,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:45,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:45,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:45,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:45,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:45,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:45,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:45,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:45,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:45,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:45,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:45,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:45,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:45,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:45,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:45,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:45,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:47,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:47,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:47,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:47,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:47,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:47,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:47,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:47,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:47,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:47,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:47,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:47,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:47,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:47,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:47,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:47,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:48,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:25:48,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:48,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:48,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:48,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:48,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:48,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:48,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:48,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:48,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:48,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:48,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:48,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:48,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:48,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:48,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:48,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:50,421 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:25:54,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:25:56,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:25:56,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:56,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:56,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:56,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:56,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:56,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:56,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:56,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:56,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:56,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:56,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:56,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:56,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:56,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:56,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:56,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:58,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:25:58,468 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:25:59,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:59,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:59,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:59,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:59,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:59,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:59,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:59,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:59,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:59,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:59,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:59,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:59,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:59,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:59,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:25:59,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:00,425 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:26:01,558 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:26:02,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:26:04,427 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:26:08,429 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:26:09,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:09,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:09,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:09,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:09,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:09,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:09,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:09,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:09,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:09,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:09,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:09,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:09,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:09,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:09,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:09,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:10,430 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:26:12,430 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:26:13,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:26:13,690 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:26:16,432 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:26:18,433 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:26:19,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:19,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:19,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:19,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:19,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:19,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:19,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:19,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:19,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:19,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:19,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:19,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:19,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:19,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:19,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:19,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:20,434 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:26:21,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:21,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:21,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:21,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:21,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:21,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:21,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:21,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:21,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:21,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:21,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:21,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:21,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:21,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:21,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:21,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:22,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:26:24,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:24,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:24,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:24,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:24,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:24,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:24,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:24,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:24,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:24,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:24,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:24,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:24,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:24,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:24,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:24,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:24,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:26:26,436 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:26:27,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:27,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:27,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:27,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:27,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:27,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:27,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:27,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:27,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:27,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:27,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:27,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:27,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:27,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:27,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:27,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:28,437 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:26:29,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:26:29,081 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:26:30,437 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:26:31,627 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:26:32,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:26:34,439 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:26:36,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:36,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:36,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:36,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:36,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:36,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:36,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:36,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:36,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:36,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:36,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:36,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:36,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:36,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:36,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:36,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:36,440 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:26:38,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:38,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:38,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:38,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:38,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:38,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:38,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:38,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:38,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:38,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:38,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:38,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:38,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:38,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:38,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:38,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:38,441 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:26:40,442 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:26:40,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:40,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:40,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:40,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:40,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:40,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:40,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:40,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:40,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:40,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:40,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:40,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:40,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:40,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:40,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:40,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:42,442 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:26:44,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:26:44,343 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:26:44,443 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:26:46,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:26:48,445 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:26:50,445 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:26:53,446 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:26:55,447 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:26:55,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:55,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:55,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:55,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:55,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:55,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:55,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:55,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:55,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:55,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:55,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:55,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:55,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:55,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:55,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:55,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:57,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:57,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:57,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:57,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:57,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:57,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:57,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:57,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:57,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:57,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:57,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:57,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:57,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:57,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:57,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:57,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:57,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:57,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:57,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:57,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:57,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:57,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:57,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:57,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:57,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:57,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:57,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:57,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:57,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:57,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:57,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:57,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:57,448 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:26:58,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:58,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:58,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:58,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:58,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:58,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:58,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:58,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:58,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:58,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:58,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:58,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:58,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:58,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:58,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:58,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:59,448 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:26:59,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:59,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:26:59,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:59,576 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:26:59,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:59,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:59,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:59,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:59,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:59,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:59,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:59,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:59,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:59,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:59,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:59,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:59,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:59,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:59,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:59,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:59,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:59,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:59,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:59,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:59,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:59,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:59,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:59,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:59,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:59,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:59,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:59,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:59,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:26:59,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:00,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:00,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:00,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:00,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:00,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:00,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:00,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:00,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:00,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:00,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:00,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:00,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:00,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:00,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:00,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:00,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:01,449 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:27:01,693 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:27:03,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:27:04,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:04,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:04,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:04,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:04,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:04,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:04,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:04,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:04,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:04,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:04,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:04,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:04,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:04,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:04,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:04,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:09,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:09,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:09,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:09,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:09,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:09,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:09,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:09,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:09,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:09,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:09,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:09,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:09,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:09,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:09,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:09,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:13,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:27:14,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:27:14,801 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:27:17,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:27:17,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:17,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:17,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:17,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:17,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:17,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:17,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:17,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:17,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:17,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:17,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:17,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:17,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:17,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:17,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:17,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:19,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:19,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:19,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:19,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:19,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:19,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:19,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:19,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:19,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:19,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:19,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:19,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:19,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:19,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:19,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:19,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:20,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:20,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:20,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:20,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:20,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:20,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:20,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:20,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:20,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:20,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:20,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:20,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:20,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:20,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:20,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:20,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:22,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:22,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:22,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:22,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:22,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:22,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:22,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:22,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:22,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:22,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:22,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:22,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:22,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:22,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:22,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:22,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:23,456 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:27:27,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:27:27,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:27,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:27,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:27,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:27,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:27,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:27,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:27,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:27,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:27,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:27,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:27,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:27,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:27,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:27,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:27,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:28,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:28,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:28,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:28,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:28,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:28,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:28,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:28,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:28,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:28,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:28,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:28,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:28,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:28,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:28,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:28,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:28,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:28,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:28,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:28,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:28,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:28,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:28,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:28,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:28,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:28,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:28,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:28,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:28,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:28,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:28,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:28,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:29,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:29,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:29,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:29,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:29,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:29,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:29,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:29,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:29,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:29,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:29,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:29,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:29,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:29,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:29,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:29,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:30,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:27:30,028 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:27:30,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:30,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:30,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:30,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:30,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:30,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:30,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:30,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:30,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:30,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:30,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:30,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:30,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:30,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:30,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:30,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:30,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:30,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:30,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:30,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:30,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:30,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:30,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:30,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:30,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:30,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:30,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:30,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:30,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:30,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:30,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:30,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:31,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:27:31,759 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:27:32,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:32,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:32,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:32,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:32,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:32,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:32,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:32,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:32,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:32,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:32,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:32,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:32,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:32,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:32,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:32,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:33,460 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:27:35,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:35,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:35,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:35,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:35,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:35,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:35,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:35,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:35,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:35,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:35,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:35,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:35,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:35,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:35,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:35,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:37,462 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:27:38,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:38,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:39,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:39,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:39,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:39,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:39,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:39,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:39,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:39,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:39,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:39,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:39,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:39,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:39,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:39,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:39,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:39,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:40,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:40,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:40,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:40,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:40,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:40,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:40,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:40,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:40,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:40,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:40,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:40,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:40,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:40,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:40,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:40,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:41,464 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:27:42,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:42,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:42,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:42,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:42,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:42,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:42,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:42,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:42,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:42,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:42,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:42,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:42,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:42,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:42,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:42,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:43,464 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:27:45,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:27:45,534 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:27:46,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:46,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:46,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:46,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:46,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:46,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:46,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:46,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:46,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:46,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:46,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:46,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:46,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:46,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:46,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:46,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:47,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:47,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:47,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:47,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:47,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:47,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:47,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:47,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:47,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:47,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:47,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:47,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:47,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:47,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:47,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:47,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:47,466 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:27:48,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:48,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:48,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:48,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:48,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:48,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:48,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:48,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:48,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:48,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:48,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:48,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:48,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:48,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:48,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:48,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:48,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:48,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:48,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:48,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:48,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:48,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:48,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:48,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:48,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:48,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:48,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:48,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:48,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:48,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:48,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:48,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:49,467 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:27:51,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:51,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:51,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:51,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:51,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:51,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:51,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:51,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:51,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:51,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:51,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:51,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:51,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:51,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:51,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:51,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:54,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:54,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:54,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:54,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:54,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:54,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:54,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:54,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:54,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:54,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:54,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:54,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:54,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:54,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:54,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:54,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:54,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:27:54,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:54,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:54,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:54,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:54,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:54,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:54,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:54,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:54,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:54,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:54,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:54,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:54,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:54,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:54,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:54,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:55,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:55,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:55,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:55,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:55,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:55,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:55,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:55,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:55,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:55,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:55,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:55,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:55,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:55,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:55,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:55,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:56,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:27:57,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:57,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:57,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:57,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:57,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:57,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:57,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:57,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:57,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:57,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:57,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:57,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:57,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:57,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:57,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:27:57,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:00,471 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:28:00,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:28:00,821 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:28:01,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:01,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:01,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:01,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:01,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:01,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:01,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:01,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:01,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:01,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:01,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:01,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:01,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:01,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:01,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:01,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:01,833 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:28:02,472 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:28:04,473 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:28:06,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:06,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:06,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:06,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:06,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:06,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:06,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:06,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:06,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:06,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:06,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:06,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:06,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:06,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:06,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:06,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:08,474 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:28:10,475 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:28:12,476 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:28:14,477 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:28:16,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:28:16,073 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:28:18,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:28:19,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:19,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:19,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:19,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:19,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:19,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:19,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:19,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:19,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:19,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:19,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:19,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:19,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:19,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:19,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:19,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:20,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:28:22,480 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:28:24,481 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:28:25,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:25,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:25,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:25,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:25,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:25,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:25,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:25,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:25,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:25,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:25,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:25,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:25,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:25,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:25,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:25,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:26,482 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:28:26,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:26,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:26,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:26,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:26,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:26,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:26,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:26,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:26,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:26,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:26,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:26,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:26,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:26,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:26,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:26,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:28,483 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:28:28,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:28,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:28,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:28,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:28,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:28,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:28,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:28,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:28,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:28,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:28,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:28,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:28,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:28,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:28,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:28,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:29,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:29,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:29,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:29,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:29,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:29,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:29,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:29,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:29,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:29,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:29,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:29,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:29,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:29,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:29,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:29,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:30,484 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:28:31,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:28:31,354 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:28:31,903 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:28:32,485 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:28:34,486 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:28:36,486 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:28:38,487 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:28:40,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:40,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:40,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:40,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:40,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:40,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:40,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:40,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:40,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:40,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:40,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:40,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:40,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:40,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:40,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:40,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:40,488 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:28:42,489 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:28:42,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:42,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:42,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:42,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:42,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:42,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:42,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:42,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:42,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:42,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:42,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:42,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:42,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:42,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:42,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:42,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:42,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:42,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:42,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:42,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:42,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:42,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:42,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:42,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:42,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:42,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:42,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:42,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:42,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:42,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:42,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:42,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:44,489 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:28:46,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:28:46,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:28:46,576 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:28:48,491 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:28:50,491 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:28:52,492 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:28:54,493 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:28:56,494 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:28:58,494 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:28:59,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:59,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:59,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:59,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:59,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:59,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:59,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:59,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:59,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:59,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:59,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:59,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:59,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:59,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:59,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:28:59,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,495 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:29:00,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:00,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:01,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:01,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:01,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:01,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:01,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:01,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:29:01,802 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:29:01,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:01,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:01,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:01,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:01,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:01,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:01,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:01,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:02,061 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:29:02,090 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 23:29:02,290 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 23:29:02,367 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 23:29:02,496 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 23:29:02,496 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:29:04,497 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:29:09,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:09,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:09,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:09,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:09,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:09,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:09,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:09,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:09,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:09,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:09,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:09,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:09,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:09,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:09,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:09,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:09,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:09,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:09,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:09,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:09,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:09,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:09,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:09,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:09,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:09,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:09,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:09,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:09,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:09,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:09,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:09,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:11,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:11,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:11,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:11,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:11,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:11,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:11,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:11,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:11,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:11,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:11,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:11,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:11,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:11,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:11,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:11,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:12,500 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:29:14,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:14,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:14,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:14,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:14,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:14,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:14,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:14,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:14,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:14,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:14,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:14,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:14,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:14,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:14,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:14,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:17,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:29:17,092 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:29:17,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:17,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:17,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:17,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:17,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:17,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:17,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:17,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:17,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:17,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:17,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:17,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:17,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:17,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:17,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:17,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:18,502 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:29:19,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:19,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:19,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:19,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:19,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:19,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:19,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:19,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:19,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:19,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:19,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:19,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:19,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:19,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:19,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:19,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:19,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:19,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:19,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:19,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:19,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:19,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:19,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:19,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:19,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:19,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:19,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:19,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:19,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:19,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:19,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:19,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:22,503 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:29:26,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:26,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:26,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:26,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:26,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:26,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:26,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:26,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:26,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:26,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:26,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:26,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:26,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:26,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:26,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:26,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:26,505 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:29:28,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:28,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:28,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:28,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:28,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:28,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:28,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:28,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:28,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:28,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:28,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:28,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:28,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:28,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:28,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:28,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:30,506 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:29:31,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:31,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:31,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:31,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:31,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:31,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:31,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:31,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:31,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:31,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:31,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:31,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:31,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:31,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:31,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:31,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:31,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:31,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:31,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:31,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:31,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:31,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:31,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:31,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:31,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:31,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:31,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:31,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:31,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:31,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:31,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:31,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:32,086 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:29:32,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:29:32,424 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:29:33,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:33,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:33,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:33,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:33,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:33,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:33,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:33,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:33,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:33,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:33,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:33,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:33,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:33,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:33,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:33,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:34,508 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:29:35,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:35,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:35,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:35,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:35,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:35,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:35,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:35,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:35,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:35,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:35,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:35,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:35,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:35,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:35,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:35,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:36,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:36,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:36,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:36,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:36,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:36,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:36,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:36,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:37,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:37,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:37,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:37,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:37,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:37,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:37,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:37,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:37,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:37,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:37,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:37,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:37,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:37,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:37,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:37,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:37,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:37,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:37,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:37,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:37,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:37,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:37,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:37,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:38,510 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:29:38,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:38,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:38,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:38,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:38,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:38,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:38,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:38,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:38,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:38,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:38,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:38,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:38,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:38,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:38,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:38,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:39,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:39,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:39,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:39,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:39,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:39,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:39,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:39,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:39,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:39,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:39,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:39,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:39,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:39,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:39,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:39,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:40,510 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:29:40,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:40,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:40,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:40,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:40,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:40,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:40,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:40,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:40,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:40,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:40,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:40,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:40,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:40,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:40,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:40,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:44,512 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:29:45,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:45,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:45,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:45,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:45,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:45,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:45,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:45,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:45,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:45,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:45,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:45,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:45,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:45,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:45,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:45,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:46,513 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:29:46,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:46,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:46,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:46,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:46,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:46,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:46,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:46,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:46,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:46,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:46,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:46,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:46,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:46,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:46,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:46,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:46,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:46,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:46,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:46,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:46,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:46,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:46,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:46,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:46,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:46,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:46,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:46,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:46,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:46,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:46,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:46,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:47,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:29:47,858 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:29:48,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:48,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:48,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:48,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:48,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:48,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:48,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:48,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:48,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:48,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:48,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:48,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:48,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:48,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:48,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:48,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:50,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:50,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:50,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:50,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:50,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:50,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:50,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:50,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:50,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:50,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:50,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:50,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:50,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:50,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:50,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:50,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:50,514 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:29:51,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:51,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:51,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:51,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:51,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:51,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:51,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:51,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:51,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:51,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:51,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:51,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:51,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:51,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:51,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:51,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:52,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:29:53,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:53,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:53,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:53,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:53,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:53,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:53,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:53,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:53,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:53,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:53,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:53,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:53,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:53,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:53,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:53,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:56,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:56,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:56,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:56,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:56,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:56,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:56,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:56,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:56,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:56,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:56,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:56,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:56,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:56,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:56,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:56,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:56,517 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:29:57,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:57,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:57,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:57,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:57,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:57,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:57,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:57,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:57,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:57,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:57,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:57,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:57,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:57,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:57,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:57,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:57,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:57,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:57,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:57,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:57,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:57,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:57,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:57,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:57,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:57,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:57,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:57,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:57,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:57,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:57,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:57,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:58,517 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:29:58,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:58,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:58,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:58,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:58,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:58,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:58,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:58,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:58,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:58,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:58,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:58,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:58,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:58,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:58,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:58,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:58,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:58,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:58,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:58,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:58,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:58,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:58,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:58,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:58,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:58,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:58,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:58,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:58,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:58,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:58,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:29:58,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:02,159 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:30:02,519 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:30:02,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:02,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:02,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:02,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:02,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:02,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:02,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:02,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:02,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:02,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:02,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:02,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:02,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:02,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:02,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:02,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:03,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:30:03,084 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:30:04,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:30:06,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:06,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:06,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:06,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:06,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:06,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:06,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:06,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:06,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:06,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:06,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:06,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:06,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:06,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:06,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:06,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:08,521 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:30:08,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:08,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:08,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:08,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:08,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:08,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:08,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:08,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:08,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:08,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:08,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:08,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:08,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:08,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:08,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:08,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:10,522 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:30:11,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:11,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:11,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:11,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:11,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:11,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:11,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:11,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:11,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:11,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:11,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:11,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:11,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:11,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:11,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:11,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:12,523 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:30:13,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:13,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:13,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:13,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:13,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:13,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:13,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:13,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:13,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:13,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:13,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:13,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:13,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:13,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:13,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:13,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:16,524 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:30:18,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:30:18,310 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:30:18,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:30:20,526 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:30:22,527 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:30:24,528 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:30:26,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:26,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:26,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:26,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:26,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:26,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:26,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:26,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:26,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:26,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:26,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:26,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:26,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:26,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:26,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:26,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:27,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:30:29,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:29,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:29,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:29,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:29,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:29,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:29,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:29,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:29,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:29,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:29,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:29,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:29,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:29,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:29,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:29,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:29,530 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:30:31,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:30:32,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:32,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:32,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:32,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:32,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:32,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:32,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:32,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:32,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:32,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:32,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:32,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:32,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:32,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:32,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:32,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:32,230 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:30:33,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:30:33,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:30:33,632 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:30:35,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:35,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:35,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:35,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:35,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:35,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:35,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:35,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:35,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:35,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:35,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:35,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:35,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:35,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:35,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:35,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:35,532 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:30:37,532 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:30:37,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:37,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:37,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:37,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:37,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:37,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:37,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:37,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:37,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:37,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:37,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:37,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:37,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:37,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:37,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:37,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:39,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:30:41,534 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:30:41,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:41,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:41,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:41,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:41,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:41,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:41,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:41,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:41,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:41,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:41,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:41,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:41,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:41,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:41,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:41,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:43,535 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:30:45,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:45,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:45,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:45,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:45,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:45,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:45,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:45,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:45,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:45,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:45,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:45,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:45,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:45,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:45,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:45,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:45,535 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:30:46,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:46,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:46,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:46,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:46,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:46,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:46,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:46,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:46,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:46,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:46,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:46,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:46,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:46,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:46,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:46,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:47,537 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:30:48,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:30:48,907 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:30:49,537 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:30:51,538 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:30:53,539 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:30:55,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:30:57,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:30:59,541 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:30:59,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:59,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:59,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:59,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:59,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:59,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:59,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:59,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:59,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:59,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:59,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:59,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:59,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:59,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:59,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:30:59,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:00,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:00,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:00,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:00,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:00,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:00,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:00,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:00,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:00,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:00,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:00,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:00,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:00,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:00,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:00,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:00,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:00,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:00,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:00,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:00,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:01,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:01,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:01,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:01,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:01,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:01,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:01,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:01,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:01,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:31:02,304 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:31:03,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:31:04,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:31:04,332 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:31:11,544 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:31:12,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:12,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:12,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:12,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:12,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:12,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:12,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:12,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:12,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:12,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:12,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:12,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:12,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:12,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:12,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:12,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:12,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:12,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:12,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:12,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:12,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:12,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:12,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:12,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:12,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:12,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:12,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:12,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:12,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:12,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:12,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:12,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:14,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:14,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:14,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:14,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:14,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:14,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:14,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:14,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:14,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:14,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:14,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:14,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:14,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:14,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:14,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:14,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:15,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:15,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:15,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:15,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:15,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:15,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:15,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:15,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:15,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:15,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:15,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:15,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:15,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:15,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:15,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:15,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:17,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:31:19,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:31:19,558 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:31:19,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:19,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:19,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:19,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:19,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:19,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:19,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:19,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:19,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:19,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:19,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:19,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:19,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:19,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:19,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:19,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:21,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:31:23,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:23,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:23,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:23,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:23,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:23,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:23,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:23,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:23,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:23,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:23,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:23,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:23,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:23,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:23,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:23,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:25,549 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:31:25,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:25,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:25,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:25,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:25,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:25,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:25,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:25,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:25,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:25,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:25,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:25,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:25,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:25,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:25,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:25,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:26,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:29,551 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:31:32,377 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:31:33,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:31:33,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:33,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:33,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:33,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:33,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:33,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:33,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:33,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:33,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:33,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:33,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:33,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:33,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:33,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:33,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:33,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:34,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:31:34,816 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:31:37,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:37,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:37,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:37,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:37,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:37,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:37,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:37,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:37,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:37,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:37,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:37,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:37,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:37,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:37,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:37,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:37,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:31:38,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:38,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:38,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:38,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:38,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:38,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:38,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:38,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:38,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:38,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:38,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:38,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:38,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:38,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:38,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:38,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:41,556 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:31:41,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:41,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:41,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:41,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:41,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:41,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:41,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:41,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:41,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:41,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:41,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:41,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:41,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:41,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:41,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:41,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:42,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:43,557 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:31:43,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:43,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:43,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:43,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:43,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:43,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:43,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:43,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:43,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:43,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:43,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:43,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:44,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:44,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:44,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:44,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:46,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:46,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:46,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:46,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:46,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:46,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:46,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:46,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:46,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:46,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:46,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:46,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:46,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:46,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:46,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:46,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:47,558 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:31:48,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:48,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:48,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:48,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:48,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:48,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:48,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:48,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:48,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:48,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:48,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:48,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:48,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:48,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:48,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:48,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:49,559 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:31:49,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:49,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:49,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:49,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:49,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:49,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:49,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:50,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:50,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:50,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:50,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:50,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:50,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:50,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:50,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:50,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:50,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:31:50,045 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:31:51,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:51,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:51,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:51,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:51,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:51,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:51,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:51,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:51,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:51,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:51,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:51,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:51,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:51,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:51,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:51,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:51,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:51,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:51,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:51,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:51,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:51,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:51,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:51,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:51,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:51,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:51,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:51,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:51,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:51,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:51,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:51,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:52,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:52,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:52,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:52,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:52,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:52,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:52,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:52,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:52,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:52,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:52,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:52,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:52,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:52,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:52,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:52,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:53,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:53,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:53,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:53,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:53,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:53,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:53,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:53,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:53,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:53,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:53,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:53,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:53,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:53,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:53,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:53,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:53,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:31:56,562 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:31:56,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:56,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:56,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:56,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:56,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:56,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:56,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:56,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:56,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:56,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:56,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:56,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:56,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:56,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:56,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:56,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:57,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:57,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:57,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:57,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:57,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:57,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:57,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:57,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:57,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:57,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:57,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:57,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:57,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:57,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:57,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:57,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:57,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:57,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:57,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:57,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:57,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:57,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:57,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:57,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:57,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:57,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:57,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:57,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:57,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:57,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:57,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:31:57,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:00,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:00,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:00,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:00,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:00,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:00,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:00,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:00,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:00,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:00,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:00,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:00,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:00,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:00,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:00,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:00,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:00,563 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:32:02,450 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:32:02,564 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:32:04,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:04,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:04,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:04,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:04,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:04,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:04,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:04,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:04,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:04,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:04,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:04,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:04,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:04,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:04,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:04,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:05,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:32:05,366 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:32:06,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:32:07,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:07,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:07,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:07,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:07,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:07,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:07,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:07,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:07,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:07,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:07,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:07,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:07,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:07,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:07,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:07,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:07,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:07,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:07,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:07,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:07,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:07,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:07,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:07,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:07,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:07,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:07,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:07,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:07,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:07,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:07,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:07,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:08,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:32:09,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:09,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:09,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:09,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:09,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:09,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:09,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:09,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:09,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:09,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:09,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:09,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:09,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:09,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:09,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:09,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:09,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:09,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:09,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:09,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:09,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:09,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:09,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:09,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:09,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:09,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:09,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:09,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:09,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:09,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:09,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:09,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:10,567 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:32:12,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:12,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:12,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:12,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:12,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:12,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:12,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:12,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:12,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:12,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:12,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:12,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:12,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:12,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:12,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:12,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:12,568 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:32:16,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:16,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:16,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:16,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:16,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:16,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:16,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:16,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:16,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:16,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:16,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:16,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:16,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:16,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:16,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:16,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:16,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:16,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:16,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:16,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:16,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:16,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:16,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:16,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:16,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:16,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:16,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:16,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:16,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:16,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:16,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:16,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:16,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:32:18,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:18,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:18,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:18,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:18,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:18,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:18,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:18,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:18,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:18,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:18,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:18,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:18,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:18,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:18,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:18,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:18,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:32:20,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:32:20,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:32:20,598 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:32:22,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:32:24,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:32:28,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:32:29,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:29,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:29,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:29,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:29,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:29,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:29,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:29,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:29,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:29,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:29,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:29,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:29,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:29,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:29,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:29,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:30,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:32:32,518 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:32:34,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:32:35,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:32:35,824 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:32:36,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:32:37,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:37,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:37,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:37,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:37,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:37,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:37,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:37,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:37,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:37,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:37,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:37,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:37,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:37,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:37,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:37,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:37,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:37,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:37,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:37,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:37,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:37,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:37,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:37,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:37,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:37,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:37,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:37,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:37,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:37,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:37,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:37,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:38,578 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:32:38,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:38,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:38,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:38,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:38,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:38,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:38,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:38,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:38,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:38,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:38,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:38,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:38,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:38,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:38,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:38,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:40,579 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:32:42,579 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:32:44,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:44,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:44,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:44,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:44,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:44,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:44,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:44,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:44,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:44,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:44,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:44,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:44,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:44,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:44,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:44,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:44,580 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:32:46,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:32:47,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:47,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:47,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:47,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:47,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:47,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:47,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:47,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:47,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:47,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:47,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:47,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:47,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:47,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:47,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:47,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:47,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:47,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:47,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:47,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:47,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:47,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:47,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:47,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:47,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:47,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:47,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:47,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:47,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:47,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:47,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:47,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:48,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:32:50,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:32:50,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:50,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:50,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:50,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:50,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:50,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:50,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:50,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:50,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:50,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:50,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:50,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:50,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:50,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:50,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:50,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:32:51,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:32:51,117 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:32:52,583 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:32:54,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:32:56,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:32:58,585 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:33:00,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:33:01,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:01,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:01,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:01,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:01,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:01,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:01,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:01,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:01,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:01,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:01,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:01,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:01,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:01,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:01,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:01,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:01,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:01,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:01,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:01,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:02,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:02,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:02,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:02,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:02,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:02,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:02,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:02,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:02,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:02,304 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 23:33:02,543 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 23:33:02,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 23:33:02,651 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:33:02,652 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 23:33:02,657 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:33:03,651 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 23:33:03,651 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:33:04,651 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:33:06,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:33:06,357 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:33:06,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:06,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:06,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:06,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:06,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:06,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:06,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:06,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:07,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:07,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:07,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:07,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:07,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:07,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:07,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:07,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:12,654 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:33:15,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:15,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:15,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:15,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:15,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:15,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:15,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:15,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:15,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:15,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:15,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:15,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:15,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:15,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:15,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:15,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:18,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:33:21,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:33:21,717 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:33:22,658 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:33:24,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:24,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:24,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:24,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:24,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:24,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:24,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:24,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:24,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:24,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:25,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:25,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:25,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:25,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:25,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:25,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:26,660 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:33:28,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:28,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:28,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:28,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:28,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:28,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:28,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:28,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:28,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:28,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:28,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:28,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:28,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:28,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:28,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:28,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:28,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:28,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:28,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:28,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:28,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:28,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:28,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:28,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:28,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:28,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:28,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:28,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:28,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:28,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:28,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:28,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:30,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:30,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:30,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:30,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:30,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:30,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:30,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:30,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:30,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:30,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:30,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:30,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:30,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:30,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:30,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:30,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:30,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:30,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:30,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:30,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:30,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:30,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:30,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:30,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:30,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:30,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:30,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:30,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:30,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:30,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:30,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:30,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:30,661 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:33:32,727 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:33:33,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:33,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:33,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:33,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:33,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:33,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:33,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:33,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:33,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:33,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:33,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:33,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:33,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:33,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:33,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:33,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:35,663 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:33:35,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:35,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:35,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:35,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:35,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:35,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:35,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:35,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:35,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:35,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:35,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:35,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:35,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:35,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:35,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:35,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:36,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:36,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:36,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:36,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:36,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:36,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:36,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:36,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:36,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:36,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:36,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:36,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:36,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:36,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:36,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:36,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:36,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:33:36,980 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:33:37,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:37,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:37,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:37,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:37,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:37,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:37,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:37,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:37,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:37,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:37,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:37,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:37,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:37,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:37,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:37,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:37,663 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:33:41,665 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:33:43,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:43,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:43,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:43,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:43,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:43,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:43,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:43,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:43,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:43,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:43,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:43,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:43,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:43,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:43,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:43,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:44,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:44,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:44,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:44,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:44,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:44,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:44,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:44,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:44,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:44,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:44,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:44,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:44,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:44,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:44,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:44,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:45,666 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:33:46,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:46,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:46,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:46,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:46,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:46,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:46,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:46,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:46,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:46,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:46,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:46,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:46,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:46,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:46,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:46,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:49,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:49,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:49,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:49,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:49,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:49,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:49,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:49,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:49,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:49,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:49,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:49,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:49,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:49,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:49,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:49,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:49,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:49,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:49,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:49,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:49,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:49,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:49,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:49,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:49,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:49,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:49,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:49,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:49,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:49,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:49,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:49,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:49,668 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:33:50,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:50,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:50,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:50,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:50,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:50,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:50,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:50,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:50,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:50,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:50,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:50,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:50,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:50,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:50,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:50,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:51,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:51,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:51,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:51,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:51,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:51,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:51,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:51,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:51,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:51,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:51,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:51,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:51,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:51,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:51,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:51,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:51,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:33:52,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:33:52,208 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:33:52,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:52,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:52,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:52,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:52,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:52,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:52,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:52,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:52,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:52,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:52,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:52,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:52,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:52,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:52,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:52,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:53,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:53,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:53,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:53,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:53,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:53,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:53,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:53,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:53,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:53,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:53,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:53,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:53,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:53,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:53,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:53,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:55,670 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:33:57,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:57,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:57,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:57,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:57,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:57,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:57,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:57,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:57,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:57,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:57,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:57,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:57,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:57,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:57,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:57,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:57,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:57,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:57,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:57,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:57,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:57,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:57,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:57,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:57,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:57,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:57,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:57,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:57,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:57,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:57,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:57,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:57,671 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:33:58,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:58,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:58,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:58,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:58,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:58,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:58,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:58,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:58,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:58,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:58,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:58,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:58,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:58,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:58,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:58,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:58,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:58,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:58,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:58,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:58,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:58,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:58,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:58,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:58,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:58,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:58,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:58,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:58,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:58,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:58,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:58,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:59,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:59,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:59,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:59,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:59,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:59,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:59,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:59,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:59,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:59,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:59,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:59,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:59,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:59,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:59,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:33:59,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:01,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:01,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:01,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:01,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:01,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:01,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:01,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:01,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:01,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:01,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:01,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:01,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:01,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:01,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:01,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:01,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:01,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:34:02,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:02,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:02,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:02,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:02,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:02,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:02,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:02,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:02,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:02,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:02,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:02,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:02,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:02,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:02,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:02,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:02,804 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:34:03,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:03,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:03,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:03,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:03,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:03,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:03,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:03,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:03,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:03,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:03,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:03,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:03,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:03,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:03,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:03,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:03,674 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:34:05,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:05,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:05,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:05,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:05,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:05,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:05,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:05,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:05,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:05,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:05,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:05,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:05,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:05,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:05,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:05,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:05,675 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:34:07,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:34:07,436 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:34:07,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:07,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:07,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:07,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:07,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:07,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:07,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:07,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:07,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:07,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:07,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:07,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:07,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:07,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:07,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:07,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:08,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:08,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:08,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:08,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:08,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:08,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:08,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:08,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:08,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:08,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:08,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:08,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:08,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:08,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:08,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:08,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:09,676 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:34:11,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:11,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:11,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:11,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:11,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:11,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:11,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:11,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:11,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:11,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:11,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:11,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:11,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:11,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:11,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:11,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:11,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:34:13,678 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:34:14,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:14,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:14,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:14,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:14,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:14,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:14,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:14,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:14,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:14,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:14,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:14,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:14,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:14,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:14,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:14,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:15,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:34:16,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:16,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:16,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:16,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:16,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:16,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:16,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:16,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:16,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:16,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:16,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:16,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:16,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:16,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:16,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:16,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:19,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:34:19,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:19,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:19,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:19,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:19,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:19,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:19,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:19,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:19,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:19,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:19,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:19,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:19,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:19,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:19,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:19,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:21,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:21,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:21,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:21,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:21,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:21,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:21,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:21,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:21,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:21,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:21,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:21,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:21,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:21,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:21,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:21,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:21,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:34:22,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:34:22,728 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:34:23,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:23,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:23,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:23,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:23,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:23,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:23,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:23,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:23,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:23,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:23,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:23,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:23,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:23,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:23,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:23,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:23,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:23,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:23,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:23,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:23,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:23,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:23,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:23,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:23,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:23,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:23,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:23,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:23,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:23,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:23,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:23,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:23,683 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:34:24,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:24,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:24,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:24,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:24,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:24,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:24,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:24,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:24,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:24,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:24,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:24,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:24,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:24,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:24,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:24,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:25,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:34:27,685 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:34:29,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:34:31,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:34:32,881 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:34:33,687 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:34:35,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:34:36,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:36,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:36,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:36,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:36,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:36,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:36,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:36,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:36,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:36,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:36,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:36,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:36,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:36,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:36,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:36,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:37,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:34:37,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:34:37,956 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:34:39,689 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:34:40,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:40,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:40,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:40,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:40,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:40,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:40,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:40,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:40,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:40,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:40,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:40,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:40,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:40,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:40,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:40,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:41,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:41,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:41,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:41,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:41,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:41,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:41,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:41,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:41,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:41,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:41,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:41,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:41,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:41,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:41,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:41,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:41,690 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:34:42,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:42,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:42,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:42,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:42,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:42,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:42,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:42,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:42,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:42,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:42,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:42,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:42,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:42,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:42,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:42,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:43,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:34:45,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:34:47,692 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:34:49,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:49,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:49,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:49,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:49,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:49,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:49,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:49,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:49,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:49,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:49,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:49,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:49,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:49,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:49,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:49,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:49,693 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:34:50,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:50,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:50,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:50,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:50,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:50,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:50,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:50,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:50,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:50,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:50,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:50,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:50,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:50,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:50,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:50,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:51,693 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:34:52,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:52,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:52,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:52,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:52,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:52,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:52,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:52,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:52,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:52,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:52,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:52,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:52,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:52,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:52,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:52,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:52,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:52,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:52,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:52,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:52,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:52,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:52,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:52,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:52,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:52,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:52,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:52,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:52,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:52,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:52,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:52,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:34:53,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:34:53,240 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:34:53,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:34:55,695 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:34:57,696 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:34:59,696 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:35:01,697 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:35:01,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:01,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:01,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:01,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:01,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:01,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:01,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:01,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:01,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:01,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:01,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:01,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:01,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:01,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:01,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:01,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:01,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:01,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:01,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:01,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:01,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:01,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:01,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:01,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:01,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:01,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:01,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:01,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:02,946 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:35:03,698 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:35:08,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:35:08,614 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:35:11,701 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:35:17,703 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:35:20,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:20,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:20,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:20,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:20,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:20,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:20,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:20,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:20,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:20,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:20,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:20,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:20,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:20,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:20,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:20,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:20,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:20,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:20,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:20,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:20,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:20,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:20,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:20,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:20,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:20,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:20,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:20,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:20,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:20,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:20,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:20,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:24,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:35:24,012 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:35:24,706 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:35:28,708 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:35:32,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:32,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:32,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:32,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:32,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:32,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:32,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:32,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:32,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:32,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:32,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:32,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:32,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:32,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:32,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:32,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:32,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:35:33,019 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:35:33,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:33,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:33,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:33,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:33,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:33,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:33,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:33,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:33,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:33,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:33,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:33,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:33,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:33,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:33,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:33,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:34,710 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:35:38,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:38,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:38,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:38,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:38,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:38,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:38,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:38,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:38,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:38,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:38,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:38,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:38,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:38,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:38,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:38,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:38,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:38,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:38,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:38,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:38,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:38,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:38,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:38,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:38,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:38,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:38,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:38,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:38,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:38,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:38,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:38,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:38,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:35:39,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:35:39,381 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:35:39,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:39,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:39,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:39,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:39,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:39,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:39,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:39,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:39,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:39,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:39,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:39,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:39,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:39,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:39,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:39,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:40,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:40,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:40,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:40,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:40,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:40,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:40,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:40,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:40,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:40,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:40,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:40,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:40,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:40,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:40,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:40,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:42,713 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:35:46,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:46,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:46,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:46,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:46,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:46,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:46,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:46,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:46,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:46,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:46,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:46,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:46,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:46,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:46,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:46,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:46,715 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:35:47,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:47,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:47,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:47,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:47,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:47,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:47,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:47,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:47,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:47,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:47,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:47,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:47,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:47,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:47,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:47,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:47,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:47,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:47,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:47,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:47,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:47,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:47,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:47,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:47,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:47,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:47,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:47,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:47,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:47,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:47,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:47,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:48,716 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:35:52,717 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:35:54,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:35:54,608 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:35:54,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,719 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:35:54,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:54,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:55,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:55,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:55,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:55,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:55,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:55,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:55,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:55,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:55,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:55,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:55,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:55,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:55,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:55,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:55,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:55,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:55,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:55,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:55,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:55,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:55,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:55,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:55,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:55,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:55,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:55,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:55,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:55,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:55,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:55,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:55,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:55,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:56,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:56,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:56,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:56,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:56,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:56,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:56,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:56,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:56,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:56,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:56,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:56,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:56,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:56,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:56,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:56,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:56,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:56,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:56,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:56,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:56,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:56,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:56,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:56,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:56,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:56,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:56,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:56,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:56,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:56,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:56,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:56,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:58,720 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:35:58,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:58,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:58,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:58,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:58,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:58,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:58,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:58,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:58,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:58,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:58,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:58,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:58,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:58,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:58,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:35:58,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:00,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:36:00,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:00,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:00,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:00,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:00,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:00,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:00,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:00,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:00,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:00,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:00,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:00,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:00,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:00,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:00,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:00,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:01,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:01,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:01,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:01,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:01,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:01,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:01,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:01,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:01,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:01,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:01,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:01,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:01,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:01,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:01,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:01,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:03,095 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:36:03,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:03,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:03,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:03,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:03,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:03,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:03,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:03,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:03,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:03,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:03,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:03,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:03,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:03,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:03,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:03,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:04,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:04,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:04,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:04,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:04,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:04,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:04,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:04,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:04,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:04,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:04,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:04,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:04,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:04,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:04,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:04,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:04,723 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:36:06,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:06,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:06,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:06,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:06,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:06,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:06,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:06,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:06,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:06,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:06,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:06,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:06,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:06,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:06,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:06,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:06,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:06,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:06,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:06,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:06,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:06,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:06,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:06,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:06,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:06,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:06,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:06,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:06,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:06,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:06,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:06,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:06,724 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:36:08,725 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:36:09,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:09,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:09,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:09,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:09,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:09,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:09,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:09,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:09,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:09,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:09,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:09,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:09,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:09,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:09,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:09,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:09,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:36:09,860 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:36:12,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:12,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:12,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:12,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:12,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:12,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:12,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:12,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:12,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:12,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:12,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:12,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:12,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:12,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:12,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:12,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:12,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:12,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:12,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:12,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:12,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:12,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:12,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:12,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:12,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:12,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:12,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:12,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:12,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:12,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:12,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:12,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:12,726 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:36:13,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:13,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:13,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:13,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:13,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:13,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:13,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:13,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:13,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:13,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:13,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:13,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:13,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:13,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:13,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:13,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:14,727 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:36:14,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:14,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:14,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:14,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:14,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:14,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:14,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:14,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:14,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:14,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:14,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:14,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:14,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:14,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:14,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:14,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:16,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:36:16,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:16,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:16,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:16,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:16,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:16,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:16,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:16,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:16,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:16,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:16,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:16,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:16,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:16,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:16,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:16,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:18,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:18,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:18,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:18,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:18,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:18,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:18,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:18,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:18,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:18,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:18,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:18,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:18,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:18,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:18,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:18,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:18,729 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:36:19,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:19,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:19,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:19,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:19,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:19,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:19,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:19,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:19,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:19,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:19,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:19,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:19,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:19,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:19,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:19,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:19,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:19,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:19,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:19,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:19,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:19,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:19,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:19,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:19,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:19,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:19,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:19,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:19,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:19,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:19,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:19,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:20,730 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:36:22,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:22,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:22,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:22,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:22,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:22,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:22,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:22,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:22,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:22,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:22,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:22,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:22,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:22,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:22,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:22,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:22,731 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:36:24,732 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:36:25,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:36:25,087 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:36:27,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:27,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:27,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:27,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:27,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:27,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:27,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:27,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:27,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:27,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:27,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:27,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:27,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:27,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:27,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:27,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:28,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:28,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:28,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:28,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:28,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:28,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:28,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:28,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:28,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:28,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:28,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:28,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:28,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:28,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:28,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:28,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:28,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:28,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:28,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:28,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:28,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:28,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:28,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:28,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:28,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:28,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:28,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:28,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:28,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:28,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:28,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:28,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:29,734 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:36:31,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:31,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:31,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:31,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:31,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:31,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:31,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:31,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:31,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:31,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:31,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:31,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:31,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:31,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:31,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:31,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:31,735 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:36:33,170 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:36:33,736 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:36:35,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:36:37,738 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:36:39,739 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:36:40,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:40,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:40,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:40,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:40,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:40,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:40,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:40,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:40,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:40,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:40,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:40,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:40,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:40,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:40,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:40,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:40,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:36:40,310 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:36:41,740 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:36:43,741 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:36:43,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:43,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:43,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:43,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:43,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:43,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:43,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:43,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:43,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:43,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:43,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:43,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:43,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:43,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:43,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:43,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:44,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:44,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:44,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:44,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:44,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:44,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:44,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:44,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:44,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:44,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:44,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:44,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:44,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:44,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:44,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:44,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:44,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:44,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:44,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:44,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:44,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:44,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:44,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:44,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:44,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:44,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:44,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:44,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:44,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:44,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:44,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:44,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:45,742 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:36:47,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:36:49,744 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:36:51,745 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:36:52,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:52,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:52,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:52,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:52,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:52,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:52,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:52,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:52,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:52,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:52,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:52,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:52,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:52,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:52,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:52,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:52,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:52,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:52,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:52,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:52,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:52,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:52,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:52,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:52,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:52,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:52,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:52,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:52,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:52,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:52,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:52,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:53,746 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:36:54,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:54,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:54,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:54,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:54,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:54,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:54,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:54,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:54,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:54,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:54,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:54,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:54,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:54,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:54,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:54,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:55,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:36:55,555 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:36:55,747 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:36:56,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:56,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:56,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:56,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:56,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:56,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:56,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:56,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:56,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:56,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:56,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:56,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:56,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:56,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:56,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:56,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:36:57,748 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:36:59,749 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:37:01,750 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:37:02,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:02,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:02,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:02,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:02,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:02,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:02,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:02,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:02,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:02,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:02,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:02,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:02,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:02,514 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 23:37:02,741 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 23:37:02,814 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:37:02,815 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 23:37:03,318 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:37:03,814 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 23:37:03,814 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:37:10,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:37:10,796 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:37:13,817 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:37:17,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:37:18,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:18,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:18,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:18,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:18,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:18,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:18,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:18,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:18,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:18,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:18,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:18,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:18,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:18,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:18,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:18,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:21,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:37:25,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:37:26,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:37:26,026 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:37:27,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:27,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:27,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:27,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:27,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:27,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:27,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:27,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:27,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:27,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:27,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:27,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:27,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:27,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:27,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:27,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:29,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:37:33,393 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:37:33,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:33,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:33,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:33,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:33,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:33,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:33,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:33,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:33,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:33,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:33,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:33,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:33,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:33,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:33,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:33,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:33,826 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:37:34,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:34,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:34,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:34,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:34,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:34,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:34,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:34,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:34,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:34,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:34,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:34,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:34,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:34,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:34,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:34,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:37,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:37,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:37,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:37,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:37,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:37,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:37,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:37,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:37,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:37,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:37,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:37,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:37,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:37,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:37,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:37,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:37,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:37:40,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:40,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:40,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:40,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:40,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:40,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:40,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:40,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:40,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:40,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:40,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:40,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:40,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:40,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:40,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:40,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:41,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:37:41,260 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:37:41,829 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:37:41,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:41,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:41,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:41,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:41,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:41,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:41,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:41,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:41,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:41,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:42,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:42,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:42,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:42,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:42,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:42,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:43,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:43,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:43,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:43,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:43,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:43,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:43,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:43,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:43,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:43,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:43,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:43,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:43,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:43,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:43,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:43,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:43,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:37:47,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:37:49,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:49,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:49,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:49,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:49,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:49,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:49,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:49,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:49,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:49,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:49,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:49,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:49,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:49,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:49,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:49,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:49,833 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:37:50,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:50,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:50,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:50,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:50,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:50,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:50,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:50,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:50,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:50,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:50,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:50,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:50,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:50,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:50,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:50,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:52,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:52,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:52,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:52,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:52,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:52,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:52,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:52,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:52,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:52,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:52,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:52,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:52,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:52,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:52,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:52,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:53,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:37:54,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:54,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:54,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:54,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:54,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:54,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:54,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:54,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:54,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:54,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:54,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:54,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:54,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:54,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:54,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:54,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:55,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:55,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:55,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:55,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:55,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:55,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:55,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:55,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:55,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:55,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:55,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:55,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:55,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:55,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:55,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:55,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:55,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:37:56,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:37:56,509 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:37:58,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:58,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:58,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:58,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:58,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:58,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:58,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:58,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:58,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:58,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:58,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:58,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:58,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:58,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:58,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:58,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:58,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:58,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:58,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:58,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:58,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:58,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:58,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:58,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:58,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:58,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:58,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:58,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:58,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:58,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:58,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:58,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:37:59,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:37:59,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:00,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:00,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:00,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:00,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:00,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:00,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:00,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:00,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:00,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:00,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:00,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:00,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:00,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:00,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:00,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:00,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:01,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:01,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:01,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:01,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:01,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:01,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:01,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:01,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:01,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:01,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:01,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:01,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:01,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:01,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:01,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:01,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:01,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:38:03,469 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:38:03,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:03,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:03,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:03,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:03,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:03,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:03,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:03,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:03,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:03,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:03,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:03,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:03,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:03,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:03,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:03,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:03,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:38:04,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:04,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:04,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:04,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:04,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:04,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:04,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:04,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:04,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:04,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:04,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:04,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:04,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:04,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:04,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:04,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:07,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:07,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:07,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:07,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:07,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:07,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:07,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:07,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:07,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:07,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:07,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:07,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:07,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:07,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:07,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:07,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:07,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:07,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:07,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:07,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:07,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:07,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:07,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:07,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:07,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:07,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:07,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:07,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:07,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:07,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:07,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:07,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:07,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:38:08,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:08,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:08,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:08,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:08,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:08,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:08,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:08,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:08,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:08,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:08,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:08,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:08,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:08,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:08,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:08,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:09,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:09,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:09,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:09,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:09,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:09,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:09,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:09,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:09,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:09,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:09,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:09,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:09,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:09,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:09,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:09,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:09,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:38:11,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:38:11,791 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:38:11,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:38:13,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:38:14,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:14,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:14,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:14,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:14,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:14,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:14,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:14,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:14,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:14,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:14,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:14,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:14,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:14,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:14,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:14,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:15,846 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:38:15,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:15,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:15,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:15,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:15,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:15,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:15,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:15,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:15,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:15,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:15,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:15,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:15,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:15,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:15,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:15,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:16,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:16,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:16,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:16,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:16,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:16,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:16,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:16,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:16,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:16,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:16,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:16,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:16,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:16,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:16,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:16,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:17,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:38:17,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:17,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:17,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:17,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:17,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:17,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:17,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:17,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:17,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:17,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:17,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:17,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:17,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:17,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:17,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:17,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:18,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:18,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:18,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:18,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:18,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:18,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:18,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:18,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:18,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:18,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:18,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:18,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:18,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:18,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:18,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:18,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:19,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:19,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:19,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:19,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:19,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:19,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:19,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:19,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:19,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:19,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:19,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:19,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:19,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:19,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:19,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:19,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:19,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:19,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:19,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:19,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:19,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:19,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:19,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:19,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:19,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:19,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:19,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:19,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:19,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:19,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:19,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:19,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:20,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:20,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:20,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:20,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:20,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:20,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:20,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:20,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:20,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:20,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:20,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:20,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:20,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:20,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:20,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:20,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:21,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:21,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:21,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:21,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:21,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:21,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:21,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:21,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:21,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:21,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:21,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:21,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:21,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:21,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:21,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:21,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:21,849 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:38:23,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:23,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:23,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:23,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:23,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:23,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:23,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:23,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:23,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:23,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:23,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:23,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:23,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:23,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:23,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:23,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:23,850 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:38:26,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:38:27,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:38:27,019 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:38:28,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:28,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:28,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:28,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:28,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:28,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:28,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:28,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:28,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:28,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:28,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:28,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:28,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:28,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:28,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:28,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:28,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:28,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:28,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:28,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:28,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:28,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:28,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:28,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:28,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:28,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:28,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:28,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:28,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:28,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:28,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:28,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:28,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:38:30,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:38:32,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:32,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:32,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:32,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:32,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:32,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:32,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:32,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:32,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:32,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:32,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:32,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:32,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:32,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:32,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:32,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:32,854 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:38:33,546 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:38:34,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:38:34,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:34,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:34,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:34,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:34,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:34,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:34,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:34,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:34,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:34,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:34,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:34,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:34,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:34,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:34,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:34,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:36,856 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:38:38,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:38:40,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:38:42,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:42,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:42,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:42,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:42,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:42,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:42,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:42,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:42,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:42,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:42,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:42,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:42,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:42,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:42,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:42,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:42,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:38:42,246 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:38:42,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:38:43,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:43,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:43,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:43,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:43,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:43,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:43,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:43,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:43,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:43,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:43,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:43,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:43,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:43,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:43,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:43,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:44,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:38:45,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:45,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:45,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:45,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:45,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:45,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:45,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:45,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:45,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:45,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:45,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:45,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:45,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:45,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:45,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:45,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:45,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:45,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:45,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:45,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:45,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:45,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:45,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:45,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:45,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:45,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:45,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:45,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:45,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:45,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:45,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:45,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:46,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:38:48,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:38:50,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:38:52,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:52,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:52,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:52,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:52,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:52,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:52,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:52,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:52,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:52,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:52,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:52,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:52,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:52,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:52,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:52,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:52,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:52,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:52,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:52,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:52,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:52,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:52,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:52,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:52,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:52,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:52,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:52,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:52,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:52,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:52,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:52,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:52,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:38:53,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:53,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:53,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:53,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:53,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:53,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:53,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:53,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:53,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:53,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:53,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:53,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:53,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:53,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:53,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:53,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:53,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:53,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:53,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:53,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:53,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:53,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:53,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:53,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:53,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:53,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:53,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:53,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:53,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:53,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:53,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:53,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:54,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:38:56,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:38:57,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:38:57,557 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:38:58,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:58,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:58,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:58,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:58,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:58,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:58,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:58,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:58,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:58,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:58,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:58,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:38:58,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:39:00,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:39:03,621 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:39:10,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:39:12,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:39:12,911 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:39:14,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:39:20,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:39:22,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:22,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:22,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:22,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:22,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:22,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:22,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:22,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:22,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:22,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:22,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:22,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:22,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:22,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:22,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:22,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:24,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:39:28,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:39:28,145 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:39:28,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:39:30,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:39:31,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:31,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:31,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:31,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:31,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:31,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:31,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:31,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:31,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:31,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:31,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:31,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:31,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:31,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:31,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:31,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:33,695 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:39:34,882 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:39:36,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:36,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:36,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:36,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:36,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:36,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:36,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:36,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:36,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:36,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:36,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:36,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:36,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:36,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:36,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:36,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:38,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:38,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:38,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:38,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:38,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:38,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:38,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:38,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:38,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:38,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:38,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:38,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:38,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:38,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:38,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:38,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:38,883 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:39:42,885 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:39:43,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:39:43,633 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:39:44,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:39:45,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:45,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:45,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:45,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:45,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:45,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:45,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:45,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:45,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:45,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:45,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:45,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:45,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:45,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:45,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:45,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:48,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:48,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:48,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:48,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:48,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:48,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:48,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:48,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:48,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:48,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:48,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:48,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:48,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:48,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:48,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:48,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:48,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:39:49,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:49,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:49,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:49,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:49,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:49,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:49,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:49,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:49,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:49,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:49,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:49,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:49,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:49,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:49,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:49,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:50,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:50,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:50,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:50,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:50,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:50,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:50,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:50,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:50,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:50,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:50,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:50,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:50,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:50,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:50,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:50,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:50,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:39:51,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:51,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:51,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:51,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:51,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:51,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:51,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:51,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:51,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:51,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:51,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:51,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:51,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:51,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:51,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:51,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:54,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:54,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:54,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:54,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:54,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:54,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:54,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:54,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:54,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:54,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:54,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:54,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:54,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:54,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:54,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:54,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:54,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:39:56,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:56,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:56,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:56,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:56,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:56,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:56,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:56,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:56,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:56,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:56,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:56,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:56,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:56,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:56,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:56,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:56,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:56,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:56,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:56,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:56,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:56,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:56,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:56,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:56,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:56,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:56,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:56,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:56,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:56,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:56,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:56,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:56,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:39:58,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:39:58,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:39:58,973 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:39:59,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:59,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:59,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:59,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:59,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:59,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:59,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:59,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:59,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:59,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:59,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:59,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:59,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:59,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:59,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:39:59,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:00,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:00,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:00,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:00,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:00,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:00,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:00,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:00,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:00,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:00,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:00,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:00,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:00,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:00,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:00,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:00,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:01,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:01,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:01,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:01,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:01,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:01,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:01,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:01,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:01,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:01,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:01,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:01,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:01,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:01,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:01,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:01,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:02,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:02,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:02,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:02,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:02,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:02,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:02,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:02,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:02,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:02,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:02,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:02,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:02,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:02,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:02,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:02,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:02,894 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:40:03,765 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:40:04,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:04,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:04,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:04,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:04,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:04,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:04,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:04,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:04,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:04,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:04,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:04,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:04,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:04,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:04,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:04,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:04,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:40:05,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:05,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:07,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:07,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:07,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:07,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:07,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:07,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:07,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:07,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:07,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:07,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:07,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:07,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:07,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:07,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:07,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:07,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:08,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:40:09,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:09,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:09,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:09,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:09,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:09,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:09,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:09,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:09,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:09,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:09,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:09,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:09,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:09,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:09,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:09,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:09,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:09,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:09,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:09,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:09,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:09,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:09,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:09,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:09,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:09,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:09,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:09,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:09,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:09,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:09,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:09,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:10,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:10,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:10,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:10,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:10,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:10,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:10,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:10,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:10,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:10,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:10,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:10,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:10,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:10,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:10,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:10,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:10,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:40:12,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:40:13,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:13,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:13,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:13,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:13,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:13,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:13,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:13,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:13,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:13,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:13,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:13,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:13,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:13,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:13,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:13,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:14,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:40:14,193 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:40:14,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:14,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:14,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:14,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:14,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:14,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:14,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:14,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:14,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:14,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:14,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:14,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:14,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:14,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:14,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:14,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:14,900 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:40:15,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:15,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:15,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:15,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:15,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:15,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:15,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:15,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:15,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:15,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:15,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:15,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:15,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:15,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:15,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:15,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:16,901 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:40:17,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:17,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:17,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:17,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:17,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:17,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:17,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:17,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:17,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:17,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:17,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:17,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:17,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:17,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:17,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:17,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:18,902 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:40:20,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:20,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:20,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:20,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:20,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:20,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:20,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:20,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:20,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:20,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:20,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:20,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:20,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:20,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:20,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:20,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:21,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:21,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:21,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:21,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:21,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:21,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:21,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:21,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:21,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:21,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:21,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:21,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:21,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:21,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:21,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:21,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:22,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:23,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:23,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:23,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:23,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:23,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:23,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:23,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:23,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:23,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:23,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:23,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:23,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:23,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:23,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:23,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:23,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:23,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:23,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:23,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:23,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:23,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:23,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:23,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:23,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:23,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:23,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:23,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:23,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:23,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:23,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:23,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:23,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:23,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:40:24,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:24,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:24,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:24,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:24,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:24,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:24,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:24,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:24,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:24,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:24,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:24,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:24,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:24,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:24,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:24,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:25,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:40:27,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:40:29,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:40:29,408 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:40:29,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:40:31,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:40:32,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:32,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:32,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:32,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:32,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:32,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:32,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:32,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:32,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:32,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:32,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:32,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:32,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:32,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:32,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:32,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:33,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:33,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:33,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:33,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:33,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:33,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:33,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:33,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:33,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:33,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:33,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:33,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:33,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:33,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:33,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:33,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:33,840 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:40:33,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:40:34,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:34,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:34,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:34,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:34,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:34,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:34,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:34,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:34,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:34,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:34,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:34,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:34,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:34,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:34,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:34,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:35,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:40:37,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:40:39,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:40:40,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:40,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:40,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:40,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:40,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:40,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:40,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:40,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:40,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:40,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:40,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:40,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:40,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:40,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:40,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:40,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:41,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:40:43,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:43,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:43,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:43,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:43,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:43,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:43,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:43,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:43,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:43,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:43,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:43,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:43,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:43,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:43,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:43,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:43,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:40:44,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:40:44,680 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:40:45,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:40:46,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:46,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:46,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:46,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:46,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:46,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:46,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:46,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:46,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:46,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:46,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:46,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:46,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:46,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:46,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:46,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:47,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:40:48,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:48,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:48,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:48,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:48,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:48,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:48,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:48,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:48,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:48,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:48,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:48,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:48,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:48,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:48,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:48,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:48,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:48,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:48,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:48,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:48,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:48,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:48,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:48,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:48,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:48,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:48,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:48,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:48,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:48,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:48,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:48,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:49,916 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:40:51,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:40:53,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:40:54,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:54,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:54,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:54,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:54,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:54,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:54,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:54,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:54,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:54,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:54,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:54,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:54,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:54,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:54,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:54,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:54,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:54,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:54,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:54,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:54,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:54,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:54,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:54,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:54,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:54,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:54,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:54,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:54,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:54,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:54,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:54,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:55,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:55,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:55,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:55,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:55,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:55,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:55,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:55,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:55,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:55,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:55,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:55,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:55,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:55,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:55,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:55,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:55,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:40:57,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:40:58,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:58,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:58,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:58,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:58,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:58,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:58,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:58,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:58,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:58,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:58,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:58,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:58,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:58,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:58,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:58,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:58,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:58,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:58,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:58,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:58,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:58,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:58,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:58,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:58,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:58,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:58,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:58,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:58,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:40:58,919 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 23:40:59,090 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 23:40:59,152 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 23:40:59,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:40:59,940 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:41:00,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 23:41:00,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:41:03,920 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:41:08,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:41:14,032 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:41:15,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:41:15,168 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:41:18,034 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:41:22,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:41:26,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:41:28,038 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:41:30,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:41:30,385 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:41:32,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:41:33,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:33,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:33,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:33,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:33,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:33,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:33,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:33,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:33,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:33,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:33,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:33,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:33,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:33,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:33,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:33,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:34,000 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:41:36,041 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:41:36,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:36,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:36,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:36,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:36,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:36,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:36,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:36,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:36,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:36,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:36,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:36,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:36,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:36,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:36,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:36,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:38,042 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:41:39,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:39,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:39,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:39,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:39,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:39,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:39,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:39,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:39,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:39,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:39,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:39,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:39,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:39,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:39,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:39,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:40,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:40,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:40,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:40,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:40,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:40,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:40,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:40,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:40,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:40,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:40,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:40,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:40,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:40,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:40,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:40,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:42,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:41:44,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:41:45,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:41:45,620 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:41:47,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:47,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:47,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:47,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:47,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:47,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:47,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:47,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:47,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:47,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:47,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:47,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:47,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:47,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:47,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:47,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:48,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:41:50,047 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:41:50,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:50,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:50,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:50,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:50,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:50,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:50,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:50,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:50,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:50,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:50,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:50,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:50,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:50,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:50,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:50,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:51,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:51,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:51,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:51,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:51,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:51,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:51,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:51,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:51,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:51,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:51,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:51,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:51,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:51,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:51,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:51,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:52,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:41:53,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:53,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:53,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:53,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:53,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:53,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:53,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:53,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:53,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:53,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:53,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:53,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:53,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:53,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:53,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:53,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:53,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:53,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:53,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:53,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:53,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:53,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:53,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:53,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:53,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:53,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:53,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:53,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:53,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:53,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:53,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:53,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:56,049 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:41:57,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:57,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:41:58,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:42:00,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:42:00,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:42:00,944 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:42:00,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:00,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:00,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:00,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:00,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:00,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:00,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:00,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:00,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:00,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:00,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:00,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:00,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:00,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:00,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:00,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:02,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:42:02,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:02,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:02,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:02,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:02,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:02,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:02,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:02,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:02,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:02,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:02,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:02,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:02,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:02,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:02,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:02,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:03,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:03,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:03,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:03,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:03,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:03,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:03,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:03,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:03,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:03,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:03,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:03,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:03,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:03,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:03,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:03,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:04,073 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:42:04,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:04,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:04,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:04,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:04,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:04,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:04,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:04,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:04,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:04,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:04,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:04,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:04,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:04,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:04,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:04,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:05,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:42:05,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:05,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:05,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:05,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:05,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:05,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:05,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:05,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:05,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:05,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:05,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:05,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:05,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:05,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:05,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:05,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:06,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:07,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:07,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:07,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:07,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:07,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:07,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:07,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:07,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:07,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:07,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:07,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:07,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:07,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:07,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:07,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:07,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:09,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:42:11,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:42:11,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:11,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:11,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:11,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:11,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:11,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:11,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:11,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:11,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:11,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:11,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:11,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:11,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:11,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:11,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:11,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:11,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:11,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:11,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:11,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:11,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:11,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:11,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:11,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:11,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:11,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:11,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:11,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:11,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:11,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:11,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:11,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:12,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:12,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:12,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:12,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:12,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:12,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:12,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:12,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:12,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:12,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:12,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:12,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:12,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:12,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:12,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:12,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:13,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:42:14,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:14,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:14,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:14,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:14,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:14,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:14,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:14,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:14,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:14,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:14,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:14,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:14,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:14,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:14,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:14,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:15,056 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:42:16,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:42:16,169 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:42:16,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:16,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:16,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:16,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:16,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:16,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:16,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:16,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:16,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:16,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:16,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:16,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:16,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:16,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:16,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:16,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:17,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:42:17,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:17,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:17,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:17,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:17,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:17,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:17,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:17,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:17,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:17,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:17,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:17,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:17,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:17,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:17,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:17,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:18,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:18,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:18,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:18,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:18,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:18,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:18,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:18,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:18,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:18,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:18,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:18,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:18,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:18,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:18,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:18,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:18,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:18,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:18,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:18,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:18,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:18,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:19,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:19,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:19,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:19,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:19,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:19,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:19,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:19,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:19,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:19,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:19,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:42:20,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:20,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:20,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:20,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:20,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:20,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:20,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:20,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:20,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:20,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:20,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:20,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:20,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:20,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:20,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:20,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:21,059 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:42:22,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:22,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:22,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:22,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:22,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:22,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:22,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:22,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:22,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:22,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:22,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:22,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:22,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:22,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:22,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:22,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:22,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:22,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:22,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:22,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:22,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:22,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:22,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:22,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:22,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:22,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:22,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:22,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:22,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:22,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:22,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:22,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:23,059 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:42:24,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:24,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:24,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:24,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:24,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:24,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:24,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:24,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:24,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:24,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:24,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:24,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:24,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:24,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:24,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:24,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:24,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:24,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:24,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:24,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:24,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:24,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:24,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:24,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:24,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:24,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:24,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:24,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:24,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:24,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:24,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:24,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:25,060 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:42:25,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:25,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:25,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:25,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:25,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:25,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:25,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:25,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:25,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:25,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:25,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:25,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:25,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:25,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:25,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:25,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:27,061 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:42:28,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:28,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:28,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:28,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:28,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:28,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:28,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:28,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:28,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:28,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:28,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:28,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:28,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:28,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:28,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:28,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:29,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:42:31,063 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:42:31,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:31,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:31,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:31,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:31,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:31,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:31,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:31,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:31,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:31,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:31,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:31,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:31,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:31,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:31,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:31,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:31,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:42:31,568 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:42:32,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:32,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:32,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:32,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:32,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:32,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:32,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:32,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:32,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:32,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:32,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:32,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:32,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:32,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:32,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:32,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:33,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:42:34,147 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:42:35,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:42:37,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:42:37,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:37,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:37,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:37,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:37,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:37,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:37,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:37,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:37,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:37,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:37,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:37,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:37,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:37,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:37,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:37,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:39,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:42:40,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:40,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:40,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:40,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:40,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:40,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:40,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:40,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:40,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:40,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:40,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:40,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:40,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:40,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:40,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:40,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:41,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:42:41,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:41,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:41,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:41,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:41,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:41,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:41,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:41,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:41,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:41,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:41,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:41,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:41,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:41,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:41,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:41,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:43,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:42:44,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:44,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:44,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:44,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:44,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:44,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:44,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:44,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:44,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:44,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:44,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:44,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:44,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:44,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:44,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:44,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:45,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:42:45,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:45,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:45,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:45,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:45,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:45,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:45,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:45,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:45,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:45,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:45,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:45,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:45,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:45,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:45,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:45,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:46,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:42:46,792 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:42:47,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:42:49,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:42:50,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:50,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:50,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:50,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:50,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:50,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:50,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:50,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:50,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:50,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:50,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:50,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:50,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:50,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:50,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:50,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:51,071 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:42:51,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:51,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:51,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:51,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:51,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:51,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:51,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:51,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:51,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:51,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:51,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:51,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:51,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:51,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:51,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:51,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:51,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:51,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:51,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:51,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:51,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:51,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:51,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:51,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:51,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:51,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:51,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:51,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:51,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:51,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:51,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:51,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:52,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:52,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:52,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:52,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:52,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:52,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:52,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:52,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:52,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:52,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:52,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:52,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:42:53,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:42:55,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:43:02,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:43:02,066 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:43:02,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:02,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:02,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:02,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:02,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:02,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:02,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:02,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:02,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:02,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:02,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:02,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:02,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:02,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:02,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:02,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:04,220 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:43:05,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:43:11,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:43:15,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:43:17,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:43:17,450 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:43:19,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:43:23,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:43:27,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:43:29,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:43:32,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:43:32,809 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:43:33,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:43:33,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:33,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:33,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:33,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:33,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:33,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:33,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:33,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:33,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:33,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:33,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:33,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:33,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:33,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:33,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:33,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:34,298 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:43:37,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:43:38,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:38,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:38,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:38,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:38,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:38,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:38,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:38,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:38,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:38,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:38,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:38,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:38,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:38,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:38,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:38,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:41,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:43:43,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:43:47,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:43:48,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:43:48,036 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:43:49,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:43:49,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:49,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:49,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:49,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:49,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:49,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:49,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:49,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:49,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:49,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:49,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:49,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:49,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:49,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:49,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:49,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:51,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:43:51,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:51,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:51,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:51,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:51,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:51,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:51,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:51,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:51,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:51,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:51,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:51,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:51,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:51,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:51,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:51,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:52,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:52,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:52,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:52,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:52,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:52,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:52,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:52,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:52,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:52,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:52,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:52,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:52,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:52,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:52,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:52,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:55,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:55,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:55,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:55,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:55,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:55,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:55,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:55,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:55,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:55,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:55,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:55,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:55,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:55,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:55,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:55,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:55,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:43:56,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:56,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:56,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:56,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:56,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:56,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:56,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:56,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:56,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:56,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:56,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:56,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:56,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:56,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:56,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:56,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:56,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:56,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:56,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:56,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:56,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:56,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:56,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:56,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:56,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:56,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:56,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:56,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:56,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:56,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:56,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:56,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:57,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:43:57,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:57,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:57,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:57,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:57,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:57,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:57,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:57,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:57,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:57,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:57,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:57,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:57,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:57,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:57,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:57,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:57,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:57,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:57,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:57,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:57,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:57,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:57,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:57,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:57,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:57,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:57,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:57,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:57,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:57,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:57,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:57,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:59,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:43:59,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:59,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:59,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:59,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:59,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:59,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:59,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:59,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:59,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:59,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:59,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:59,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:59,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:59,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:59,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:43:59,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:00,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:00,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:00,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:00,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:00,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:00,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:00,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:00,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:00,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:00,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:00,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:00,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:00,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:00,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:00,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:00,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:02,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:02,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:02,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:02,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:02,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:02,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:02,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:02,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:02,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:02,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:02,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:02,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:02,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:02,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:02,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:02,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:02,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:02,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:02,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:02,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:02,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:02,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:02,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:02,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:02,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:02,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:02,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:02,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:02,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:02,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:02,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:02,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:03,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:44:03,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:44:03,268 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:44:04,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:04,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:04,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:04,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:04,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:04,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:04,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:04,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:04,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:04,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:04,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:04,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:04,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:04,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:04,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:04,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:04,376 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:44:05,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:44:06,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:06,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:06,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:06,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:06,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:06,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:06,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:06,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:06,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:06,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:06,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:06,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:06,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:06,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:06,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:06,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:07,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:44:07,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:07,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:07,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:07,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:07,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:07,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:07,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:07,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:07,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:07,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:07,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:07,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:07,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:07,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:07,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:07,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:08,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:08,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:08,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:08,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:08,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:08,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:08,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:08,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:08,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:08,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:08,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:08,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:08,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:08,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:08,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:08,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:08,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:08,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:08,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:08,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:08,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:08,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:08,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:08,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:08,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:08,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:08,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:08,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:08,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:08,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:08,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:08,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:09,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:44:10,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:10,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:10,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:10,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:10,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:10,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:10,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:10,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:10,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:10,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:10,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:10,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:10,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:10,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:10,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:10,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:11,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:44:13,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:44:13,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:13,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:15,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:44:15,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:15,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:15,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:15,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:15,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:15,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:15,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:15,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:15,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:15,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:15,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:15,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:15,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:15,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:15,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:15,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:16,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:16,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:16,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:16,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:16,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:16,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:16,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:16,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:16,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:16,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:16,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:16,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:16,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:16,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:16,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:16,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:44:18,584 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:44:18,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:18,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:19,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:44:19,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:19,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:19,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:19,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:19,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:19,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:19,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:19,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:19,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:19,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:19,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:19,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:19,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:19,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:19,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:19,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:21,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:44:21,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:21,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:21,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:21,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:21,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:21,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:21,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:21,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:21,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:21,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:21,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:21,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:21,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:21,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:21,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:21,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:22,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:22,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:22,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:22,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:22,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:22,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:22,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:22,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:22,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:22,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:22,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:22,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:22,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:22,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:22,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:22,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:22,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:22,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:22,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:22,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:22,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:22,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:22,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:22,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:22,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:22,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:22,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:22,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:22,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:22,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:22,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:22,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:23,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:23,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:23,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:23,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:23,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:23,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:23,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:23,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:23,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:23,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:23,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:23,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:23,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:23,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:23,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:23,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:24,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:44:26,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:44:26,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:26,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:26,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:26,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:26,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:26,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:26,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:26,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:26,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:26,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:26,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:26,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:26,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:26,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:26,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:26,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:28,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:44:29,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:29,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:29,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:29,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:29,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:29,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:29,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:29,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:29,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:29,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:29,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:29,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:29,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:29,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:29,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:29,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:30,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:44:30,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:30,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:30,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:30,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:30,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:30,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:30,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:30,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:30,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:30,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:30,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:30,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:30,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:30,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:30,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:30,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:31,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:31,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:31,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:31,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:31,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:31,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:31,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:31,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:31,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:31,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:31,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:31,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:31,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:31,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:31,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:31,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:32,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:44:33,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:44:33,873 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:44:34,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:44:34,452 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:44:35,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:35,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:35,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:35,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:35,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:35,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:35,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:35,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:35,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:35,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:35,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:35,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:35,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:35,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:35,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:35,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:36,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:44:37,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:37,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:37,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:37,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:37,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:37,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:37,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:37,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:37,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:37,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:37,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:37,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:37,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:37,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:37,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:37,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:38,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:44:38,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:38,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:38,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:38,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:38,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:38,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:38,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:38,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:38,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:38,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:38,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:38,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:38,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:38,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:38,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:38,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:40,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:44:42,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:44:42,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:42,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:42,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:42,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:42,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:42,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:42,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:42,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:42,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:42,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:42,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:42,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:42,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:42,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:42,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:42,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:44,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:44,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:44,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:44,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:44,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:44,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:44,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:44,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:44,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:44,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:44,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:44,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:44,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:44,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:44,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:44,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:44,121 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:44:46,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:44:47,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:47,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:47,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:47,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:47,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:47,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:47,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:47,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:47,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:47,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:47,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:47,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:47,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:47,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:47,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:47,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:48,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:48,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:48,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:48,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:48,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:48,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:48,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:48,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:48,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:48,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:48,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:48,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:48,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:48,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:48,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:48,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:48,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:44:49,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:44:49,131 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:44:50,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:44:52,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:44:52,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:52,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:52,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:52,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:52,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:52,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:52,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:52,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:52,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:52,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:52,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:52,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:52,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:52,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:52,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:52,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:52,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:52,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:52,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:52,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:52,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:52,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:52,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:52,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:52,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:52,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:52,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:52,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:53,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-23 23:44:53,137 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-23 23:44:53,381 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-23 23:44:53,454 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-23 23:44:54,240 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-23 23:44:54,240 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:44:55,240 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:44:56,241 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:44:58,242 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:45:00,243 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:45:02,243 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:45:04,244 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:45:04,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:45:04,354 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:45:04,586 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:45:06,245 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:45:08,246 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:45:10,247 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:45:12,248 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:45:14,249 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:45:16,250 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:45:18,251 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:45:19,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:45:19,583 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:45:20,252 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:45:22,253 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:45:24,254 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:45:26,255 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:45:28,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:45:30,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:45:32,257 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:45:34,258 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:45:34,661 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:45:34,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:45:34,914 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:45:36,259 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:45:38,260 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:45:40,261 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:45:42,262 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:45:44,263 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:45:46,264 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:45:48,265 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:45:50,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:45:50,234 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:45:50,266 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:45:52,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:45:54,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:45:56,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:45:58,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:46:00,270 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:46:02,271 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:46:04,272 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:46:04,736 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:46:05,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:46:05,511 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:46:06,273 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:46:08,274 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:46:10,275 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:46:13,276 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:46:15,277 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:46:17,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:46:19,279 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:46:20,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:46:20,745 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:46:21,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:46:23,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:46:25,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:46:27,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:46:29,283 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:46:31,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:46:33,285 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:46:34,811 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:46:35,286 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:46:36,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:46:36,042 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:46:37,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:46:39,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:46:41,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:46:43,290 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:46:45,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:46:47,292 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:46:49,293 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:46:51,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:46:51,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:46:51,361 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:46:53,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:46:55,296 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:46:57,297 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:46:59,298 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:47:01,299 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:47:03,300 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:47:04,877 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:47:05,301 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:47:06,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:47:06,591 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:47:07,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:47:09,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:47:11,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:47:13,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:47:15,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:47:17,306 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:47:19,306 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:47:21,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:47:21,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:47:21,816 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:47:23,308 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:47:25,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:47:27,310 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:47:29,310 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:47:31,311 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:47:33,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:47:34,955 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:47:35,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:47:37,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:47:37,042 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:47:37,313 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:47:39,314 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:47:41,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:47:43,316 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:47:45,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:47:47,318 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:47:49,319 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:47:51,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:47:52,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:47:52,268 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:47:53,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:47:55,321 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:47:57,322 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:47:59,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:48:01,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:48:03,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:48:05,030 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:48:05,326 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:48:07,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:48:07,548 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:48:08,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:48:10,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:48:12,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:48:14,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:48:16,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:48:18,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:48:20,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:48:22,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:48:22,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:48:22,775 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:48:24,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:48:26,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:48:28,335 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:48:30,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:48:32,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:48:34,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:48:35,105 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:48:36,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:48:38,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:48:38,109 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:48:38,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:48:40,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:48:42,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:48:44,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:48:46,342 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:48:48,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:48:50,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:48:52,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:48:53,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:48:53,369 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:48:54,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:48:56,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:48:58,346 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:49:00,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:49:02,348 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:49:04,348 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:49:05,183 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:49:06,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:49:08,350 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:49:08,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:49:08,654 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:49:10,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:49:12,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:49:14,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:49:16,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:49:18,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:49:20,354 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:49:22,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:49:23,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:49:23,882 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:49:24,356 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:49:26,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:49:28,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:49:30,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:49:32,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:49:34,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:49:35,253 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:49:36,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:49:38,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:49:39,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:49:39,194 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:49:40,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:49:42,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:49:44,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:49:46,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:49:48,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:49:50,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:49:52,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:49:54,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:49:54,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:49:54,635 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:49:56,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:49:58,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:50:00,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:50:02,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:50:04,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:50:05,327 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:50:07,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:50:09,371 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:50:09,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:50:09,855 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:50:11,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:50:13,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:50:15,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:50:17,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:50:19,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:50:21,376 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:50:23,377 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:50:25,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:50:25,116 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:50:25,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:50:27,379 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:50:29,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:50:31,381 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:50:33,382 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:50:35,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:50:35,399 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:50:37,384 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:50:39,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:50:40,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:50:40,422 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:50:41,386 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:50:43,387 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:50:45,388 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:50:47,389 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:50:49,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:50:51,391 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:50:53,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:50:55,393 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:50:55,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:50:55,721 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:50:57,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:50:59,395 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:51:01,396 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:51:03,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:51:05,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:51:05,474 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:51:07,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:51:09,399 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:51:11,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:51:11,201 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:51:11,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:51:13,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:51:15,402 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:51:17,402 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:51:19,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:51:21,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:51:23,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:51:25,406 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:51:26,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:51:26,494 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:51:27,407 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:51:29,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:51:32,409 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:51:34,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:51:35,550 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:51:36,411 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:51:38,412 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:51:40,413 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:51:41,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:51:41,725 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:51:42,414 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:51:44,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:51:46,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:51:48,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:51:50,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:51:52,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:51:54,419 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:51:56,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:51:56,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:51:56,980 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:51:58,421 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:52:00,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:52:02,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:52:04,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:52:05,623 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:52:06,425 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:52:08,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:52:10,427 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:52:12,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:52:12,340 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:52:12,428 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:52:14,429 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:52:16,430 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:52:18,431 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:52:20,432 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:52:22,433 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:52:24,434 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:52:26,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:52:27,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:52:27,622 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:52:28,436 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:52:30,437 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:52:32,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:52:34,439 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:52:35,700 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:52:36,440 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:52:38,441 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:52:40,442 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:52:42,443 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:52:42,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:52:42,917 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:52:44,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:52:46,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:52:48,445 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:52:50,446 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:52:52,447 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:52:54,448 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:52:56,449 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:52:58,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:52:58,206 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:52:58,449 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:53:00,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:53:02,451 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:53:04,452 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:53:05,777 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:53:06,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:53:08,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:53:10,455 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:53:12,456 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:53:13,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:53:13,509 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:53:14,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:53:16,458 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:53:18,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:53:20,460 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:53:23,461 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:53:25,463 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:53:27,464 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:53:28,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:53:28,765 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:53:29,465 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:53:31,466 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:53:33,467 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:53:35,468 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:53:35,850 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:53:37,468 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:53:39,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:53:41,470 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:53:43,471 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:53:44,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:53:44,155 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:53:45,472 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:53:47,473 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:53:49,474 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:53:51,475 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:53:53,476 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:53:55,477 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:53:57,478 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:53:59,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:53:59,375 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:53:59,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:54:01,480 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:54:03,481 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:54:05,481 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:54:05,926 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:54:07,482 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:54:09,483 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:54:11,484 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:54:13,484 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:54:14,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:54:14,588 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:54:15,485 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:54:17,486 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:54:19,487 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:54:21,487 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:54:23,488 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:54:25,489 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:54:27,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:54:29,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:54:29,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:54:29,902 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:54:31,491 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:54:33,492 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:54:35,492 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:54:36,001 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:54:37,493 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:54:39,494 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:54:41,495 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:54:43,495 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:54:45,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:54:45,148 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:54:46,496 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:54:48,497 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:54:50,498 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:54:52,498 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:54:54,499 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:54:56,500 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:54:58,501 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:55:00,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:55:00,454 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:55:00,502 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:55:02,503 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:55:04,504 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:55:06,075 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:55:06,504 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:55:08,505 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:55:10,506 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:55:12,507 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:55:14,508 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:55:15,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:55:15,687 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:55:16,509 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:55:18,510 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:55:20,511 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:55:22,512 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:55:24,512 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:55:26,513 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:55:28,514 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:55:30,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:55:30,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:55:30,978 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:55:32,516 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:55:34,517 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:55:36,148 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:55:36,518 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:55:38,518 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:55:40,519 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:55:42,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:55:44,521 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:55:46,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:55:46,216 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:55:46,522 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:55:48,522 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:55:50,523 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:55:52,524 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:55:54,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:55:56,526 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:55:58,527 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:56:00,527 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:56:01,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:56:01,543 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:56:02,528 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:56:04,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:56:06,223 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:56:06,530 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:56:08,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:56:10,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:56:12,532 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:56:14,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:56:16,534 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:56:16,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:56:16,908 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:56:18,535 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:56:21,536 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:56:23,536 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:56:25,537 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:56:27,538 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:56:29,539 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:56:31,539 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:56:32,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:56:32,131 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:56:33,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:56:35,541 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:56:36,299 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:56:37,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:56:39,543 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:56:41,544 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:56:43,545 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:56:45,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:56:47,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:56:47,469 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:56:47,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:56:49,547 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:56:51,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:56:53,549 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:56:55,550 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:56:57,551 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:56:59,552 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:57:01,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:57:02,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:57:02,825 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:57:03,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:57:05,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:57:06,375 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:57:07,555 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:57:09,556 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:57:11,557 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:57:13,558 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:57:15,559 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:57:17,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:57:18,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:57:18,046 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:57:19,561 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:57:21,562 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:57:23,563 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:57:26,564 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:57:28,565 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:57:30,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:57:32,567 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:57:33,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:57:33,488 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:57:34,568 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:57:36,450 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:57:36,569 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:57:38,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:57:40,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:57:42,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:57:44,574 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:57:46,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:57:48,576 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:57:48,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:57:48,793 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:57:50,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:57:52,578 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:57:54,579 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:57:56,579 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:57:58,580 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:58:00,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:58:02,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:58:04,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:58:04,034 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:58:04,583 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:58:06,525 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:58:06,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:58:08,585 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:58:10,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:58:12,587 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:58:14,588 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:58:16,589 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:58:18,589 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:58:19,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:58:19,312 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:58:20,590 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:58:22,591 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:58:24,592 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:58:26,593 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:58:28,594 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:58:30,595 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:58:32,596 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:58:34,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:58:34,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:58:34,708 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:58:36,598 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:58:36,602 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:58:38,599 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:58:40,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:58:42,601 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:58:44,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:58:46,603 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:58:48,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:58:49,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:58:49,959 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:58:50,605 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:58:52,606 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:58:54,607 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:58:56,608 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:58:58,609 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:59:00,610 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:59:02,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:59:04,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:59:05,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:59:05,190 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:59:06,613 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:59:06,672 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:59:08,614 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:59:10,615 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:59:12,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:59:14,617 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:59:16,617 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:59:18,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:59:20,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:59:20,432 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:59:21,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:59:23,621 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:59:25,622 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:59:27,623 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:59:29,624 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:59:31,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:59:33,626 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:59:35,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:59:35,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:59:35,654 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:59:36,739 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-23 23:59:37,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:59:39,629 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:59:41,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:59:43,631 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:59:45,632 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:59:47,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:59:49,634 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:59:51,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-23 23:59:51,006 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-23 23:59:51,635 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:59:53,636 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:59:55,636 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:59:57,637 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-23 23:59:59,638 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:00:01,639 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:00:03,640 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:00:05,641 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:00:06,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:00:06,512 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:00:06,801 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:00:07,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:00:09,643 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:00:11,643 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:00:13,644 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:00:15,645 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:00:17,646 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:00:19,646 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:00:21,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:00:21,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:00:21,837 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:00:23,648 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:00:25,649 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:00:27,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:00:29,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:00:31,651 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:00:33,652 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:00:35,653 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:00:36,881 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:00:37,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:00:37,101 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:00:37,654 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:00:40,655 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:00:42,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:00:44,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:00:46,657 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:00:48,658 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:00:50,658 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:00:52,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:00:52,629 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:00:52,659 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:00:54,660 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:00:56,661 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:00:58,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:01:00,663 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:01:02,664 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:01:04,666 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:01:06,666 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:01:06,958 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:01:07,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:01:07,855 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:01:08,667 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:01:10,668 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:01:12,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:01:14,670 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:01:16,671 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:01:18,672 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:01:20,672 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:01:22,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:01:23,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:01:23,111 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:01:24,674 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:01:26,675 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:01:28,676 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:01:30,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:01:32,678 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:01:34,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:01:36,680 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:01:37,033 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:01:38,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:01:38,334 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:01:38,680 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:01:40,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:01:42,682 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:01:44,683 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:01:46,683 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:01:48,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:01:51,685 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:01:53,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:01:53,626 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:01:53,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:01:55,687 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:01:57,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:01:59,689 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:02:01,690 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:02:03,690 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:02:05,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:02:07,111 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:02:07,692 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:02:08,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:02:08,845 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:02:09,693 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:02:11,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:02:13,695 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:02:15,696 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:02:17,697 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:02:19,697 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:02:21,698 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:02:23,699 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:02:24,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:02:24,074 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:02:25,700 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:02:27,701 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:02:29,702 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:02:31,703 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:02:33,704 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:02:35,704 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:02:37,197 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:02:37,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:02:39,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:02:39,297 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:02:39,706 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:02:41,707 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:02:43,708 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:02:45,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:02:48,710 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:02:50,711 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:02:52,711 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:02:54,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:02:54,583 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:02:54,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:02:56,713 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:02:58,714 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:03:00,716 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:03:02,717 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:03:04,719 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:03:06,720 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:03:07,271 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:03:08,720 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:03:09,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:03:09,873 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:03:10,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:03:12,722 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:03:14,723 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:03:16,724 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:03:18,725 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:03:20,725 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:03:22,726 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:03:24,727 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:03:25,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:03:25,137 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:03:26,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:03:28,729 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:03:30,730 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:03:32,731 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:03:34,732 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:03:36,733 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:03:37,345 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:03:38,734 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:03:40,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:03:40,423 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:03:40,735 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:03:42,735 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:03:44,736 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:03:46,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:03:48,738 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:03:50,739 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:03:52,740 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:03:54,741 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:03:55,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:03:55,796 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:03:56,741 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:03:58,742 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:04:00,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:04:02,744 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:04:04,745 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:04:06,746 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:04:07,420 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:04:09,747 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:04:11,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:04:11,075 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:04:11,748 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:04:13,748 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:04:15,749 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:04:17,750 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:04:19,751 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:04:21,751 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:04:23,752 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:04:25,753 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:04:26,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:04:26,296 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:04:27,754 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:04:29,754 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:04:31,755 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:04:33,756 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:04:35,757 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:04:37,497 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:04:37,757 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:04:39,758 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:04:41,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:04:41,585 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:04:41,759 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:04:43,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:04:45,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:04:47,761 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:04:49,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:04:51,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:04:53,763 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:04:55,764 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:04:56,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:04:56,803 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:04:57,765 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:04:59,766 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:05:01,766 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:05:03,767 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:05:05,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:05:07,571 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:05:07,769 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:05:10,770 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:05:12,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:05:12,045 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:05:12,771 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:05:14,772 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:05:16,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:05:18,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:05:20,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:05:22,775 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:05:24,776 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:05:26,777 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:05:27,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:05:27,361 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:05:28,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:05:30,779 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:05:32,780 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:05:34,781 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:05:36,782 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:05:37,646 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:05:38,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:05:40,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:05:42,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:05:42,597 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:05:42,785 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:05:44,786 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:05:46,787 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:05:48,788 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:05:50,789 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:05:52,790 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:05:54,791 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:05:56,791 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:05:58,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:05:58,014 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:05:58,792 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:06:00,793 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:06:02,794 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:06:04,795 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:06:06,796 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:06:07,722 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:06:08,797 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:06:10,798 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:06:12,799 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:06:13,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:06:13,240 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:06:14,799 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:06:16,800 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:06:18,801 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:06:20,802 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:06:22,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:06:24,804 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:06:26,805 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:06:28,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:06:28,597 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:06:28,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:06:30,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:06:32,807 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:06:34,808 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:06:36,809 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:06:37,799 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:06:38,810 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:06:40,810 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:06:43,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:06:43,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:06:43,830 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:06:45,813 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:06:47,813 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:06:49,814 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:06:51,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:06:53,816 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:06:55,817 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:06:57,817 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:06:59,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:06:59,059 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:06:59,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:07:01,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:07:03,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:07:05,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:07:07,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:07:07,875 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:07:09,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:07:11,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:07:13,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:07:14,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:07:14,278 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:07:15,826 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:07:17,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:07:19,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:07:21,829 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:07:23,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:07:25,831 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:07:27,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:07:29,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:07:29,537 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:07:29,833 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:07:31,833 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:07:33,834 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:07:35,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:07:37,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:07:37,949 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:07:39,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:07:41,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:07:43,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:07:44,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:07:44,820 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:07:45,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:07:47,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:07:49,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:07:51,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:07:53,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:07:55,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:07:57,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:07:59,846 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:08:00,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:08:00,041 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:08:01,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:08:03,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:08:05,849 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:08:07,850 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:08:08,022 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:08:09,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:08:11,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:08:13,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:08:15,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:08:15,324 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:08:15,854 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:08:17,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:08:19,856 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:08:21,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:08:23,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:08:25,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:08:27,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:08:29,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:08:30,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:08:30,601 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:08:31,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:08:33,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:08:35,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:08:38,096 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:08:38,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:08:40,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:08:42,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:08:44,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:08:45,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:08:45,936 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:08:46,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:08:48,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:08:50,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:08:52,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:08:54,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:08:56,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:08:58,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:09:00,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:09:01,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:09:01,167 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:09:02,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:09:04,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:09:06,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:09:08,168 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:09:08,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:09:10,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:09:12,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:09:14,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:09:16,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:09:16,391 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:09:16,882 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:09:18,883 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:09:20,883 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:09:22,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:09:24,885 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:09:26,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:09:28,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:09:30,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:09:31,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:09:31,659 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:09:32,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:09:34,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:09:36,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:09:38,241 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:09:38,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:09:40,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:09:42,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:09:44,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:09:46,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:09:46,883 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:09:46,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:09:48,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:09:50,894 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:09:52,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:09:54,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:09:56,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:09:58,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:10:00,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:10:02,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:10:02,225 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:10:02,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:10:04,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:10:07,900 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:10:08,315 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:10:09,901 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:10:11,902 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:10:13,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:10:15,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:10:17,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:10:17,565 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:10:17,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:10:19,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:10:21,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:10:23,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:10:25,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:10:27,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:10:29,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:10:31,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:10:32,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:10:32,894 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:10:33,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:10:35,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:10:37,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:10:38,385 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:10:39,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:10:41,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:10:43,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:10:45,916 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:10:47,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:10:48,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:10:48,118 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:10:49,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:10:51,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:10:53,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:10:55,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:10:57,921 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:10:59,922 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:11:01,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:11:03,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:11:03,341 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:11:03,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:11:05,925 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:11:07,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:11:08,461 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:11:09,927 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:11:11,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:11:13,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:11:15,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:11:17,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:11:18,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:11:18,668 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:11:19,932 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:11:21,932 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:11:23,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:11:25,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:11:27,935 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:11:29,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:11:32,937 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:11:33,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:11:33,964 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:11:34,938 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:11:36,939 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:11:38,536 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:11:38,940 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:11:40,941 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:11:42,942 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:11:44,943 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:11:46,944 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:11:48,944 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:11:49,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:11:49,325 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:11:50,945 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:11:52,946 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:11:54,947 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:11:56,948 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:11:58,948 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:12:00,949 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:12:02,950 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:12:04,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:12:04,650 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:12:04,951 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:12:06,952 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:12:08,610 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:12:08,953 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:12:10,954 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:12:12,954 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:12:14,955 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:12:16,956 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:12:18,957 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:12:19,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:12:19,982 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:12:20,958 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:12:22,958 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:12:24,959 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:12:26,960 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:12:28,960 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:12:30,961 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:12:32,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:12:34,963 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:12:35,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:12:35,235 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:12:36,963 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:12:38,684 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:12:38,964 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:12:40,964 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:12:42,965 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:12:44,966 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:12:46,967 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:12:48,968 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:12:50,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:12:50,828 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:12:50,969 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:12:53,970 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:12:55,971 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:12:57,972 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:12:59,973 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:13:01,974 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:13:03,975 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:13:05,976 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:13:06,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:13:06,052 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:13:07,977 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:13:08,765 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:13:09,978 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:13:11,979 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:13:13,980 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:13:15,981 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:13:17,982 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:13:19,983 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:13:21,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:13:21,277 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:13:21,984 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:13:23,985 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:13:25,986 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:13:27,987 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:13:29,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:13:31,989 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:13:33,990 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:13:35,991 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:13:36,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:13:36,551 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:13:37,992 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:13:38,838 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:13:39,992 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:13:41,993 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:13:43,994 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:13:45,995 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:13:47,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:13:50,997 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:13:51,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:13:51,837 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:13:52,998 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:13:54,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:13:57,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:13:59,001 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:14:01,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:14:03,003 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:14:05,004 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:14:07,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:14:07,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:14:07,204 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:14:08,914 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:14:09,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:14:11,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:14:13,007 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:14:15,008 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:14:17,009 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:14:19,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:14:21,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:14:22,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:14:22,438 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:14:23,012 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:14:25,013 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:14:27,014 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:14:29,015 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:14:31,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:14:33,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:14:35,017 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:14:37,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:14:37,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:14:37,672 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:14:38,989 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:14:39,019 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:14:41,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:14:43,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:14:45,021 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:14:47,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:14:49,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:14:51,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:14:52,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:14:52,964 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:14:53,025 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:14:55,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:14:57,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:14:59,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:15:01,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:15:03,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:15:06,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:15:08,031 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:15:08,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:15:08,235 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:15:09,065 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:15:10,032 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:15:12,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:15:14,034 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:15:16,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:15:18,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:15:20,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:15:22,038 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:15:23,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:15:23,547 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:15:24,039 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:15:26,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:15:28,041 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:15:30,042 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:15:32,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:15:34,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:15:36,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:15:38,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:15:38,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:15:38,839 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:15:39,140 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:15:40,047 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:15:42,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:15:44,049 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:15:46,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:15:48,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:15:50,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:15:52,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:15:54,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:15:54,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:15:54,077 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:15:56,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:15:58,056 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:16:00,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:16:02,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:16:04,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:16:06,059 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:16:08,060 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:16:09,214 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:16:09,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:16:09,312 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:16:10,061 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:16:12,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:16:14,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:16:16,063 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:16:18,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:16:20,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:16:22,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:16:24,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:16:24,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:16:24,644 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:16:26,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:16:28,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:16:30,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:16:32,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:16:34,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:16:37,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:16:39,074 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:16:39,288 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:16:39,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:16:39,946 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:16:41,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:16:43,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:16:45,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:16:47,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:16:49,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:16:51,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:16:53,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:16:55,081 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:16:55,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:16:55,166 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:16:57,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:16:59,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:17:01,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:17:03,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:17:05,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:17:07,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:17:09,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:17:09,364 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:17:10,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:17:10,430 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:17:11,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:17:13,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:17:15,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:17:17,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:17:19,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:17:21,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:17:23,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:17:25,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:17:25,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:17:25,654 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:17:27,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:17:29,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:17:31,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:17:33,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:17:35,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:17:37,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:17:39,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:17:39,439 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:17:40,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:17:40,951 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:17:41,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:17:43,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:17:45,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:17:47,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:17:49,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:17:51,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:17:53,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:17:55,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:17:56,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:17:56,258 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:17:57,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:17:59,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:18:01,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:18:03,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:18:05,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:18:07,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:18:09,513 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:18:10,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:18:11,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:18:11,623 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:18:12,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:18:14,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:18:16,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:18:18,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:18:20,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:18:22,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:18:24,121 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:18:26,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:18:26,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:18:26,951 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:18:28,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:18:30,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:18:32,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:18:34,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:18:36,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:18:38,128 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:18:39,589 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:18:40,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:18:42,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:18:42,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:18:42,316 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:18:44,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:18:46,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:18:48,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:18:50,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:18:52,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:18:54,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:18:56,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:18:57,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:18:57,648 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:18:58,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:19:01,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:19:03,140 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:19:05,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:19:07,142 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:19:09,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:19:09,664 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:19:11,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:19:12,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:19:12,968 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:19:13,145 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:19:15,146 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:19:17,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:19:19,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:19:21,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:19:23,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:19:25,150 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:19:27,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:19:28,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:19:28,195 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:19:29,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:19:31,152 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:19:33,153 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:19:35,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:19:37,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:19:39,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:19:39,743 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:19:41,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:19:43,157 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:19:43,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:19:43,413 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:19:45,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:19:47,159 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:19:49,160 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:19:51,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:19:53,162 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:19:55,163 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:19:57,164 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:19:58,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:19:58,690 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:19:59,165 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:20:01,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:20:03,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:20:05,168 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:20:07,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:20:09,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:20:09,816 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:20:11,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:20:13,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:20:13,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:20:13,961 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:20:15,172 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:20:17,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:20:20,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:20:22,175 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:20:24,176 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:20:26,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:20:28,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:20:29,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:20:29,186 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:20:30,179 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:20:32,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:20:34,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:20:36,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:20:38,182 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:20:39,891 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:20:40,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:20:42,184 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:20:44,185 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:20:44,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:20:44,526 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:20:46,186 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:20:48,186 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:20:50,187 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:20:52,188 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:20:54,189 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:20:56,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:20:58,191 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:20:59,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:20:59,749 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:21:00,192 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:21:02,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:21:04,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:21:06,194 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:21:08,195 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:21:09,965 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:21:10,196 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:21:12,196 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:21:14,197 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:21:15,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:21:15,043 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:21:16,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:21:18,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:21:20,199 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:21:22,200 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:21:24,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:21:26,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:21:28,202 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:21:30,203 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:21:30,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:21:30,329 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:21:32,203 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:21:34,204 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:21:36,205 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:21:39,206 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:21:40,042 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:21:41,207 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:21:43,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:21:45,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:21:45,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:21:45,679 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:21:47,209 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:21:49,210 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:21:51,210 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:21:53,211 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:21:55,212 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:21:57,213 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:21:59,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:22:00,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:22:00,906 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:22:01,215 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:22:03,216 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:22:05,217 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:22:07,218 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:22:09,218 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:22:10,117 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:22:11,219 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:22:13,220 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:22:15,221 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:22:16,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:22:16,121 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:22:17,222 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:22:19,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:22:21,224 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:22:23,225 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:22:25,226 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:22:27,226 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:22:29,227 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:22:31,228 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:22:31,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:22:31,347 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:22:33,229 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:22:35,229 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:22:37,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:22:39,231 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:22:40,193 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:22:41,232 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:22:43,233 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:22:45,234 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:22:46,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:22:46,566 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:22:47,234 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:22:49,235 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:22:51,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:22:53,237 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:22:55,238 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:22:57,239 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:22:59,240 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:23:01,241 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:23:01,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:23:01,852 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:23:03,242 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:23:05,243 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:23:07,243 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:23:09,244 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:23:10,265 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:23:11,245 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:23:13,246 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:23:15,248 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:23:17,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:23:17,083 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:23:17,248 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:23:19,249 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:23:21,250 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:23:23,251 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:23:26,253 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:23:28,253 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:23:30,254 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:23:32,255 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:23:32,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:23:32,330 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:23:34,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:23:36,257 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:23:38,258 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:23:40,259 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:23:40,332 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:23:42,260 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:23:44,261 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:23:46,262 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:23:47,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:23:47,843 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:23:48,263 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:23:50,264 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:23:52,265 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:23:54,266 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:23:56,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:23:58,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:24:00,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:24:02,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:24:03,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:24:03,072 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:24:04,270 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:24:06,271 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:24:08,272 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:24:10,273 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:24:10,408 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:24:12,274 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:24:14,274 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:24:16,275 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:24:18,276 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:24:18,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:24:18,459 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:24:20,277 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:24:22,277 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:24:24,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:24:26,279 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:24:28,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:24:30,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:24:32,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:24:33,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:24:33,783 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:24:34,283 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:24:37,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:24:39,285 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:24:40,483 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:24:41,286 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:24:43,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:24:45,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:24:47,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:24:49,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:24:49,034 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:24:49,290 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:24:51,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:24:53,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:24:55,292 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:24:57,293 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:24:59,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:25:01,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:25:03,296 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:25:04,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:25:04,258 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:25:05,297 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:25:07,297 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:25:09,298 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:25:10,559 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:25:11,299 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:25:13,300 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:25:15,301 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:25:17,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:25:19,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:25:19,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:25:19,545 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:25:21,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:25:23,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:25:25,306 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:25:27,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:25:29,308 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:25:31,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:25:33,310 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:25:34,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:25:34,768 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:25:35,311 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:25:37,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:25:39,313 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:25:40,636 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:25:41,314 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:25:43,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:25:45,316 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:25:47,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:25:49,318 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:25:49,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:25:49,994 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:25:51,319 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:25:53,319 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:25:55,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:25:57,321 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:25:59,322 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:26:01,322 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:26:03,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:26:05,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:26:05,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:26:05,619 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:26:07,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:26:09,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:26:10,713 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:26:11,326 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:26:13,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:26:15,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:26:18,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:26:20,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:26:20,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:26:20,850 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:26:22,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:26:24,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:26:26,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:26:28,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:26:30,335 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:26:32,335 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:26:34,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:26:36,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:26:36,124 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:26:36,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:26:38,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:26:40,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:26:40,786 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:26:42,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:26:44,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:26:46,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:26:48,342 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:26:50,342 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:26:51,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:26:51,432 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:26:52,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:26:54,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:26:56,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:26:58,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:27:00,346 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:27:02,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:27:04,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:27:06,348 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:27:06,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:27:06,764 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:27:08,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:27:10,350 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:27:10,861 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:27:12,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:27:14,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:27:16,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:27:18,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:27:20,354 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:27:22,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:27:22,069 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:27:22,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:27:24,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:27:26,356 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:27:28,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:27:30,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:27:32,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:27:34,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:27:36,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:27:37,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:27:37,368 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:27:38,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:27:40,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:27:40,939 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:27:42,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:27:44,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:27:46,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:27:48,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:27:50,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:27:52,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:27:52,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:27:52,598 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:27:55,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:27:57,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:27:59,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:28:01,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:28:03,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:28:05,371 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:28:07,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:28:07,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:28:07,930 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:28:09,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:28:11,015 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:28:11,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:28:13,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:28:15,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:28:17,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:28:19,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:28:21,376 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:28:23,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:28:23,167 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:28:23,376 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:28:25,377 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:28:27,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:28:29,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:28:31,379 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:28:33,379 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:28:35,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:28:37,381 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:28:38,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:28:38,393 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:28:39,381 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:28:41,091 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:28:41,382 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:28:43,382 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:28:45,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:28:47,384 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:28:49,384 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:28:51,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:28:53,386 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:28:53,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:28:53,669 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:28:55,386 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:28:57,387 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:29:08,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:29:08,965 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:29:11,167 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:29:24,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:29:24,259 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:29:39,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:29:39,526 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:29:41,238 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:29:54,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:29:54,796 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:29:57,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:29:57,655 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 00:29:57,710 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 00:29:57,790 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 00:29:58,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 00:29:59,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:30:00,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:30:05,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:30:10,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:30:10,043 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:30:11,326 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:30:25,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:30:25,269 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:30:31,414 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:30:40,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:30:40,494 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:30:41,402 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:30:55,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:30:55,806 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:31:11,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:31:11,031 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:31:11,476 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:31:26,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:31:26,264 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:31:41,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:31:41,488 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:31:41,795 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:31:56,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:31:56,797 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:32:11,631 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:32:12,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:32:12,032 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:32:27,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:32:27,256 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:32:41,712 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:32:42,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:32:42,560 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:32:57,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:32:57,792 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:33:11,790 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:33:13,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:33:13,018 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:33:28,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:33:28,247 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:33:41,867 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:33:43,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:33:43,526 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:33:58,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:33:58,799 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:34:11,943 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:34:14,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:34:14,021 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:34:20,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:34:24,517 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:34:29,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:34:29,246 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:34:32,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:34:35,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:35,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:35,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:35,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:35,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:35,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:35,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:35,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:35,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:35,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:35,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:35,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:35,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:35,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:35,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:35,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:38,522 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:34:40,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:40,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:40,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:40,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:40,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:40,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:40,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:40,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:40,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:40,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:40,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:40,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:40,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:40,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:40,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:40,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:42,020 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:34:42,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:42,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:42,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:42,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:42,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:42,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:42,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:42,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:42,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:42,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:42,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:42,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:42,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:42,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:42,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:42,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:34:42,523 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:34:44,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:34:44,565 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:34:46,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:34:50,527 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:34:54,528 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:34:56,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:34:59,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:34:59,912 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:35:00,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:35:03,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:03,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:03,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:03,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:03,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:03,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:03,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:03,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:03,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:03,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:03,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:03,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:03,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:03,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:03,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:03,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:04,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:35:06,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:35:10,535 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:35:12,095 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:35:12,536 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:35:15,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:35:15,158 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:35:16,538 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:35:16,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:16,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:16,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:16,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:16,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:16,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:16,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:16,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:16,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:16,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:16,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:16,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:16,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:16,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:16,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:16,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:18,539 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:35:20,539 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:35:23,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:23,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:23,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:23,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:23,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:23,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:23,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:23,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:23,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:23,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:23,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:23,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:23,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:23,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:23,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:23,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:23,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:23,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:23,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:23,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:23,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:23,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:23,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:23,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:23,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:23,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:23,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:23,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:23,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:23,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:23,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:23,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:24,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:24,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:24,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:24,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:24,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:24,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:24,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:24,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:24,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:24,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:24,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:24,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:24,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:24,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:24,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:24,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:24,541 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:35:26,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:26,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:26,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:26,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:26,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:26,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:26,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:26,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:26,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:26,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:26,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:26,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:26,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:26,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:26,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:26,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:26,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:35:28,543 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:35:29,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:29,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:29,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:29,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:29,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:29,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:29,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:29,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:29,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:29,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:29,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:29,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:29,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:29,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:29,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:29,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:35:30,381 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:35:30,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,543 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:35:30,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:30,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:33,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:33,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:33,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:33,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:33,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:33,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:33,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:33,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:33,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:33,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:33,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:33,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:33,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:33,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:33,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:33,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:34,545 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:35:36,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:36,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:36,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:36,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:36,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:36,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:36,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:36,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:36,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:36,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:36,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:36,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:36,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:36,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:36,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:36,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:36,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:35:38,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:35:39,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:39,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:39,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:39,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:39,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:39,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:39,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:39,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:39,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:39,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:39,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:39,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:39,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:39,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:39,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:39,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:39,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:39,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:39,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:39,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:39,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:39,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:39,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:39,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:39,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:39,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:39,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:39,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:39,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:39,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:39,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:39,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:40,547 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:35:40,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:40,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:40,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:40,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:40,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:40,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:40,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:40,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:40,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:40,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:40,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:40,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:40,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:40,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:40,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:40,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:41,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:41,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:41,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:41,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:41,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:41,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:41,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:41,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:41,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:41,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:41,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:41,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:41,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:41,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:41,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:41,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:42,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:42,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:42,171 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:35:42,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:42,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:42,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:42,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:42,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:42,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:42,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:42,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:42,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:42,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:42,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:42,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:42,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:42,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:42,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:35:43,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:43,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:43,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:43,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:43,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:43,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:43,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:43,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:43,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:43,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:43,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:43,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:43,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:43,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:43,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:43,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:44,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:44,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:44,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:44,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:44,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:44,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:44,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:44,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:44,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:44,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:44,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:44,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:44,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:44,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:44,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:44,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:44,549 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:35:45,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:35:45,711 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:35:46,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:46,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:46,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:46,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:46,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:46,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:46,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:46,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:46,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:46,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:46,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:46,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:46,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:46,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:46,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:46,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:47,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:47,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:47,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:47,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:47,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:47,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:47,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:47,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:47,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:47,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:47,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:47,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:47,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:47,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:47,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:47,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:47,550 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:35:48,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:48,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:49,551 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:35:49,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:49,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:49,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:49,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:49,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:49,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:49,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:49,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:49,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:49,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:49,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:49,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:49,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:49,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:49,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:49,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:50,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:50,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:50,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:50,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:50,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:50,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:50,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:50,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:50,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:50,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:50,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:50,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:50,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:50,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:50,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:50,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:50,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:50,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:50,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:50,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:50,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:50,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:50,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:50,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:50,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:50,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:50,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:50,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:50,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:50,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:50,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:50,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:51,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:51,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:51,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:51,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:51,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:51,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:51,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:51,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:51,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:51,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:51,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:51,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:51,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:51,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:51,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:51,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:51,552 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:35:51,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:51,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:51,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:51,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:51,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:51,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:51,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:51,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:51,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:51,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:51,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:51,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:51,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:51,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:51,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:51,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:53,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:35:54,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:54,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:54,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:54,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:54,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:54,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:54,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:54,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:54,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:54,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:54,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:54,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:54,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:54,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:54,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:54,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:55,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:35:57,555 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:35:58,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:58,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:58,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:58,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:58,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:58,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:58,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:58,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:58,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:58,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:58,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:58,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:58,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:58,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:58,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:58,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:59,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:59,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:59,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:59,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:59,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:59,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:59,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:59,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:59,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:59,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:59,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:59,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:59,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:59,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:59,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:59,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:59,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:59,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:59,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:59,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:59,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:59,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:59,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:59,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:59,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:59,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:59,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:59,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:59,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:59,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:59,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:59,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:35:59,556 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:36:00,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:36:00,968 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:36:01,556 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:36:03,557 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:36:05,558 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:36:05,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:05,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:05,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:05,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:05,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:05,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:05,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:05,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:05,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:05,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:05,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:05,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:05,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:05,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:05,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:05,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:07,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:07,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:07,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:07,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:07,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:07,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:07,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:07,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:07,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:07,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:07,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:07,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:07,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:07,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:07,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:07,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:07,559 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:36:09,559 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:36:10,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:10,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:10,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:10,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:10,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:10,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:10,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:10,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:10,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:10,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:10,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:10,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:10,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:10,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:10,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:10,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:10,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:10,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:10,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:10,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:10,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:10,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:10,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:10,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:10,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:10,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:10,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:10,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:10,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:10,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:10,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:10,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:11,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:11,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:11,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:11,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:11,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:11,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:11,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:11,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:11,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:11,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:11,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:11,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:11,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:11,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:11,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:11,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:11,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:36:12,243 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:36:13,561 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:36:15,562 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:36:16,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:16,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:16,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:16,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:16,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:16,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:16,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:16,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:16,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:16,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:16,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:16,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:16,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:16,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:16,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:16,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:16,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:36:16,220 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:36:17,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:17,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:17,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:17,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:17,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:17,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:17,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:17,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:17,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:17,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:17,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:17,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:17,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:17,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:17,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:17,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:17,562 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:36:18,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:18,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:18,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:18,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:18,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:18,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:18,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:18,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:18,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:18,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:18,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:18,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:18,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:18,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:18,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:18,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:19,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:19,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:19,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:19,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:19,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:19,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:19,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:19,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:19,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:19,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:19,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:19,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:19,563 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:36:21,564 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:36:31,569 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:36:31,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:36:31,607 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:36:35,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:36:39,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:36:41,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:41,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:41,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:41,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:41,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:41,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:41,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:41,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:41,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:41,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:41,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:41,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:41,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:41,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:41,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:41,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:41,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:41,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:41,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:41,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:41,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:41,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:41,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:41,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:41,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:41,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:41,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:41,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:41,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:41,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:41,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:41,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:42,316 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:36:43,574 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:36:43,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:43,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:43,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:43,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:43,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:43,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:43,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:43,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:43,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:43,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:43,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:43,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:43,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:43,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:43,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:43,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:36:46,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:36:46,914 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:36:47,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:36:51,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:36:55,579 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:36:57,580 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:37:01,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:37:02,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:37:02,170 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:37:05,583 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:37:07,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:37:08,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:08,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:08,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:08,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:08,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:08,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:08,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:08,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:08,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:08,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:08,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:08,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:08,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:08,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:08,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:08,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:11,585 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:37:12,393 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:37:13,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:37:15,587 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:37:17,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:37:17,490 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:37:18,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:18,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:18,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:18,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:18,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:18,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:18,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:18,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:18,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:18,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:18,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:18,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:18,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:18,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:18,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:18,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:19,589 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:37:21,589 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:37:23,590 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:37:25,591 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:37:26,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:26,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:26,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:26,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:26,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:26,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:26,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:26,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:26,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:26,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:26,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:26,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:26,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:26,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:26,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:26,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:27,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:27,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:27,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:27,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:27,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:27,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:27,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:27,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:27,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:27,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:27,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:27,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:27,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:27,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:27,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:27,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:28,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:28,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:28,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:28,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:28,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:28,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:28,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:28,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:28,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:28,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:28,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:28,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:28,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:28,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:28,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:28,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:29,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:29,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:29,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:29,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:29,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:29,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:29,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:29,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:29,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:29,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:29,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:29,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:29,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:29,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:29,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:29,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:29,593 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:37:30,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:30,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:30,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:30,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:30,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:30,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:30,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:30,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:30,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:30,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:30,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:30,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:30,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:30,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:30,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:30,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:31,593 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:37:31,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:31,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:31,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:31,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:31,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:32,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:32,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:32,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:32,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:32,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:32,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:32,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:32,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:32,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:32,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:32,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:32,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:37:32,754 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:37:33,594 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:37:33,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:33,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:33,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:33,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:33,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:33,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:33,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:33,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:33,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:33,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:33,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:33,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:33,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:33,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:33,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:33,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:34,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:34,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:34,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:34,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:34,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:34,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:34,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:34,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:34,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:34,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:34,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:34,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:34,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:34,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:34,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:34,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:34,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:34,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:34,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:34,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:34,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:34,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:34,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:34,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:34,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:34,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:34,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:34,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:34,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:34,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:34,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:34,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:35,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:35,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:35,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:35,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:35,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:35,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:35,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:35,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:35,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:35,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:35,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:35,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:35,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:35,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:35,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:35,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:35,595 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:37:36,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:36,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:36,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:36,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:36,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:36,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:36,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:36,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:36,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:36,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:36,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:36,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:36,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:36,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:36,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:36,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:37,596 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:37:38,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:38,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:38,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:38,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:38,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:38,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:38,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:38,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:38,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:38,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:38,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:38,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:38,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:38,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:38,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:38,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:39,596 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:37:40,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:40,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:40,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:40,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:40,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:40,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:40,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:40,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:40,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:40,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:40,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:40,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:40,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:40,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:40,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:40,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:41,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:37:42,466 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:37:42,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:42,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:42,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:42,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:42,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:42,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:42,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:42,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:42,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:42,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:42,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:42,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:42,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:42,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:42,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:42,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:42,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:42,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:42,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:42,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:42,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:42,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:42,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:42,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:42,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:42,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:42,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:42,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:42,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:42,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:42,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:42,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:43,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:43,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:43,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:43,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:43,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:43,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:43,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:43,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:43,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:43,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:43,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:43,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:43,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:43,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:43,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:43,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:43,598 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:37:43,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:43,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:43,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:43,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:43,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:43,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:43,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:43,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:43,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:43,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:43,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:43,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:43,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:43,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:43,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:43,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:44,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:44,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:44,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:44,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:44,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:44,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:44,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:44,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:44,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:44,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:44,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:44,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:44,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:44,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:44,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:44,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:44,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:44,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:44,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:44,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:44,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:44,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:44,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:44,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:44,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:44,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:44,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:44,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:44,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:44,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:44,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:44,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:45,598 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:37:47,599 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:37:47,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:47,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:47,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:47,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:47,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:47,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:47,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:47,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:47,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:47,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:47,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:47,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:47,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:47,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:47,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:47,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:48,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:37:48,069 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:37:49,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:37:49,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:49,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:50,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:50,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:50,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:50,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:50,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:50,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:50,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:50,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:50,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:50,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:50,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:50,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:50,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:50,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:50,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:50,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:50,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:50,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:50,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:50,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:50,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:50,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:50,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:50,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:50,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:50,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:50,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:50,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:50,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:50,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:50,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:50,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:51,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:51,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:51,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:51,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:51,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:51,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:51,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:51,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:51,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:51,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:51,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:51,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:51,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:51,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:51,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:51,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:51,601 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:37:52,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:52,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:53,601 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:37:53,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:53,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:53,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:53,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:53,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:53,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:53,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:53,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:53,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:53,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:53,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:53,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:53,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:53,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:53,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:53,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:55,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:37:55,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:55,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:55,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:55,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:55,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:55,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:55,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:55,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:55,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:55,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:55,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:55,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:55,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:55,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:55,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:55,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:58,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:37:58,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:58,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:58,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:58,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:58,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:58,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:58,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:58,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:58,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:58,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:58,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:58,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:58,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:58,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:58,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:37:58,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:00,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:00,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:00,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:00,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:00,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:00,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:00,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:00,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:00,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:00,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:00,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:00,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:00,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:00,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:00,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:00,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:00,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:00,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:00,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:00,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:00,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:00,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:00,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:00,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:00,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:00,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:00,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:00,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:00,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:00,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:00,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:00,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:00,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:38:02,605 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:38:03,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:03,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:03,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:03,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:03,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:03,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:03,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:03,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:03,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:03,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:03,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:03,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:03,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:03,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:03,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:03,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:03,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:38:03,292 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:38:04,606 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:38:06,607 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:38:07,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:07,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:07,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:07,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:07,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:07,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:07,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:07,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:07,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:07,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:07,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:07,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:07,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:07,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:07,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:07,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:07,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:07,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:07,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:07,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:07,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:07,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:07,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:07,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:07,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:07,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:07,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:07,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:07,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:07,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:07,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:07,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:08,608 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:38:10,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:10,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:10,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:10,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:10,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:10,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:10,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:10,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:10,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:10,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:10,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:10,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:10,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:10,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:10,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:10,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:10,609 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:38:12,539 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:38:12,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:12,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:12,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:12,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:12,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:12,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:12,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:12,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:12,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:12,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:12,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:12,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:12,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:12,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:12,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:12,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:12,610 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:38:14,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:38:15,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:15,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:15,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:15,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:15,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:15,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:15,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:15,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:15,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:15,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:15,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:15,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:15,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:15,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:15,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:15,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:16,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:16,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:16,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:16,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:16,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:16,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:16,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:16,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:16,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:16,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:16,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:16,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:16,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:16,620 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 00:38:16,811 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:38:16,814 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 00:38:16,877 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 00:38:17,751 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 00:38:17,751 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:38:18,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:38:18,540 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:38:20,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:20,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:20,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:20,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:20,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:20,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:20,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:20,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:20,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:20,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:20,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:20,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:20,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:20,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:20,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:20,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:28,755 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:38:32,757 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:38:33,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:38:33,948 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:38:37,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:37,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:37,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:37,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:37,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:37,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:37,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:37,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:37,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:37,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:37,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:37,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:37,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:37,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:37,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:37,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:38,759 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:38:39,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:39,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:39,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:39,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:39,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:39,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:39,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:39,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:39,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:39,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:39,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:39,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:39,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:39,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:39,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:39,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:42,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:38:42,943 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:38:43,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:43,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:43,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:43,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:43,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:43,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:43,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:43,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:43,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:43,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:43,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:43,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:43,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:43,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:43,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:43,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:46,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:38:48,763 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:38:49,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:38:49,172 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:38:52,764 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:38:54,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:54,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:54,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:54,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:54,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:54,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:54,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:54,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:54,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:54,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:54,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:54,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:54,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:54,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:54,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:54,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:38:56,766 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:38:58,767 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:39:02,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:39:04,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:39:04,539 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:39:06,770 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:39:08,771 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:39:12,772 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:39:13,018 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:39:14,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:39:15,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:15,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:15,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:15,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:15,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:15,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:15,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:15,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:15,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:15,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:15,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:15,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:15,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:15,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:15,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:15,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:16,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:39:19,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:39:19,885 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:39:20,776 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:39:22,776 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:39:23,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:23,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:23,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:23,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:23,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:23,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:23,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:23,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:23,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:23,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:23,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:23,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:23,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:23,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:23,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:23,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:24,777 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:39:26,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:39:29,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:29,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:29,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:29,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:29,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:29,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:29,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:29,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:29,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:29,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:29,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:29,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:29,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:29,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:29,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:29,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:29,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:29,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:29,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:29,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:29,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:29,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:29,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:29,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:29,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:29,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:29,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:29,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:29,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:29,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:29,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:29,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:30,779 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:39:32,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,780 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:39:32,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:32,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:34,781 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:39:35,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:39:35,110 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:39:36,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:36,782 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:39:38,782 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:39:40,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:39:41,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:41,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:41,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:41,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:41,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:41,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:41,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:41,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:41,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:41,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:41,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:41,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:41,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:41,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:41,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:41,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:41,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:41,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:41,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:41,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:41,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:41,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:41,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:41,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:41,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:41,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:41,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:41,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:41,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:41,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:41,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:41,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:42,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:42,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:42,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:42,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:42,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:42,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:42,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:42,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:42,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:42,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:42,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:42,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:42,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:42,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:42,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:42,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:42,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:39:43,083 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:39:43,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:43,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:43,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:43,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:43,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:43,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:43,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:43,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:43,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:43,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:43,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:43,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:43,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:43,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:43,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:43,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:44,785 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:39:46,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:46,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:46,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:46,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:46,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:46,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:46,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:46,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:46,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:46,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:46,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:46,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:46,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:46,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:46,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:46,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:46,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:46,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:46,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:46,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:46,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:46,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:46,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:46,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:46,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:46,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:46,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:46,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:46,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:46,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:46,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:46,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:46,785 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:39:47,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:47,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:47,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:47,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:47,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:47,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:47,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:47,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:47,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:47,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:47,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:47,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:47,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:47,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:47,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:47,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:48,786 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:39:49,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:49,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:49,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:49,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:49,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:49,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:49,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:49,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:49,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:49,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:49,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:49,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:49,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:49,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:49,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:49,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:50,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:50,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:50,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:50,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:50,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:50,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:50,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:50,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:50,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:50,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:50,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:50,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:50,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:50,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:50,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:50,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:50,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:39:50,329 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:39:51,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:51,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:51,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:51,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:51,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:51,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:51,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:51,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:51,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:51,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:51,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:51,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:51,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:51,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:51,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:51,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:51,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:51,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:51,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:51,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:51,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:51,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:51,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:51,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:51,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:51,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:51,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:51,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:51,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:51,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:51,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:51,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:51,787 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:39:53,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,788 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:39:53,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:53,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:54,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:54,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:54,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:54,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:54,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:54,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:54,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:54,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:54,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:54,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:54,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:54,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:54,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:54,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:54,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:54,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:55,788 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:39:56,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:56,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:56,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:56,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:56,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:56,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:56,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:56,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:56,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:56,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:56,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:56,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:56,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:56,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:56,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:56,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:57,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:57,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:57,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:57,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:57,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:57,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:57,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:57,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:57,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:57,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:57,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:57,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:57,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:57,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:57,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:57,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:39:57,789 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:39:59,790 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:40:00,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:00,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:00,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:00,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:00,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:00,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:00,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:00,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:00,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:00,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:00,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:00,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:00,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:00,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:00,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:00,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:00,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:00,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:00,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:00,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:00,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:00,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:00,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:00,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:00,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:00,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:00,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:00,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:00,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:00,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:00,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:00,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:01,791 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:40:03,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:03,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:03,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:03,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:03,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:03,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:03,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:03,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:03,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:03,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:03,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:03,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:03,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:03,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:03,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:03,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:03,792 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:40:04,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:04,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:04,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:04,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:04,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:04,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:04,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:04,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:04,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:04,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:04,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:04,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:04,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:04,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:04,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:04,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:05,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:40:05,596 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:40:05,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:05,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:05,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:05,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:05,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:05,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:05,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:05,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:05,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:05,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:05,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:05,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:05,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:05,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:05,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:05,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:05,792 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:40:07,793 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:40:09,794 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:40:10,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:10,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:10,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:10,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:10,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:10,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:10,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:10,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:10,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:10,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:10,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:10,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:10,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:10,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:10,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:10,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:11,794 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:40:12,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:12,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:12,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:12,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:12,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:12,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:12,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:12,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:12,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:12,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:12,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:12,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:12,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:12,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:12,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:12,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:13,151 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:40:13,795 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:40:13,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:13,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:13,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:13,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:13,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:13,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:13,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:13,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:13,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:13,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:13,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:13,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:13,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:13,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:13,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:13,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:14,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:14,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:14,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:14,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:14,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:14,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:14,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:14,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:14,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:14,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:14,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:14,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:14,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:14,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:14,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:14,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:15,796 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:40:17,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:17,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:17,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:17,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:17,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:17,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:17,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:17,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:17,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:17,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:17,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:17,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:17,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:17,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:17,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:17,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:17,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:17,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:17,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:17,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:17,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:17,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:17,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:17,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:17,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:17,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:17,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:17,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:17,797 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:40:19,798 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:40:20,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:40:20,882 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:40:29,801 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:40:33,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:40:36,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:40:36,107 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:40:37,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:37,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:37,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:37,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:37,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:37,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:37,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:37,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:37,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:37,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:37,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:37,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:37,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:37,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:37,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:37,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:37,804 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:40:41,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:40:42,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:42,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:42,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:42,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:42,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:42,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:42,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:42,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:42,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:42,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:42,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:42,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:42,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:42,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:42,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:42,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:43,224 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:40:43,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:43,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:43,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:43,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:43,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:43,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:43,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:43,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:43,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:43,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:43,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:43,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:43,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:43,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:43,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:43,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:45,808 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:40:49,809 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:40:51,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:40:51,502 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:40:53,811 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:40:54,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:54,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:54,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:54,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:54,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:54,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:54,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:54,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:54,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:54,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:54,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:54,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:54,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:54,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:54,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:54,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:57,813 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:40:59,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:59,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:59,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:59,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:59,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:59,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:59,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:59,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:59,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:59,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:59,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:59,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:59,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:59,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:59,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:59,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:40:59,814 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:41:03,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:41:05,816 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:41:06,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:41:06,788 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:41:09,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:41:11,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:41:13,296 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:41:15,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:41:17,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:41:19,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:41:22,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:41:22,010 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:41:22,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:22,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:22,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:22,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:22,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:22,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:22,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:22,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:22,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:22,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:22,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:22,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:22,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:22,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:22,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:22,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:23,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:41:25,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:41:27,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:41:29,826 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:41:30,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:30,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:30,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:30,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:30,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:30,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:30,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:30,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:30,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:30,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:30,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:30,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:30,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:30,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:30,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:30,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:31,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:41:33,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:41:34,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:34,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:34,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:34,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:34,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:34,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:34,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:34,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:34,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:34,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:34,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:34,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:34,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:34,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:34,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:34,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:35,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:35,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:35,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:35,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:35,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:35,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:35,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:35,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:35,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:35,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:35,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:35,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:35,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:35,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:35,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:35,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:36,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:36,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:36,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:36,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:36,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:36,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:36,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:36,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:36,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:36,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:36,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:36,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:36,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:36,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:36,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:36,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:37,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:41:37,237 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:41:37,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:41:37,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:37,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:37,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:37,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:37,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:37,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:37,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:37,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:37,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:37,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:37,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:37,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:37,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:37,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:37,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:37,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:39,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:39,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:39,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:39,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:39,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:39,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:39,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:39,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:39,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:39,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:39,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:39,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:39,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:39,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:39,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:39,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:39,831 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:41:40,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:40,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:40,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:40,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:40,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:40,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:40,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:40,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:40,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:40,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:40,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:40,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:40,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:40,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:40,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:40,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:41,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:41,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:41,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:41,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:41,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:41,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:41,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:41,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:41,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:41,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:41,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:41,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:41,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:41,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:41,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:41,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:41,831 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:41:42,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:42,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:42,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:42,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:42,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:42,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:42,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:42,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:42,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:42,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:42,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:42,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:42,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:42,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:42,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:42,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:43,367 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:41:43,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:43,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:43,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:43,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:43,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:43,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:43,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:43,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:43,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:43,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:43,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:43,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:43,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:43,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:43,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:43,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:43,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:43,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:43,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:43,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:43,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:43,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:43,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:43,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:43,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:43,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:43,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:43,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:43,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:43,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:43,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:43,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:43,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:41:45,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:45,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:45,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:45,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:45,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:45,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:45,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:45,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:45,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:45,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:45,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:45,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:45,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:45,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:45,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:45,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:45,833 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:41:47,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:47,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:47,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:47,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:47,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:47,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:47,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:47,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:47,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:47,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:47,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:47,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:47,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:47,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:47,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:47,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:47,834 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:41:49,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:49,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:41:50,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:50,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:50,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:50,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:50,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:50,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:50,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:50,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:50,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:50,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:50,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:50,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:50,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:50,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:50,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:50,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:51,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:41:52,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:41:52,449 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:41:53,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:53,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:53,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:53,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:53,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:53,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:53,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:53,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:53,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:53,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:53,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:53,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:53,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:53,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:53,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:53,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:53,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:41:54,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:54,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:54,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:54,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:54,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:54,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:54,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:54,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:54,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:54,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:54,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:54,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:54,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:54,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:54,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:54,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:54,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:54,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:54,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:54,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:54,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:54,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:54,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:54,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:54,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:54,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:54,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:54,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:54,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:54,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:54,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:54,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:41:55,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:55,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:56,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:56,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:56,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:56,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:56,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:56,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:56,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:56,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:56,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:56,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:56,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:56,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:56,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:56,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:56,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:56,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:41:57,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:57,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:58,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:41:59,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:42:00,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:00,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:00,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:00,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:00,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:00,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:00,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:00,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:00,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:00,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:00,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:00,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:00,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:00,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:00,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:00,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:01,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:01,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:01,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:01,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:01,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:01,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:01,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:01,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:01,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:01,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:01,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:01,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:01,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:01,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:01,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:01,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:01,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:01,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:01,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:01,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:01,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:01,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:01,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:01,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:01,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:01,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:01,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:01,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:01,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:01,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:01,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:01,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:01,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:42:04,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:04,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:04,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:04,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:04,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:04,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:04,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:04,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:04,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:04,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:04,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:04,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:04,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:04,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:04,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:04,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:04,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:42:04,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:04,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:04,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:04,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:04,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:04,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:04,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:04,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:04,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:04,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:04,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:04,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:04,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:04,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:04,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:04,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:06,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:42:07,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:42:07,736 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:42:07,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:07,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:07,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:07,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:07,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:07,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:07,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:07,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:07,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:07,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:07,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:07,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:07,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:07,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:07,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:07,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:08,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:42:10,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:42:11,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:11,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:11,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:11,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:11,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:11,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:11,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:11,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:11,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:11,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:11,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:11,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:11,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:11,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:11,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:11,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:11,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:11,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:11,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:11,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:11,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:11,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:11,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:11,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:11,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:11,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:11,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:11,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:11,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:11,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:11,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:11,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:12,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:42:13,439 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:42:14,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:14,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:14,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:14,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:14,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:14,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:14,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:14,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:14,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:14,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:14,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:14,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:14,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:14,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:14,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:14,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:14,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:14,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:14,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:14,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:14,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:14,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:14,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:14,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:14,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:14,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:14,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:14,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:14,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:14,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:14,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:14,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:14,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:42:15,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:15,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:15,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:15,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:15,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:15,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:15,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:15,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:15,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:15,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:15,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:15,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:15,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:15,591 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 00:42:15,741 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 00:42:15,806 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 00:42:15,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 00:42:16,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:42:22,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:42:22,959 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:42:26,849 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:42:32,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:42:36,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:36,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:36,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:36,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:36,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:36,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:36,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:36,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:36,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:36,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:36,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:36,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:36,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:36,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:36,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:36,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:36,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:42:38,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:42:38,190 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:42:38,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:38,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:38,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:38,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:38,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:38,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:38,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:38,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:38,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:38,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:38,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:38,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:38,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:38,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:38,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:38,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:40,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:42:43,572 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:42:44,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:42:48,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:48,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:48,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:48,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:48,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:48,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:48,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:48,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:48,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:48,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:48,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:48,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:48,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:48,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:48,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:48,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:48,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:42:51,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:51,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:51,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:51,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:51,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:51,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:51,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:51,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:51,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:51,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:51,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:51,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:51,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:51,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:51,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:51,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:42:52,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:42:53,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:42:53,449 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:42:54,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:42:58,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:43:01,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:01,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:01,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:01,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:01,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:01,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:01,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:01,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:01,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:01,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:01,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:01,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:01,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:01,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:01,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:01,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:02,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:43:04,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:43:05,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:05,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:05,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:05,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:05,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:05,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:05,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:05,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:05,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:05,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:05,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:05,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:05,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:05,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:05,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:05,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:08,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:43:08,680 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:43:08,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:43:10,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:43:12,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:43:13,642 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:43:16,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:43:18,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:43:20,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:43:22,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:43:23,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:43:23,904 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:43:25,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:25,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:25,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:25,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:25,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:25,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:25,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:25,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:25,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:25,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:25,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:25,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:25,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:25,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:25,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:25,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:26,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:43:28,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:43:30,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:43:31,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:31,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:31,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:31,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:31,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:31,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:31,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:31,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:31,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:31,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:31,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:31,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:31,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:31,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:31,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:31,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:32,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:43:34,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:43:36,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:43:37,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:37,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:37,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:37,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:37,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:37,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:37,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:37,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:37,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:37,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:37,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:37,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:37,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:37,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:37,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:37,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:38,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:38,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:38,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:38,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:38,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:38,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:38,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:38,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:38,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:38,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:38,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:38,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:38,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:38,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:38,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:38,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:38,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:43:39,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:43:39,205 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:43:39,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:39,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:40,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:43:42,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:43:43,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:43,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:43,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:43,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:43,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:43,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:43,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:43,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:43,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:43,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:43,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:43,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:43,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:43,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:43,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:43,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:43,717 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:43:44,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:44,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:44,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:44,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:44,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:44,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:44,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:44,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:44,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:44,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:44,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:44,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:44,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:44,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:44,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:44,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:44,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:44,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:44,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:44,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:44,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:44,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:44,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:44,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:44,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:44,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:44,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:44,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:44,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:44,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:44,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:44,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:44,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:43:45,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:45,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:46,882 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:43:48,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:43:49,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:49,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:50,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:50,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:50,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:50,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:50,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:50,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:50,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:43:51,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:51,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:51,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:51,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:51,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:51,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:51,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:51,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:51,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:51,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:51,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:51,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:51,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:51,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:51,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:51,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:52,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:52,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:52,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:52,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:52,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:52,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:52,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:52,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:52,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:52,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:52,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:52,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:52,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:52,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:52,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:52,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:52,885 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:43:53,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:53,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:54,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:43:54,492 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:43:54,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:43:55,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:55,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:55,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:55,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:55,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:55,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:55,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:55,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:55,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:55,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:55,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:55,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:55,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:55,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:55,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:55,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:55,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:55,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:55,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:55,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:55,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:55,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:55,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:55,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:55,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:55,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:55,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:55,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:55,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:55,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:55,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:55,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:56,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:56,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:56,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:56,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:56,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:56,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:56,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:56,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:56,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:56,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:56,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:56,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:56,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:56,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:56,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:56,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:56,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:56,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:56,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:56,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:56,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:56,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:56,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:56,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:56,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:56,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:56,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:56,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:56,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:56,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:56,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:56,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:56,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:43:57,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:57,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:57,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:57,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:57,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:57,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:57,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:57,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:57,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:57,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:57,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:57,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:57,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:57,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:57,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:57,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:57,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:57,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:57,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:57,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:57,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:57,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:57,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:57,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:57,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:57,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:57,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:57,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:57,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:57,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:57,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:57,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:58,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:43:59,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:59,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:59,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:59,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:59,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:59,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:59,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:59,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:59,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:59,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:59,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:59,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:59,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:59,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:59,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:59,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:59,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:59,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:59,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:59,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:59,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:59,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:59,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:59,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:59,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:59,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:59,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:59,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:59,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:59,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:59,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:43:59,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:00,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:44:02,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:02,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:02,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:02,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:02,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:02,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:02,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:02,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:02,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:02,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:02,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:02,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:02,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:02,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:02,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:02,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:02,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:02,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:02,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:02,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:02,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:02,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:02,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:02,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:02,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:02,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:02,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:02,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:02,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:02,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:02,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:02,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:02,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:44:03,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:03,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:03,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:03,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:03,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:03,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:03,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:03,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:03,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:03,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:03,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:03,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:03,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:03,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:03,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:03,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:04,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:04,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:04,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:04,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:04,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:04,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:04,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:04,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:04,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:04,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:04,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:04,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:04,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:04,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:04,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:04,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:04,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:44:05,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:05,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:05,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:05,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:05,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:05,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:05,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:05,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:05,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:05,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:05,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:05,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:05,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:05,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:05,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:05,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:06,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:44:07,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:07,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:07,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:07,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:07,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:07,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:07,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:07,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:07,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:07,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:07,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:07,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:07,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:07,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:07,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:07,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:08,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:44:09,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:44:09,788 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:44:10,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:44:11,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:11,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:11,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:11,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:11,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:11,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:11,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:11,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:11,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:11,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:11,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:11,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:11,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:11,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:11,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:11,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:11,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:11,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:11,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:11,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:11,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:11,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:11,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:11,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:11,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:11,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:11,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:11,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:11,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:11,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:11,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:11,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:12,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:44:12,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:12,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:12,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:12,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:13,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:13,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:13,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:13,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:13,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:13,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:13,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:13,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:13,793 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:44:14,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:44:21,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:21,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:21,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:21,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:21,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:21,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:21,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:21,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:21,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:21,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:21,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:21,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:21,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:21,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:21,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:21,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:24,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:24,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:24,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:24,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:24,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:24,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:24,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:24,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:24,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:24,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:24,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:24,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:24,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:24,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:24,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:24,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:25,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:44:25,015 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:44:25,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:44:29,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:44:33,900 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:44:37,901 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:44:40,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:40,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:40,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:40,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:40,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:40,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:40,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:40,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:40,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:40,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:40,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:40,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:40,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:40,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:40,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:40,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:40,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:44:40,238 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:44:41,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:44:43,868 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:44:45,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:44:49,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:49,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:49,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:49,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:49,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:49,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:49,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:49,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:49,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:49,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:49,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:49,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:49,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:49,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:49,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:49,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:49,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:44:52,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:52,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:52,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:52,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:52,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:52,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:52,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:52,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:52,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:52,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:52,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:52,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:52,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:52,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:52,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:52,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:53,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:44:55,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:44:55,470 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:44:55,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:44:57,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:57,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:57,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:57,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:57,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:57,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:57,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:57,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:57,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:57,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:57,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:57,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:57,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:57,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:57,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:57,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:44:59,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:45:03,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:45:05,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:45:07,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:07,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:07,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:07,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:07,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:07,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:07,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:07,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:07,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:07,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:07,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:07,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:07,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:07,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:07,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:07,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:09,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:09,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:09,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:09,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:09,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:09,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:09,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:09,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:09,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:09,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:09,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:09,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:09,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:09,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:09,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:09,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:09,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:45:10,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:45:10,693 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:45:11,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:45:13,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:45:13,943 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:45:15,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:45:19,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:45:21,921 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:45:23,922 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:45:25,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:45:26,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:45:26,011 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:45:26,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:26,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:26,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:26,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:26,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:26,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:26,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:26,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:26,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:26,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:26,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:26,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:26,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:26,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:26,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:26,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:27,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:45:31,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:45:33,927 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:45:35,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:45:37,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:37,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:37,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:37,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:37,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:37,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:37,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:37,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:37,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:37,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:37,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:37,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:37,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:37,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:37,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:37,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:37,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:45:39,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:39,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:39,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:39,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:39,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:39,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:39,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:39,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:39,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:39,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:39,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:39,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:39,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:39,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:39,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:39,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:39,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:45:40,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:40,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:40,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:40,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:40,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:40,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:40,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:40,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:40,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:40,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:40,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:40,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:40,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:40,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:40,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:40,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:40,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:40,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:40,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:40,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:40,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:40,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:40,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:40,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:40,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:40,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:40,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:40,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:40,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:40,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:40,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:40,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:41,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:45:41,234 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:45:41,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:45:42,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:42,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:42,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:42,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:42,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:42,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:42,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:42,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:42,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:42,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:42,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:42,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:42,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:42,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:42,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:42,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:43,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:45:43,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:43,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:43,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:43,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:43,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:43,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:43,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:43,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:43,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:43,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:43,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:43,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:43,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:43,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:43,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:43,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:44,018 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:45:44,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:44,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:44,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:44,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:44,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:44,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:44,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:44,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:44,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:44,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:44,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:44,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:44,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:44,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:44,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:44,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:44,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:44,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:44,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:44,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:44,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:44,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:44,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:44,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:44,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:44,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:44,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:44,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:44,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:44,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:44,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:44,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:45,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:45,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:45,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:45,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:45,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:45,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:45,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:45,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:45,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:45,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:45,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:45,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:45,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:45,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:45,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:45,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:45,932 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:45:46,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:46,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:46,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:46,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:46,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:46,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:46,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:46,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:46,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:46,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:46,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:46,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:46,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:46,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:46,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:46,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:46,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:46,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:46,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:46,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:46,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:46,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:46,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:46,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:46,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:46,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:46,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:46,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:46,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:46,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:46,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:46,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:47,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:47,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:47,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:47,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:47,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:47,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:47,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:47,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:47,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:47,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:47,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:47,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:47,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:47,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:47,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:47,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:47,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:45:48,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:48,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:48,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:48,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:48,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:48,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:48,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:48,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:48,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:48,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:48,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:48,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:48,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:48,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:48,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:48,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:49,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:49,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:49,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:49,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:49,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:49,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:49,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:49,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:49,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:49,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:49,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:49,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:49,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:49,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:49,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:49,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:49,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:45:50,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:50,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:50,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:50,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:50,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:50,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:50,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:50,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:50,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:50,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:50,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:50,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:50,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:50,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:50,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:50,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:51,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:51,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:51,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:51,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:51,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:51,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:51,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:51,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:51,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:51,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:51,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:51,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:51,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:51,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:51,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:51,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:51,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:51,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:51,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:51,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:51,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:51,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:51,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:51,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:51,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:51,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:51,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:51,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:51,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:51,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:51,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:51,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:51,935 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:45:52,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:52,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:52,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:52,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:52,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:52,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:52,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:52,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:52,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:52,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:52,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:52,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:52,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:52,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:52,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:52,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:53,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:53,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:53,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:53,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:53,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:53,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:53,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:53,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:53,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:53,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:53,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:53,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:53,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:53,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:53,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:53,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:53,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:45:53,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:53,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:53,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:53,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:53,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:53,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:53,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:53,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:53,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:53,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:54,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:55,937 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:45:55,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:55,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:55,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:55,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:55,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:55,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:55,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:55,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:45:56,540 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:45:56,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:56,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:57,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:57,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:57,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:57,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:57,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:57,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:57,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:57,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:57,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:57,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:57,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:57,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:57,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:57,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:57,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:57,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:57,938 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:45:59,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:59,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:59,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:59,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:59,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:59,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:59,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:59,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:59,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:59,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:59,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:59,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:59,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:59,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:59,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:59,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:45:59,939 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:46:00,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:00,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:00,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:00,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:00,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:00,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:00,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:00,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:00,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:00,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:00,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:00,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:00,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:00,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:00,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:00,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:01,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:01,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:01,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:01,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:01,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:01,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:01,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:01,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:01,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:01,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:01,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:01,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:01,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:01,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:01,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:01,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:01,940 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:46:02,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:02,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:03,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:03,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:03,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:03,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:03,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:03,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:03,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:03,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:03,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:03,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:03,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:03,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:03,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:03,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:03,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:03,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:03,941 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:46:05,942 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:46:06,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:06,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:06,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:06,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:06,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:06,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:06,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:06,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:06,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:06,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:06,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:06,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:06,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:06,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:06,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:06,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:06,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:06,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:06,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:06,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:06,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:06,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:06,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:06,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:06,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:06,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:06,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:06,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:06,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:06,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:06,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:06,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:07,943 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:46:09,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:09,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:09,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:09,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:09,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:09,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:09,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:09,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:09,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:09,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:09,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:09,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:09,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:09,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:09,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:09,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:09,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:09,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:09,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:09,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:09,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:09,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:09,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:09,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:09,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:09,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:09,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:09,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:09,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:09,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:09,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:09,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:09,944 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:46:10,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:10,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:10,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:10,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:10,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:10,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:10,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:10,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:10,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:10,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:10,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:10,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:10,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:10,897 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 00:46:11,127 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 00:46:11,203 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 00:46:11,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:46:11,953 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:46:12,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 00:46:12,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:46:13,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:46:14,111 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:46:20,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:20,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:20,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:20,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:20,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:20,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:20,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:20,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:20,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:20,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:20,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:20,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:20,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:20,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:20,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:20,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:22,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:46:24,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:24,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:24,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:24,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:24,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:24,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:24,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:24,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:24,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:24,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:24,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:24,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:24,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:24,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:24,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:24,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:26,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:46:27,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:46:27,180 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:46:27,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:27,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:27,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:27,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:27,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:27,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:27,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:27,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:27,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:27,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:27,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:27,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:27,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:27,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:27,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:27,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:33,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:46:35,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:46:39,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:46:42,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:46:42,404 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:46:43,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:46:44,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:44,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:44,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:44,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:44,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:44,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:44,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:44,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:44,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:44,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:44,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:44,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:44,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:44,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:44,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:44,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:44,189 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:46:47,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:46:49,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:46:52,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:52,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:52,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:52,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:52,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:52,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:52,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:52,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:52,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:52,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:52,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:52,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:52,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:52,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:52,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:52,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:53,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:46:57,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:46:57,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:57,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:57,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:57,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:57,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:57,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:57,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:57,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:57,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:57,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:57,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:57,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:57,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:57,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:57,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:57,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:46:57,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:46:57,641 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:46:59,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:47:03,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:47:04,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:04,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:04,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:04,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:04,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:04,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:04,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:04,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:04,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:04,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:04,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:04,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:04,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:04,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:04,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:04,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:05,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:47:07,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:47:08,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:08,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:08,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:08,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:08,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:08,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:08,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:08,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:08,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:08,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:08,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:08,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:08,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:08,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:08,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:08,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:11,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:47:11,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:11,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:11,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:11,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:11,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:11,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:11,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:11,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:11,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:11,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:11,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:11,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:11,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:11,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:11,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:11,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:13,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:47:13,044 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:47:13,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:47:14,265 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:47:17,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:47:19,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:47:21,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:47:23,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:47:25,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:47:28,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:47:28,407 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:47:29,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:47:31,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:47:31,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:31,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:31,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:31,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:31,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:31,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:31,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:31,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:31,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:31,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:31,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:31,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:31,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:31,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:31,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:31,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:33,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:47:35,121 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:47:37,121 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:47:38,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:38,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:38,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:38,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:38,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:38,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:38,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:38,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:38,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:38,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:38,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:38,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:38,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:38,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:38,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:38,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:39,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:47:40,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:40,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:40,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:40,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:40,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:40,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:40,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:40,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:40,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:40,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:40,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:40,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:40,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:40,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:40,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:40,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:41,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:47:41,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:41,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:41,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:41,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:41,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:41,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:41,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:41,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:41,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:41,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:41,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:41,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:41,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:41,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:41,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:41,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:43,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:43,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:43,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:43,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:43,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:43,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:43,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:43,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:43,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:43,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:43,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:43,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:43,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:43,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:43,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:43,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:43,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:47:43,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:43,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:43,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:43,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:43,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:43,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:43,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:43,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:43,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:43,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:43,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:43,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:43,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:43,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:43,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:43,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:43,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:47:43,708 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:47:44,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:44,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:44,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:44,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:44,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:44,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:44,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:44,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:44,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:44,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:44,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:44,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:44,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:44,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:44,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:44,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:44,340 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:47:45,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:47:45,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:45,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:45,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:45,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:45,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:45,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:45,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:45,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:45,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:45,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:45,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:45,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:45,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:45,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:45,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:45,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:46,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:46,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:46,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:46,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:46,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:46,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:46,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:46,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:46,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:46,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:46,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:46,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:46,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:46,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:46,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:46,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:46,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:46,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:46,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:46,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:46,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:46,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:46,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:46,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:46,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:46,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:46,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:46,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:46,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:46,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:46,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:46,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:47,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:47:47,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:47,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:47,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:47,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:47,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:47,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:47,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:47,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:47,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:47,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:47,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:47,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:47,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:47,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:47,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:47,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:48,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:48,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:48,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:48,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:48,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:48,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:48,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:48,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:48,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:48,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:48,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:48,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:48,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:48,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:48,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:48,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:49,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:47:49,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:49,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:49,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:49,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:49,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:49,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:49,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:49,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:49,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:49,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:49,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:49,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:49,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:49,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:49,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:49,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:50,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:50,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:50,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:50,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:50,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:50,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:50,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:50,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:50,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:50,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:50,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:50,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:50,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:50,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:50,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:50,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:50,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:50,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:50,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:50,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:50,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:50,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:50,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:50,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:50,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:50,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:50,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:50,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:50,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:50,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:50,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:50,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:51,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:47:51,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:51,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:51,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:51,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:51,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:51,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:51,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:51,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:51,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:51,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:51,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:51,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:51,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:51,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:51,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:51,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:51,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:51,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:51,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:51,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:51,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:51,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:51,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:51,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:51,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:51,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:51,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:51,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:51,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:51,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:51,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:51,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:52,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:52,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:52,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:52,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:52,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:52,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:52,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:52,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:52,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:52,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:52,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:52,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:52,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:52,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:52,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:52,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:53,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:47:53,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:53,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:53,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:53,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:53,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:53,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:53,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:53,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:53,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:53,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:53,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:53,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:53,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:53,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:53,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:53,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:53,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:53,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:53,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:53,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:53,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:53,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:53,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:53,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:53,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:53,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:53,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:53,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:53,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:53,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:53,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:53,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:47:55,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:55,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:56,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:57,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:47:57,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:57,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:57,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:57,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:57,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:57,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:57,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:57,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:57,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:57,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:57,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:57,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:57,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:57,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:57,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:57,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:58,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:47:58,934 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:47:59,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:59,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:59,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:59,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:59,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:59,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:59,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:59,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:59,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:59,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:59,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:59,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:59,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:59,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:59,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:59,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:47:59,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:48:00,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:00,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:00,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:00,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:00,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:00,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:00,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:00,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:00,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:00,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:00,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:00,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:00,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:00,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:00,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:00,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:01,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:48:01,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:01,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:01,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:01,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:01,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:01,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:01,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:01,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:01,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:01,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:01,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:01,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:01,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:01,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:01,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:01,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:02,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:02,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:02,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:02,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:02,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:02,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:02,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:02,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:02,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:02,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:02,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:02,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:02,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:02,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:02,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:02,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:02,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:02,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:02,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:02,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:02,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:02,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:02,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:02,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:02,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:02,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:02,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:02,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:02,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:02,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:02,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:02,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:03,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:03,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:03,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:03,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:03,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:03,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:03,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:03,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:03,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:03,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:03,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:03,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:03,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:03,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:03,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:03,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:03,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:48:03,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:03,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:03,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:03,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:03,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:03,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:03,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:03,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:03,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:03,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:03,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:03,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:03,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:03,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:03,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:03,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:04,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:04,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:04,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:04,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:04,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:04,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:04,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:04,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:04,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:04,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:04,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:04,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:04,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:04,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:04,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:04,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:05,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:48:07,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:48:07,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:07,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:07,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:07,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:07,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:07,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:07,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:07,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:07,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:07,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:07,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:07,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:07,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:07,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:07,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:07,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:07,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:07,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:07,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:07,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:07,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:07,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:07,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:07,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:07,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:07,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:07,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:07,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:07,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:07,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:07,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:07,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:08,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:08,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:08,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:08,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:08,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:08,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:08,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:08,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:08,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:08,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:08,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:08,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:08,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:08,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:08,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:08,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:08,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:08,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:08,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:08,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:09,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:09,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:09,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:09,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:09,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:09,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:09,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:09,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:09,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:48:11,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:48:14,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:48:14,221 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:48:14,445 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:48:20,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:48:22,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:22,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:22,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:22,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:22,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:22,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:22,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:22,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:22,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:22,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:22,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:22,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:22,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:22,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:22,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:22,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:24,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:48:29,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:48:29,575 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:48:30,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:48:32,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:32,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:32,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:32,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:32,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:32,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:32,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:32,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:32,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:32,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:32,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:32,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:32,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:32,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:32,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:32,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:34,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:48:36,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:48:36,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:36,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:36,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:36,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:36,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:36,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:36,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:36,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:36,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:36,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:36,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:36,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:36,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:36,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:36,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:36,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:37,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:37,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:37,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:37,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:37,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:37,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:37,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:37,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:37,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:37,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:37,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:37,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:37,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:37,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:37,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:37,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:40,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:48:44,159 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:48:44,493 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:48:44,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:48:44,990 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:48:48,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:48:48,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:48,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:48,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:48,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:48,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:48,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:48,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:48,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:48,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:48,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:48,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:48,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:48,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:48,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:48,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:48,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:50,162 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:48:53,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:53,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:53,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:53,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:53,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:53,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:53,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:53,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:53,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:53,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:53,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:53,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:53,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:53,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:53,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:53,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:48:54,164 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:48:58,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:49:00,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:49:00,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:49:00,269 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:49:02,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:49:02,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:02,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:02,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:02,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:02,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:02,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:02,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:02,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:02,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:02,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:02,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:02,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:02,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:02,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:02,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:02,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:05,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:05,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:05,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:05,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:05,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:05,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:05,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:05,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:05,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:05,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:05,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:05,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:05,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:05,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:05,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:05,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:06,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:49:08,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:49:12,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:49:14,569 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:49:15,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:49:15,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:49:15,516 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:49:15,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:15,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:15,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:15,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:15,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:15,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:15,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:15,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:15,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:15,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:15,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:15,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:15,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:15,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:15,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:15,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:17,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:17,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:17,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:17,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:17,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:17,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:17,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:17,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:17,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:17,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:17,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:17,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:17,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:17,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:17,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:17,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:17,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:49:19,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:49:21,175 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:49:25,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:49:27,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:49:29,179 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:49:30,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:49:30,727 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:49:31,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:49:31,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:31,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:31,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:31,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:31,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:31,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:31,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:31,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:31,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:31,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:31,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:31,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:32,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:32,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:32,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:32,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:33,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:49:35,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:49:36,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:36,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:36,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:36,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:36,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:36,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:36,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:36,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:36,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:36,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:36,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:36,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:36,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:36,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:36,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:36,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:37,182 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:49:39,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:49:39,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:39,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:39,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:39,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:39,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:39,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:39,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:39,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:39,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:39,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:39,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:39,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:39,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:39,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:39,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:39,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:41,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:49:42,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:42,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:42,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:42,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:42,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:42,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:42,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:42,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:42,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:42,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:42,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:42,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:42,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:42,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:42,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:42,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:42,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:42,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:42,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:42,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:42,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:42,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:42,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:42,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:42,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:42,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:42,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:42,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:42,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:42,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:42,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:42,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:43,184 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:49:44,644 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:49:45,185 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:49:45,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:45,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:45,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:45,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:45,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:45,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:45,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:45,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:45,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:45,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:45,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:45,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:45,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:45,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:45,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:45,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:45,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:49:45,964 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:49:46,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:46,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:46,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:46,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:46,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:46,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:46,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:46,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:46,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:46,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:46,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:46,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:46,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:46,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:46,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:46,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:46,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:46,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:46,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:46,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:46,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:46,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:46,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:46,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:46,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:46,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:46,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:46,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:46,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:46,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:46,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:46,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:47,186 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:49:47,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:47,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:47,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:47,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:47,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:47,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:47,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:47,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:47,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:47,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:47,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:47,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:47,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:47,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:47,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:47,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:48,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:49,187 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:49:50,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:50,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:51,188 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:49:51,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:51,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:51,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:51,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:51,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:51,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:51,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:51,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:51,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:51,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:51,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:51,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:51,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:51,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:51,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:51,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:52,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:52,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:52,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:52,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:52,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:52,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:52,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:52,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:52,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:52,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:52,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:52,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:52,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:52,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:52,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:52,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:53,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:53,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:53,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:53,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:53,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:53,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:53,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:53,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:53,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:53,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:53,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:53,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:53,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:53,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:53,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:53,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:53,188 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:49:53,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:53,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:53,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:53,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:53,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:53,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:53,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:53,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:53,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:53,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:53,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:53,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:53,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:53,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:53,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:53,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:54,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:54,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:54,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:54,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:54,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:54,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:54,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:54,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:54,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:54,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:54,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:54,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:54,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:54,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:54,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:54,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:55,189 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:49:55,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:55,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:55,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:55,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:55,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:55,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:55,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:55,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:55,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:55,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:55,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:55,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:55,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:55,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:55,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:55,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:55,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:55,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:55,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:55,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:55,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:55,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:55,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:55,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:55,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:55,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:55,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:55,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:55,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:55,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:55,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:55,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:56,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:56,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:56,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:56,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:56,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:56,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:56,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:56,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:56,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:56,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:56,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:56,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:56,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:56,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:56,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:56,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:56,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:56,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:56,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:56,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:56,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:56,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:56,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:56,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:56,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:56,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:56,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:56,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:56,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:56,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:56,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:56,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:49:57,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:57,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:49:59,191 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:50:00,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:00,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:00,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:00,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:00,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:00,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:00,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:00,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:00,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:00,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:00,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:00,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:00,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:00,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:00,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:00,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:00,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:00,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:00,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:00,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:00,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:00,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:00,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:00,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:00,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:00,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:00,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:00,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:00,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:00,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:00,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:00,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:01,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:50:01,188 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:50:01,192 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:50:02,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:02,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:02,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:02,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:02,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:02,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:02,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:02,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:02,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:02,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:02,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:02,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:02,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:02,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:02,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:02,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:02,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:02,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:02,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:02,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:02,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:02,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:02,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:02,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:02,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:02,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:02,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:02,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:02,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:02,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:02,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:02,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:03,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:03,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:03,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:03,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:03,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:03,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:03,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:03,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:03,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:03,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:03,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:03,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:03,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:03,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:03,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:03,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:03,192 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:50:04,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:04,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:04,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:04,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:04,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:04,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:04,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:04,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:04,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:04,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:04,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:04,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:04,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:04,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:04,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:04,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:04,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:04,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:04,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:04,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:04,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:04,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:04,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:04,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:04,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:04,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:04,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:04,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:04,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:04,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:04,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:04,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:05,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:50:05,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:05,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:05,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:05,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:05,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:05,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:05,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:05,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:05,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:05,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:05,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:05,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:05,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:05,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:05,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:05,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:07,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:07,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:07,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:07,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:07,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:07,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:07,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:07,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:07,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:07,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:07,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:07,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:07,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:07,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:07,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:07,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:07,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:07,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:07,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:07,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:07,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:07,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:07,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:07,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:07,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:07,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:07,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:07,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:07,194 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:50:07,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:07,421 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 00:50:07,646 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 00:50:07,709 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 00:50:08,194 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 00:50:08,195 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:50:09,195 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:50:14,734 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:50:16,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:50:16,408 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:50:17,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:17,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:17,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:17,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:17,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:17,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:17,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:17,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:17,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:17,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:17,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:17,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:17,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:17,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:17,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:17,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:19,199 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:50:19,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:19,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:19,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:19,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:19,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:19,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:19,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:19,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:19,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:19,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:19,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:19,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:19,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:19,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:19,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:19,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:25,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:50:29,203 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:50:31,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:50:31,663 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:50:33,205 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:50:36,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:36,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:36,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:36,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:36,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:36,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:36,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:36,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:36,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:36,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:36,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:36,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:36,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:36,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:36,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:36,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:37,206 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:50:39,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:39,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:39,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:39,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:39,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:39,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:39,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:39,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:39,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:39,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:39,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:39,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:39,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:39,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:39,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:39,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:41,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:50:43,209 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:50:44,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:44,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:44,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:44,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:44,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:44,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:44,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:44,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:44,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:44,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:44,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:44,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:44,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:44,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:44,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:44,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:44,810 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:50:45,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:45,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:45,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:45,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:45,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:45,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:45,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:45,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:45,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:45,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:45,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:45,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:45,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:45,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:45,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:45,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:46,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:50:46,880 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:50:47,211 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:50:49,212 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:50:52,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:52,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:52,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:52,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:52,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:52,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:52,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:52,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:52,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:52,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:52,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:52,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:52,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:52,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:52,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:52,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:50:53,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:50:57,215 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:50:59,216 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:51:00,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:00,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:00,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:00,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:00,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:00,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:00,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:00,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:00,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:00,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:00,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:00,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:00,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:00,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:00,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:00,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:01,217 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:51:02,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:51:02,238 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:51:05,219 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:51:05,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:05,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:05,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:05,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:05,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:05,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:05,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:05,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:05,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:05,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:05,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:05,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:05,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:05,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:05,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:05,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:07,220 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:51:09,221 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:51:09,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:09,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:09,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:09,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:09,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:09,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:09,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:09,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:09,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:09,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:09,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:09,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:09,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:09,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:09,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:09,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:13,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:51:14,878 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:51:15,224 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:51:17,225 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:51:17,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:51:17,502 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:51:19,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:19,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:19,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:19,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:19,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:19,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:19,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:19,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:19,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:19,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:19,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:19,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:19,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:19,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:19,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:19,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:19,226 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:51:23,227 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:51:24,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:24,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:24,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:24,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:24,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:24,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:24,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:24,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:24,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:24,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:24,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:24,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:24,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:24,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:24,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:24,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:25,228 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:51:27,229 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:51:29,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:51:31,231 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:51:32,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:51:32,726 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:51:33,233 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:51:35,233 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:51:36,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:36,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:36,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:36,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:36,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:36,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:36,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:36,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:36,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:36,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:36,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:36,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:36,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:36,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:36,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:36,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:36,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:36,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:36,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:36,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:36,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:36,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:36,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:36,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:36,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:36,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:36,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:36,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:36,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:36,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:36,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:36,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:37,234 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:51:39,234 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:51:39,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:39,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:39,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:39,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:39,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:39,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:39,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:39,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:39,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:39,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:39,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:39,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:39,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:39,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:39,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:39,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:41,235 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:51:43,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:43,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:43,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:43,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:43,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:43,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:43,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:43,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:43,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:43,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:43,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:43,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:43,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:43,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:43,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:43,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:43,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:51:44,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:44,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:44,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:44,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:44,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:44,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:44,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:44,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:44,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:44,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:44,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:44,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:44,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:44,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:44,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:44,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:44,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:44,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:44,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:44,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:44,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:44,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:44,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:44,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:44,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:44,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:44,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:44,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:44,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:44,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:44,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:44,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:44,944 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:51:45,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:51:46,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:46,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:46,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:46,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:46,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:46,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:46,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:46,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:46,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:46,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:46,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:46,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:46,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:46,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:46,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:46,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:47,237 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:51:47,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:51:47,957 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:51:48,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:48,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:49,237 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:51:49,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:49,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:49,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:49,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:49,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:49,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:49,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:49,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:49,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:49,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:49,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:49,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:49,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:49,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:49,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:49,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:50,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:51,238 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:51:51,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:51,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:51,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:51,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:51,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:51,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:51,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:51,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:51,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:51,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:51,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:51,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:51,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:51,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:51,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:51,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:53,240 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:51:53,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:53,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:53,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:53,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:53,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:53,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:53,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:53,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:53,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:53,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:53,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:53,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:53,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:53,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:53,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:53,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:53,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:53,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:53,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:53,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:53,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:53,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:53,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:53,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:53,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:53,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:53,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:53,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:53,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:53,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:53,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:53,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:54,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:55,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:56,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:56,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:56,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:56,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:56,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:56,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:56,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:56,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:56,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:56,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:56,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:56,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:56,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:56,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:56,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:56,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:51:56,241 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:51:58,241 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:52:00,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,242 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:52:00,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:00,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:01,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:01,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:01,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:01,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:01,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:01,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:01,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:01,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:01,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:01,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:01,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:01,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:01,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:01,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:01,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:01,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:01,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:01,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:01,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:01,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:01,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:01,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:01,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:01,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:01,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:01,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:01,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:01,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:01,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:01,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:01,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:01,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:02,243 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:52:03,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:03,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:03,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:03,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:03,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:03,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:03,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:03,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:03,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:03,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:03,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:03,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:03,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:03,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:03,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:03,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:03,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:52:03,193 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:52:04,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:04,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:04,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:04,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:04,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:04,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:04,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:04,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:04,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:04,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:04,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:04,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:04,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:04,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:04,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:04,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:04,243 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:52:04,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:04,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:04,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:04,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:04,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:04,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:04,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:04,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:04,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:04,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:04,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:04,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:06,244 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:52:11,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:11,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:11,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:11,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:11,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:11,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:11,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:11,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:11,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:11,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:11,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:11,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:11,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:11,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:11,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:11,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:12,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:12,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:12,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:12,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:12,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:12,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:12,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:12,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:12,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:12,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:12,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:12,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:12,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:12,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:12,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:12,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:14,248 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:52:15,019 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:52:18,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:52:18,520 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:52:20,250 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:52:24,251 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:52:28,253 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:52:28,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:28,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:28,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:28,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:28,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:28,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:28,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:28,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:28,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:28,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:28,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:28,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:28,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:28,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:28,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:28,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:28,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:28,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:28,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:28,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:28,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:28,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:28,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:28,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:28,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:28,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:28,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:28,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:28,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:28,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:28,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:28,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:32,255 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:52:33,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:52:33,741 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:52:36,257 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:52:40,258 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:52:44,260 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:52:44,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:44,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:44,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:44,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:44,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:44,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:44,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:44,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:44,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:44,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:44,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:44,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:44,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:44,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:44,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:44,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:44,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:44,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:44,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:44,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:44,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:44,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:44,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:44,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:44,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:44,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:45,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:45,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:45,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:45,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:45,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:45,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:45,095 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:52:45,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:45,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:45,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:45,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:45,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:45,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:45,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:45,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:45,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:45,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:45,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:45,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:45,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:45,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:45,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:45,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:48,261 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:52:49,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:52:49,127 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:52:50,262 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:52:52,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:52,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:52,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:52,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:52,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:52,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:52,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:52,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:52,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:52,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:52,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:52,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:52,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:52,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:52,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:52,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:54,264 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:52:56,265 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:52:57,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:57,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:57,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:57,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:57,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:57,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:57,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:57,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:57,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:57,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:57,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:57,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:57,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:57,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:57,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:52:57,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:00,266 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:53:02,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:02,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:02,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:02,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:02,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:02,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:02,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:02,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:02,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:02,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:02,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:02,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:02,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:02,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:02,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:02,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:02,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:53:04,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:53:04,350 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:53:06,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:53:08,270 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:53:10,271 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:53:10,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:10,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:10,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:10,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:10,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:10,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:10,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:10,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:10,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:10,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:10,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:10,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:10,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:10,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:10,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:10,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:14,273 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:53:15,170 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:53:15,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:15,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:15,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:15,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:15,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:15,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:15,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:15,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:15,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:15,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:15,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:15,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:15,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:15,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:15,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:15,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:16,274 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:53:18,274 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:53:19,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:53:19,579 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:53:21,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:21,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:21,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:21,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:21,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:21,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:21,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:21,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:21,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:21,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:21,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:21,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:21,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:21,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:21,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:21,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:22,276 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:53:24,277 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:53:26,277 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:53:28,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:53:30,279 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:53:32,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:53:34,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:53:34,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:34,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:34,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:34,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:34,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:34,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:34,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:34,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:34,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:34,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:34,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:34,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:34,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:34,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:34,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:34,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:34,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:53:34,874 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:53:36,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:53:38,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:53:40,283 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:53:41,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:41,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:41,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:41,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:41,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:41,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:41,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:41,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:41,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:41,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:41,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:41,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:41,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:41,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:41,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:41,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:41,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:41,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:41,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:41,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:41,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:41,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:41,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:41,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:41,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:41,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:41,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:41,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:41,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:41,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:41,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:41,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:42,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:53:43,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:43,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:43,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:43,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:43,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:43,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:43,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:43,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:43,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:43,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:43,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:43,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:43,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:43,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:43,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:43,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:44,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:53:45,240 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:53:46,285 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:53:46,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:46,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:46,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:46,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:46,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:46,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:46,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:46,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:46,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:46,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:46,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:46,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:46,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:46,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:46,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:46,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:48,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:48,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:48,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:48,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:48,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:48,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:48,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:48,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:48,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:48,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:48,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:48,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:48,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:48,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:48,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:48,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:48,286 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:53:49,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:49,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:49,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:49,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:49,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:49,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:49,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:49,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:49,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:49,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:49,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:49,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:49,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:49,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:49,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:49,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:50,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:53:50,099 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:53:50,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:53:51,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:51,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:52,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:53:52,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:52,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:52,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:52,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:52,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:52,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:52,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:52,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:52,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:52,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:52,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:52,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:52,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:52,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:52,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:52,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:52,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:52,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:52,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:52,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:52,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:52,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:52,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:52,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:52,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:52,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:52,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:52,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:52,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:52,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:52,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:52,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:53,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:53,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:53,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:53,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:53,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:53,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:53,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:53,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:53,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:53,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:53,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:53,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:53,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:53,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:53,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:53,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:54,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:53:54,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:54,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:54,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:54,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:54,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:54,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:54,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:54,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:54,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:54,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:54,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:54,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:54,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:54,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:54,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:54,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:55,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:56,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:53:56,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:56,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:56,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:56,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:56,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:56,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:56,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:56,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:56,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:56,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:56,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:56,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:56,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:56,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:56,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:56,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:57,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:57,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:57,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:57,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:57,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:57,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:57,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:57,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:57,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:57,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:57,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:57,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:57,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:57,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:57,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:57,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:57,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:57,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:57,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:57,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:57,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:57,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:57,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:57,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:57,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:57,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:57,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:57,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:57,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:57,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:57,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:57,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,290 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:53:58,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:58,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:59,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:59,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:59,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:59,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:59,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:59,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:59,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:59,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:59,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:59,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:59,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:59,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:59,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:59,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:59,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:59,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:59,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:59,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:59,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:53:59,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:00,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:00,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:00,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:00,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:00,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:00,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:00,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:00,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:00,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:00,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:00,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:00,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:00,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:00,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:00,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:00,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:00,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:00,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:00,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:00,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:00,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:00,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:00,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:00,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:00,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:00,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:00,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:00,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:00,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:54:01,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:01,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:01,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:01,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:01,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:01,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:01,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:01,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:01,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:01,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:01,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:01,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:01,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:01,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:01,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:01,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:02,292 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:54:03,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:03,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:03,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:03,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:03,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:03,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:03,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:03,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:03,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:03,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:03,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:03,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:03,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:03,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:03,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:03,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:03,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:03,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:03,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:03,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:03,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:03,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:03,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:03,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:03,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:03,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:03,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:03,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:03,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:03,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:03,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:03,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:04,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:04,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:04,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:04,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:04,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:04,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:04,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:04,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:04,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:04,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:04,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:04,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:04,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:04,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:04,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:04,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:04,293 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:54:05,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:05,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:05,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:05,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:05,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:05,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:05,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:05,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:05,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:05,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:05,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:05,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:05,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:05,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:05,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:05,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:05,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:05,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:05,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:05,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:05,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:54:05,324 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:54:05,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:05,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:05,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:05,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:05,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:05,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:05,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:05,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:05,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 00:54:05,667 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 00:54:05,829 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 00:54:05,900 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 00:54:06,293 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 00:54:06,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:54:07,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:54:08,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:54:10,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:54:12,296 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:54:14,297 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:54:15,334 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:54:17,298 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:54:19,299 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:54:20,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:54:20,683 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:54:21,300 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:54:23,300 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:54:25,301 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:54:27,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:54:29,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:54:31,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:54:33,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:54:35,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:54:35,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:54:35,906 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:54:37,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:54:39,306 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:54:41,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:54:43,308 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:54:45,308 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:54:45,409 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:54:47,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:54:49,310 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:54:51,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:54:51,211 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:54:51,311 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:54:53,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:54:55,313 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:54:57,314 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:54:59,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:55:01,316 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:55:03,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:55:05,318 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:55:06,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:55:06,440 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:55:07,319 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:55:09,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:55:11,321 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:55:13,322 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:55:15,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:55:15,485 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:55:17,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:55:19,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:55:21,326 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:55:21,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:55:21,790 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:55:23,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:55:25,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:55:27,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:55:29,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:55:31,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:55:33,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:55:35,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:55:37,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:55:37,009 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:55:37,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:55:39,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:55:41,335 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:55:44,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:55:45,560 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:55:46,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:55:48,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:55:50,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:55:52,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:55:52,339 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:55:52,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:55:54,350 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:55:56,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:55:58,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:56:00,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:56:02,354 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:56:04,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:56:06,356 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:56:07,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:56:07,704 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:56:08,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:56:10,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:56:12,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:56:14,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:56:15,635 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:56:16,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:56:18,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:56:20,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:56:22,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:56:22,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:56:22,931 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:56:24,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:56:26,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:56:28,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:56:30,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:56:32,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:56:34,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:56:36,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:56:38,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:56:38,233 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:56:38,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:56:40,371 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:56:42,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:56:44,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:56:45,708 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:56:46,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:56:48,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:56:50,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:56:52,376 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:56:53,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:56:53,460 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:56:54,377 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:56:56,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:56:58,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:57:01,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:57:03,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:57:05,381 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:57:07,382 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:57:08,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:57:08,844 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:57:09,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:57:11,384 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:57:13,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:57:15,386 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:57:15,781 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:57:17,387 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:57:19,388 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:57:21,388 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:57:23,389 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:57:24,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:57:24,133 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:57:25,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:57:27,391 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:57:29,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:57:31,393 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:57:33,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:57:35,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:57:37,395 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:57:39,396 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:57:39,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:57:39,404 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:57:41,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:57:43,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:57:45,399 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:57:45,856 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:57:47,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:57:49,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:57:51,402 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:57:53,402 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:57:54,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:57:54,628 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:57:55,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:57:57,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:57:59,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:58:01,406 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:58:03,407 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:58:05,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:58:07,409 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:58:09,409 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:58:09,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:58:09,978 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:58:11,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:58:13,411 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:58:15,411 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:58:15,921 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:58:17,412 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:58:19,413 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:58:21,414 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:58:23,414 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:58:25,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:58:25,205 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:58:25,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:58:27,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:58:29,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:58:31,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:58:33,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:58:35,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:58:37,419 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:58:39,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:58:40,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:58:40,516 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:58:42,421 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:58:44,421 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:58:45,995 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:58:46,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:58:48,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:58:50,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:58:52,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:58:54,425 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:58:55,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:58:55,797 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:58:56,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:58:58,427 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:59:00,427 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:59:02,428 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:59:04,429 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:59:06,429 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:59:08,430 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:59:10,431 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:59:11,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:59:11,020 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:59:12,432 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:59:14,433 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:59:16,073 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:59:16,434 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:59:18,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:59:20,436 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:59:22,437 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:59:24,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:59:26,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:59:26,279 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:59:26,439 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:59:28,440 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:59:30,440 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:59:32,441 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:59:34,442 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:59:36,443 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:59:38,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:59:40,445 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:59:41,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:59:41,564 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:59:42,446 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:59:44,447 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:59:46,148 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 00:59:46,448 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:59:48,449 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:59:50,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:59:52,451 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:59:54,452 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:59:56,452 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 00:59:56,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 00:59:56,870 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 00:59:58,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:00:00,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:00:02,455 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:00:04,456 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:00:06,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:00:08,458 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:00:10,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:00:12,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:00:12,091 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:00:12,460 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:00:14,461 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:00:16,222 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:00:16,461 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:00:18,462 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:00:20,463 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:00:23,464 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:00:25,465 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:00:27,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:00:27,435 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:00:27,466 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:00:29,467 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:00:31,468 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:00:33,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:00:35,470 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:00:37,471 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:00:39,471 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:00:41,472 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:00:42,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:00:42,660 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:00:43,473 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:00:45,474 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:00:46,298 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:00:47,475 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:00:49,476 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:00:51,477 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:00:53,478 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:00:55,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:00:57,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:00:57,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:00:57,903 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:00:59,480 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:01:01,481 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:01:03,482 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:01:05,483 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:01:07,484 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:01:09,485 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:01:11,486 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:01:13,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:01:13,261 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:01:13,486 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:01:15,487 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:01:16,372 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:01:17,488 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:01:19,489 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:01:21,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:01:23,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:01:25,491 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:01:27,492 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:01:28,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:01:28,490 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:01:29,494 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:01:31,495 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:01:33,495 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:01:35,496 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:01:37,497 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:01:39,498 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:01:41,498 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:01:43,499 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:01:43,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:01:43,791 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:01:45,500 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:01:46,446 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:01:47,501 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:01:49,501 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:01:51,502 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:01:53,503 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:01:55,504 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:01:57,504 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:01:59,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:01:59,014 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:02:00,505 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:02:02,506 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:02:04,506 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:02:06,507 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:02:08,508 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:02:10,509 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:02:12,509 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:02:14,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:02:14,315 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:02:14,510 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:02:16,511 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:02:16,523 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:02:18,512 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:02:20,512 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:02:22,513 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:02:24,514 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:02:26,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:02:28,516 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:02:29,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:02:29,626 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:02:30,517 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:02:32,518 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:02:34,519 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:02:36,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:02:38,521 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:02:40,522 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:02:42,523 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:02:44,524 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:02:44,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:02:44,915 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:02:46,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:02:46,596 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:02:48,526 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:02:50,527 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:02:52,528 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:02:54,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:02:56,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:02:58,530 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:03:00,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:03:00,140 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:03:00,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:03:02,532 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:03:04,532 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:03:06,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:03:08,534 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:03:10,535 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:03:12,536 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:03:14,537 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:03:15,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:03:15,468 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:03:16,537 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:03:16,670 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:03:18,538 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:03:20,539 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:03:22,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:03:24,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:03:26,541 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:03:28,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:03:30,543 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:03:30,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:03:30,692 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:03:32,543 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:03:34,544 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:03:36,545 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:03:38,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:03:40,547 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:03:42,547 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:03:44,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:03:45,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:03:45,950 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:03:46,549 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:03:46,743 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:03:48,550 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:03:51,551 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:03:53,552 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:03:55,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:03:57,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:03:59,555 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:04:01,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:04:01,174 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:04:01,555 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:04:03,556 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:04:05,557 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:04:07,558 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:04:09,559 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:04:11,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:04:13,561 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:04:15,562 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:04:16,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:04:16,465 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:04:16,817 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:04:17,563 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:04:19,564 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:04:21,565 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:04:23,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:04:25,567 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:04:27,568 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:04:29,569 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:04:31,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:04:31,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:04:31,832 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:04:33,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:04:35,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:04:37,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:04:39,574 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:04:41,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:04:43,576 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:04:45,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:04:46,892 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:04:47,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:04:47,136 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:04:47,578 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:04:49,579 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:04:51,580 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:04:53,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:04:55,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:04:57,583 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:04:59,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:05:01,585 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:05:02,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:05:02,433 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:05:03,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:05:05,587 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:05:07,588 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:05:09,589 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:05:11,590 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:05:14,591 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:05:16,592 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:05:16,957 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:05:17,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:05:17,655 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:05:18,593 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:05:20,594 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:05:22,595 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:05:24,596 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:05:26,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:05:28,598 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:05:30,599 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:05:32,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:05:33,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:05:33,015 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:05:34,601 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:05:36,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:05:38,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:05:40,603 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:05:42,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:05:44,605 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:05:46,606 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:05:47,031 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:05:48,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:05:48,389 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:05:48,610 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:05:50,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:05:52,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:05:54,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:05:56,613 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:05:58,614 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:06:00,615 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:06:02,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:06:03,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:06:03,704 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:06:04,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:06:06,617 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:06:08,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:06:10,619 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:06:12,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:06:14,621 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:06:16,621 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:06:17,105 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:06:18,622 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:06:18,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:06:18,975 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:06:20,623 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:06:22,623 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:06:24,624 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:06:26,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:06:28,626 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:06:30,626 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:06:32,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:06:34,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:06:34,198 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:06:34,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:06:36,629 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:06:38,629 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:06:40,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:06:42,631 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:06:44,632 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:06:46,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:06:47,178 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:06:48,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:06:49,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:06:49,439 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:06:50,634 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:06:52,635 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:06:54,636 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:06:56,637 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:06:59,638 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:07:01,639 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:07:03,640 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:07:04,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:07:04,742 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:07:05,641 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:07:07,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:07:09,643 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:07:11,644 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:07:13,645 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:07:15,646 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:07:17,251 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:07:17,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:07:19,648 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:07:19,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:07:19,964 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:07:21,648 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:07:23,649 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:07:25,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:07:27,651 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:07:29,652 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:07:31,653 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:07:33,654 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:07:35,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:07:35,279 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:07:35,655 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:07:37,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:07:39,657 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:07:41,658 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:07:43,659 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:07:45,660 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:07:47,322 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:07:47,661 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:07:49,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:07:50,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:07:50,501 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:07:51,663 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:07:53,664 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:07:55,665 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:07:57,666 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:07:59,667 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:08:01,668 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:08:03,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:08:05,670 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:08:05,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:08:05,896 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:08:07,671 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:08:09,672 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:08:11,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:08:13,674 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:08:15,674 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:08:17,403 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:08:17,675 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:08:20,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:08:21,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:08:21,202 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:08:22,678 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:08:24,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:08:26,680 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:08:28,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:08:30,682 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:08:32,683 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:08:34,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:08:36,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:08:36,501 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:08:36,685 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:08:38,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:08:40,687 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:08:42,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:08:44,689 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:08:46,690 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:08:47,483 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:08:48,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:08:50,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:08:51,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:08:51,729 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:08:52,692 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:08:54,693 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:08:56,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:08:58,695 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:09:00,696 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:09:02,697 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:09:04,698 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:09:06,699 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:09:07,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:09:07,800 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:09:08,700 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:09:10,701 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:09:12,702 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:09:14,703 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:09:16,704 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:09:17,558 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:09:18,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:09:20,706 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:09:22,707 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:09:23,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:09:23,093 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:09:24,708 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:09:26,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:09:28,710 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:09:30,711 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:09:32,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:09:34,713 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:09:36,714 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:09:38,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:09:38,365 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:09:38,715 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:09:40,716 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:09:42,717 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:09:45,719 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:09:47,635 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:09:47,719 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:09:49,720 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:09:51,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:09:53,722 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:09:53,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:09:53,753 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:09:55,723 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:09:57,724 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:09:59,725 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:10:01,726 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:10:03,727 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:10:05,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:10:07,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:10:09,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:10:09,070 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:10:09,729 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:10:11,730 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:10:13,731 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:10:15,732 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:10:17,713 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:10:17,733 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:10:19,733 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:10:21,734 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:10:23,735 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:10:24,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:10:24,351 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:10:25,736 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:10:27,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:10:29,738 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:10:31,739 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:10:33,740 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:10:35,741 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:10:37,742 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:10:39,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:10:39,644 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:10:39,742 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:10:41,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:10:44,745 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:10:46,746 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:10:47,790 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:10:48,747 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:10:50,747 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:10:52,748 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:10:54,749 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:10:54,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:10:54,876 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:10:56,750 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:10:58,751 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:11:00,753 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:11:02,754 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:11:04,755 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:11:06,756 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:11:08,757 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:11:10,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:11:10,214 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:11:10,758 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:11:12,759 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:11:14,759 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:11:16,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:11:17,868 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:11:18,761 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:11:20,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:11:22,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:11:24,763 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:11:25,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:11:25,534 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:11:26,764 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:11:28,765 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:11:30,766 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:11:32,766 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:11:34,767 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:11:36,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:11:38,769 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:11:40,770 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:11:40,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:11:40,813 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:11:42,771 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:11:44,772 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:11:46,772 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:11:47,945 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:11:48,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:11:50,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:11:52,775 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:11:54,776 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:11:56,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:11:56,038 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:11:56,776 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:11:58,777 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:12:00,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:12:02,779 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:12:05,780 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:12:07,781 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:12:09,782 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:12:11,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:12:11,267 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:12:11,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:12:13,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:12:15,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:12:17,785 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:12:18,021 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:12:19,786 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:12:21,787 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:12:23,788 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:12:25,789 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:12:26,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:12:26,568 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:12:27,790 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:12:29,791 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:12:31,792 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:12:33,793 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:12:35,793 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:12:37,794 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:12:39,795 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:12:41,796 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:12:41,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:12:41,911 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:12:43,797 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:12:45,797 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:12:47,798 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:12:48,098 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:12:49,799 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:12:51,800 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:12:53,801 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:12:55,802 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:12:57,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:12:57,171 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:12:57,802 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:12:59,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:13:01,804 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:13:03,804 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:13:05,805 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:13:07,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:13:09,807 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:13:11,808 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:13:12,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:13:12,797 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:13:13,808 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:13:15,809 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:13:17,810 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:13:18,175 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:13:19,811 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:13:21,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:13:23,813 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:13:25,814 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:13:28,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:13:28,059 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:13:28,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:13:30,816 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:13:32,817 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:13:34,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:13:36,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:13:38,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:13:40,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:13:42,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:13:43,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:13:43,343 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:13:44,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:13:46,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:13:48,249 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:13:48,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:13:50,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:13:52,826 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:13:54,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:13:56,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:13:58,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:13:58,676 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:13:58,829 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:14:00,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:14:02,831 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:14:04,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:14:06,833 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:14:08,834 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:14:10,834 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:14:12,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:14:13,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:14:13,971 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:14:14,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:14:16,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:14:18,322 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:14:18,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:14:20,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:14:22,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:14:24,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:14:26,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:14:28,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:14:29,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:14:29,195 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:14:30,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:14:32,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:14:34,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:14:36,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:14:38,846 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:14:40,846 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:14:42,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:14:44,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:14:44,613 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:14:44,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:14:46,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:14:48,400 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:14:48,849 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:14:50,850 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:14:52,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:14:54,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:14:56,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:14:58,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:14:59,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:14:59,837 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:15:00,854 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:15:03,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:15:05,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:15:07,856 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:15:09,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:15:11,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:15:13,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:15:15,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:15:15,067 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:15:15,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:15:17,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:15:18,476 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:15:19,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:15:21,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:15:23,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:15:25,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:15:27,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:15:29,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:15:30,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:15:30,377 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:15:31,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:15:33,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:15:35,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:15:37,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:15:39,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:15:41,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:15:43,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:15:45,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:15:45,608 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:15:45,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:15:47,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:15:48,552 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:15:49,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:15:51,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:15:53,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:15:55,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:15:57,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:15:59,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:16:01,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:16:01,218 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:16:01,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:16:04,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:16:06,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:16:08,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:16:10,882 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:16:12,883 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:16:14,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:16:16,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:16:16,463 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:16:16,885 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:16:18,626 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:16:18,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:16:20,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:16:22,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:16:24,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:16:26,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:16:28,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:16:30,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:16:31,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:16:31,765 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:16:32,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:16:34,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:16:36,894 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:16:38,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:16:40,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:16:42,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:16:44,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:16:46,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:16:47,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:16:47,047 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:16:48,699 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:16:48,900 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:16:50,901 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:16:52,902 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:16:54,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:16:56,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:16:58,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:17:00,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:17:02,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:17:02,280 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:17:02,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:17:04,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:17:06,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:17:08,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:17:10,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:17:12,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:17:14,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:17:16,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:17:17,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:17:17,578 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:17:18,757 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:17:18,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:17:20,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:17:22,916 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:17:24,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:17:26,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:17:28,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:17:30,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:17:32,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:17:32,801 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:17:32,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:17:34,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:17:37,922 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:17:39,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:17:41,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:17:43,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:17:45,925 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:17:47,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:17:48,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:17:48,142 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:17:48,835 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:17:49,927 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:17:51,927 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:17:53,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:17:55,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:17:57,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:17:59,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:18:01,932 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:18:03,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:18:03,576 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:18:03,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:18:05,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:18:07,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:18:09,935 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:18:11,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:18:13,937 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:18:15,938 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:18:17,938 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:18:18,908 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:18:18,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:18:18,915 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:18:19,939 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:18:21,940 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:18:23,941 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:18:25,942 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:18:27,942 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:18:29,944 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:18:31,944 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:18:33,945 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:18:34,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:18:34,267 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:18:35,946 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:18:37,947 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:18:39,948 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:18:41,949 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:18:43,950 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:18:45,951 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:18:47,952 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:18:48,984 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:18:49,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:18:49,540 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:18:49,953 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:18:51,954 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:18:53,954 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:18:55,955 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:18:57,956 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:19:00,957 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:19:02,958 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:19:04,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:19:04,763 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:19:04,959 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:19:06,960 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:19:08,961 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:19:10,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:19:12,963 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:19:14,964 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:19:16,965 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:19:18,966 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:19:19,061 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:19:20,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:19:20,055 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:19:20,967 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:19:22,968 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:19:24,968 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:19:26,969 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:19:28,970 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:19:30,971 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:19:32,972 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:19:34,973 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:19:35,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:19:35,308 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:19:36,974 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:19:38,975 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:19:40,976 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:19:42,977 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:19:44,977 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:19:46,978 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:19:48,979 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:19:49,141 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:19:50,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:19:50,559 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:19:50,980 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:19:52,981 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:19:54,982 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:19:56,983 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:19:58,984 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:20:00,985 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:20:02,986 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:20:04,987 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:20:06,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:20:06,111 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:20:06,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:20:08,989 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:20:10,990 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:20:12,991 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:20:14,992 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:20:16,993 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:20:18,994 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:20:19,218 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:20:20,994 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:20:21,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:20:21,344 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:20:22,995 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:20:24,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:20:26,997 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:20:28,998 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:20:30,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:20:32,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:20:35,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:20:36,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:20:36,665 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:20:37,001 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:20:39,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:20:41,003 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:20:43,004 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:20:46,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:20:48,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:20:49,292 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:20:50,007 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:20:51,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:20:51,904 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:20:52,008 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:20:54,009 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:20:56,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:20:58,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:21:00,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:21:02,012 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:21:04,013 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:21:06,014 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:21:07,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:21:07,201 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:21:08,015 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:21:10,015 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:21:12,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:21:14,017 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:21:16,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:21:18,019 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:21:19,363 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:21:20,019 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:21:22,021 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:21:22,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:21:22,421 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:21:24,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:21:26,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:21:28,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:21:30,025 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:21:32,025 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:21:34,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:21:36,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:21:37,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:21:37,827 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:21:38,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:21:40,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:21:42,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:21:44,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:21:46,031 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:21:48,032 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:21:49,438 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:21:50,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:21:53,034 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:21:53,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:21:53,062 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:21:55,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:21:57,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:21:59,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:22:01,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:22:03,038 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:22:05,038 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:22:07,039 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:22:08,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:22:08,312 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:22:09,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:22:11,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:22:13,041 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:22:15,042 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:22:17,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:22:19,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:22:19,510 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:22:21,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:22:23,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:22:23,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:22:23,578 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:22:25,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:22:27,047 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:22:29,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:22:31,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:22:33,049 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:22:35,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:22:37,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:22:38,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:22:38,795 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:22:39,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:22:41,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:22:43,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:22:45,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:22:47,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:22:49,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:22:49,586 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:22:51,056 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:22:53,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:22:54,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:22:54,131 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:22:55,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:22:57,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:22:59,059 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:23:01,060 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:23:03,061 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:23:05,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:23:07,063 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:23:09,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:23:09,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:23:09,562 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:23:11,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:23:13,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:23:15,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:23:17,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:23:19,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:23:19,659 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:23:21,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:23:23,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:23:24,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:23:24,793 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:23:25,071 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:23:27,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:23:29,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:23:31,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:23:33,074 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:23:35,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:23:37,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:23:39,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:23:40,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:23:40,224 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:23:41,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:23:43,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:23:45,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:23:47,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:23:49,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:23:49,733 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:23:51,081 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:23:53,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:23:55,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:23:55,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:23:55,517 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:23:58,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:24:00,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:24:02,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:24:04,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:24:06,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:24:08,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:24:10,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:24:12,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:24:12,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:24:12,306 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:24:14,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:24:16,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:24:18,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:24:19,807 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:24:20,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:24:22,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:24:24,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:24:26,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:24:27,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:24:27,703 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:24:28,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:24:30,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:24:32,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:24:34,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:24:36,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:24:38,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:24:40,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:24:42,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:24:42,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:24:42,982 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:24:44,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:24:46,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:24:48,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:24:49,879 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:24:50,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:24:52,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:24:54,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:24:56,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:24:58,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:24:58,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:24:58,333 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:25:00,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:25:02,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:25:04,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:25:06,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:25:08,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:25:10,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:25:12,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:25:13,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:25:13,556 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:25:14,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:25:16,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:25:18,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:25:19,952 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:25:20,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:25:22,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:25:24,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:25:26,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:25:28,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:25:28,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:25:28,849 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:25:31,121 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:25:33,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:25:35,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:25:37,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:25:39,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:25:41,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:25:43,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:25:44,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:25:44,156 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:25:45,128 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:25:47,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:25:49,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:25:50,029 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:25:51,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:25:53,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:25:55,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:25:57,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:25:59,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:25:59,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:25:59,386 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:26:01,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:26:03,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:26:05,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:26:07,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:26:09,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:26:11,140 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:26:13,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:26:14,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:26:14,700 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:26:15,142 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:26:17,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:26:19,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:26:20,105 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:26:21,145 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:26:23,146 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:26:25,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:26:27,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:26:29,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:26:30,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:26:30,023 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:26:31,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:26:33,150 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:26:35,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:26:37,152 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:26:39,153 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:26:41,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:26:43,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:26:45,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:26:45,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:26:45,486 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:26:47,157 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:26:49,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:26:50,181 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:26:51,159 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:26:53,160 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:26:55,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:26:57,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:26:59,162 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:27:00,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:27:00,712 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:27:01,163 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:27:03,164 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:27:05,164 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:27:08,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:27:10,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:27:12,168 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:27:14,168 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:27:16,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:27:16,002 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:27:16,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:27:18,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:27:20,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:27:20,252 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:27:22,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:27:24,172 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:27:26,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:27:28,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:27:30,175 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:27:31,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:27:31,274 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:27:32,176 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:27:34,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:27:36,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:27:38,179 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:27:40,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:27:42,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:27:44,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:27:46,182 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:27:46,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:27:46,496 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:27:48,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:27:50,184 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:27:50,326 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:27:52,185 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:27:54,186 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:27:56,187 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:27:58,188 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:28:00,189 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:28:01,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:28:01,836 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:28:02,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:28:04,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:28:06,191 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:28:08,192 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:28:10,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:28:12,194 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:28:14,194 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:28:16,195 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:28:17,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:28:17,185 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:28:18,196 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:28:20,197 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:28:20,398 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:28:22,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:28:24,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:28:26,199 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:28:29,200 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:28:31,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:28:32,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:28:32,425 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:28:33,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:28:35,202 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:28:37,203 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:28:39,204 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:28:41,205 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:28:43,205 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:28:45,206 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:28:47,207 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:28:47,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:28:47,642 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:28:49,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:28:50,477 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:28:51,209 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:28:53,210 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:28:55,211 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:28:57,212 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:28:59,213 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:29:01,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:29:02,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:29:02,943 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:29:03,215 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:29:05,216 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:29:07,217 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:29:09,218 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:29:11,219 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:29:13,220 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:29:15,221 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:29:17,222 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:29:18,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:29:18,168 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:29:19,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:29:20,544 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:29:21,224 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:29:23,225 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:29:25,225 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:29:27,226 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:29:29,227 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:29:31,228 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:29:33,229 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:29:33,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:29:33,531 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:29:35,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:29:37,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:29:39,231 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:29:41,232 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:29:43,233 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:29:45,234 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:29:48,235 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:29:48,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:29:48,805 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:29:50,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:29:50,605 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:29:52,237 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:29:54,238 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:29:56,239 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:29:58,239 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:30:00,240 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:30:02,241 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:30:04,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:30:04,076 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:30:04,242 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:30:06,243 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:30:08,244 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:30:10,245 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:30:12,246 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:30:14,247 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:30:16,249 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:30:18,249 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:30:19,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:30:19,300 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:30:20,250 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:30:20,679 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:30:22,251 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:30:24,252 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:30:26,253 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:30:28,254 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:30:30,255 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:30:32,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:30:34,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:30:34,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:30:34,614 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:30:36,257 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:30:38,258 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:30:40,259 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:30:42,260 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:30:44,261 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:30:46,262 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:30:48,262 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:30:49,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:30:49,960 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:30:50,263 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:30:50,756 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:30:52,264 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:30:54,265 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:30:56,266 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:30:58,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:31:00,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:31:02,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:31:04,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:31:05,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:31:05,212 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:31:06,270 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:31:08,271 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:31:10,271 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:31:12,272 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:31:15,274 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:31:17,274 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:31:19,275 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:31:20,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:31:20,440 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:31:20,828 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:31:21,276 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:31:23,277 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:31:25,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:31:27,279 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:31:29,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:31:31,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:31:33,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:31:35,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:31:35,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:31:35,665 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:31:37,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:31:39,283 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:31:41,283 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:31:43,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:31:45,285 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:31:47,285 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:31:49,286 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:31:50,903 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:31:51,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:31:51,054 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:31:51,286 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:31:53,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:31:55,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:31:57,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:31:59,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:32:01,290 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:32:03,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:32:05,292 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:32:06,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:32:06,384 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:32:07,293 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:32:09,293 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:32:11,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:32:13,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:32:15,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:32:17,296 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:32:19,297 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:32:20,967 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:32:21,297 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:32:21,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:32:21,640 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:32:23,298 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:32:25,300 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:32:27,300 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:32:29,301 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:32:31,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:32:33,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:32:35,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:32:36,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:32:36,975 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:32:38,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:32:40,306 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:32:42,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:32:44,308 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:32:46,310 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:32:48,310 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:32:50,311 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:32:51,041 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:32:52,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:32:52,218 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:32:52,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:32:54,313 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:32:56,314 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:32:58,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:33:00,316 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:33:02,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:33:04,318 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:33:06,319 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:33:07,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:33:07,492 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:33:08,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:33:10,321 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:33:12,322 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:33:14,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:33:16,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:33:18,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:33:20,326 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:33:21,118 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:33:22,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:33:22,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:33:22,816 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:33:24,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:33:26,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:33:28,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:33:30,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:33:32,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:33:34,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:33:36,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:33:38,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:33:38,048 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:33:38,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:33:40,335 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:33:42,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:33:44,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:33:46,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:33:48,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:33:50,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:33:51,193 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:33:52,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:33:53,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:33:53,285 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:33:54,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:33:56,342 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:33:58,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:34:00,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:34:02,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:34:04,346 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:34:06,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:34:08,348 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:34:08,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:34:08,533 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:34:10,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:34:12,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:34:15,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:34:17,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:34:19,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:34:21,271 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:34:21,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:34:23,354 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:34:23,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:34:23,759 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:34:25,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:34:27,356 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:34:29,356 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:34:31,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:34:33,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:34:35,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:34:37,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:34:38,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:34:38,986 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:34:39,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:34:41,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:34:43,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:34:45,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:34:47,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:34:49,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:34:51,348 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:34:51,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:34:53,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:34:54,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:34:54,279 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:34:55,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:34:57,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:34:59,371 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:35:01,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:35:03,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:35:05,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:35:07,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:35:09,376 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:35:09,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:35:09,539 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:35:11,376 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:35:13,377 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:35:15,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:35:17,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:35:19,379 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:35:21,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:35:21,418 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:35:23,381 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:35:24,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:35:24,814 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:35:25,382 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:35:27,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:35:29,384 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:35:31,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:35:33,386 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:35:35,387 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:35:37,388 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:35:39,389 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:35:40,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:35:40,136 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:35:41,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:35:43,391 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:35:46,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:35:48,393 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:35:50,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:35:51,492 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:35:52,395 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:35:54,396 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:35:55,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:35:55,501 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:35:56,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:35:58,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:36:00,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:36:02,399 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:36:04,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:36:06,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:36:08,402 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:36:10,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:36:10,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:36:10,727 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:36:12,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:36:14,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:36:16,406 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:36:18,407 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:36:20,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:36:21,573 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:36:22,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:36:24,409 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:36:26,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:36:26,063 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:36:26,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:36:28,411 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:36:30,412 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:36:32,413 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:36:34,414 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:36:36,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:36:38,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:36:40,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:36:41,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:36:41,334 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:36:42,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:36:44,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:36:46,419 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:36:49,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:36:51,421 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:36:51,647 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:36:53,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:36:55,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:36:56,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:36:56,556 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:36:57,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:36:59,425 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:37:01,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:37:03,427 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:37:05,428 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:37:07,429 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:37:09,430 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:37:11,431 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:37:11,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:37:11,872 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:37:13,432 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:37:15,433 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:37:17,434 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:37:19,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:37:21,436 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:37:21,723 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:37:23,437 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:37:25,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:37:27,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:37:27,218 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:37:27,440 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:37:29,441 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:37:31,442 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:37:33,443 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:37:35,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:37:37,445 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:37:39,446 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:37:41,447 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:37:42,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:37:42,467 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:37:43,448 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:37:45,449 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:37:47,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:37:49,451 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:37:51,452 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:37:51,794 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:37:53,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:37:55,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:37:57,455 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:37:57,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:37:57,762 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:37:59,456 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:38:01,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:38:03,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:38:05,458 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:38:07,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:38:13,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:38:13,017 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:38:21,872 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:38:28,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:38:28,265 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:38:43,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:38:43,530 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:38:51,946 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:38:58,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:38:58,795 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:39:08,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:39:08,572 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 01:39:08,625 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 01:39:08,709 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 01:39:09,483 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 01:39:10,483 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:39:14,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:39:14,083 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:39:18,487 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:39:22,045 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:39:29,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:39:29,337 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:39:40,497 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:39:44,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:39:44,569 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:39:52,124 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:39:59,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:39:59,798 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:40:15,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:40:15,069 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:40:22,201 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:40:30,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:40:30,346 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:40:45,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:40:45,574 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:40:52,276 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:41:00,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:41:00,794 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:41:16,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:41:16,022 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:41:22,355 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:41:31,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:41:31,243 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:41:46,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:41:46,473 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:41:52,433 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:42:01,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:42:01,696 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:42:16,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:42:16,952 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:42:22,511 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:42:32,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:42:32,177 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:42:47,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:42:47,404 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:42:52,588 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:43:02,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:43:02,631 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:43:17,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:43:17,909 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:43:22,665 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:43:32,595 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:43:33,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:43:33,135 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:43:34,596 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:43:36,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:43:44,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:44,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:44,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:44,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:44,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:44,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:44,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:44,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:44,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:44,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:44,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:44,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:44,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:44,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:44,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:44,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:46,601 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:43:46,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:46,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:46,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:46,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:46,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:46,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:46,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:46,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:46,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:46,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:46,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:46,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:46,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:46,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:46,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:46,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:48,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:43:48,450 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:43:49,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:49,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:49,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:49,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:49,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:49,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:49,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:49,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:49,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:49,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:49,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:49,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:49,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:49,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:49,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:49,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:43:51,603 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:43:52,742 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:43:57,605 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:44:00,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:00,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:00,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:00,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:00,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:00,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:00,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:00,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:00,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:00,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:00,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:00,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:00,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:00,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:00,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:00,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:01,607 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:44:03,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:44:03,689 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:44:05,609 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:44:06,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:06,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:06,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:06,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:06,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:06,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:06,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:06,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:06,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:06,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:06,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:06,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:06,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:06,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:06,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:06,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:09,610 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:44:11,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:11,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:11,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:11,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:11,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:11,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:11,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:11,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:11,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:11,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:11,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:11,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:11,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:11,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:11,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:11,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:13,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:44:15,613 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:44:18,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:44:18,918 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:44:19,614 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:44:21,615 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:44:21,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:21,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:21,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:21,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:21,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:21,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:21,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:21,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:21,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:21,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:21,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:21,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:21,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:21,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:21,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:21,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:22,820 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:44:25,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:44:27,617 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:44:27,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:27,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:27,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:27,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:27,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:27,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:27,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:27,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:27,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:27,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:27,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:27,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:27,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:27,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:27,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:27,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:30,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:30,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:30,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:30,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:30,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:30,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:30,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:30,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:30,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:30,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:30,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:30,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:30,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:30,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:30,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:30,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:31,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:44:33,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:33,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:33,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:33,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:33,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:33,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:33,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:33,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:33,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:33,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:33,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:33,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:33,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:33,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:33,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:33,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:33,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:33,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:33,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:33,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:33,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:33,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:33,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:33,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:33,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:33,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:33,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:33,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:33,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:33,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:33,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:33,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:33,619 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:44:34,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:44:34,228 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:44:37,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:44:38,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:38,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:38,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:38,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:38,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:38,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:38,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:38,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:38,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:38,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:38,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:38,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:38,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:38,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:38,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:38,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:39,621 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:44:41,622 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:44:45,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:45,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:45,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:45,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:45,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:45,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:45,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:45,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:45,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:45,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:45,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:45,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:45,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:45,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:45,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:45,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:45,623 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:44:47,624 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:44:49,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:44:49,451 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:44:49,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:44:51,626 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:44:52,896 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:44:53,626 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:44:54,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:54,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:54,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:54,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:54,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:54,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:54,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:54,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:54,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:54,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:54,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:54,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:54,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:54,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:54,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:54,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:55,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:55,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:55,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:55,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:55,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:55,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:55,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:55,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:55,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:55,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:55,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:55,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:55,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:55,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:55,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:55,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:44:55,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:44:57,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:45:01,629 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:45:03,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:45:04,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:45:04,682 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:45:05,631 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:45:07,632 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:45:07,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:07,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:07,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:07,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:07,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:07,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:07,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:07,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:07,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:07,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:07,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:07,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:07,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:07,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:07,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:07,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:09,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:45:11,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:45:12,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:12,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:12,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:12,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:12,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:12,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:12,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:12,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:12,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:12,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:12,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:12,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:12,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:12,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:12,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:12,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:13,634 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:45:15,635 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:45:15,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:15,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:15,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:15,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:15,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:15,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:15,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:15,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:15,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:15,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:15,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:15,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:15,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:15,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:15,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:15,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:16,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:16,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:16,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:16,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:16,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:16,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:16,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:16,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:16,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:16,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:16,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:16,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:16,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:16,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:16,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:16,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:17,636 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:45:19,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:19,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:19,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:19,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:19,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:19,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:19,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:19,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:19,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:19,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:19,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:19,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:19,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:19,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:19,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:19,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:19,636 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:45:19,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:45:19,966 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:45:20,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:20,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:20,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:20,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:20,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:20,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:20,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:20,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:20,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:20,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:20,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:20,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:20,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:20,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:20,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:20,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:21,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:21,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:21,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:21,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:21,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:21,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:21,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:21,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:21,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:21,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:21,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:21,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:21,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:21,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:21,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:21,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:21,637 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:45:22,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:22,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:22,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:22,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:22,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:22,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:22,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:22,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:22,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:22,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:22,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:22,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:22,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:22,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:22,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:22,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:22,965 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:45:23,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:23,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:23,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:23,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:23,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:23,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:23,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:23,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:23,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:23,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:23,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:23,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:23,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:23,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:23,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:23,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:23,638 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:45:24,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:24,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:24,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:24,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:24,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:24,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:24,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:24,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:24,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:24,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:24,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:24,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:24,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:24,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:24,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:24,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:24,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:24,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:24,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:24,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:24,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:24,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:24,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:24,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:24,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:24,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:24,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:24,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:24,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:24,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:24,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:24,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:25,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:25,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:25,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:25,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:25,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:25,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:25,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:25,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:25,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:25,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:25,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:25,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:25,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:25,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:25,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:25,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:25,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:25,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:25,640 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:45:25,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:25,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:25,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:25,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:25,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:25,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:25,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:25,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:25,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:25,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:25,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:25,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:25,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:25,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:26,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:26,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:26,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:26,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:26,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:26,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:26,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:26,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:26,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:26,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:26,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:26,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:26,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:26,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:26,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:26,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:27,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:27,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:27,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:27,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:27,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:27,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:27,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:27,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:27,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:27,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:27,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:27,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:27,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:27,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:27,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:27,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:27,641 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:45:28,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:28,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:28,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:28,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:28,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:28,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:28,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:28,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:28,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:28,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:28,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:28,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:28,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:28,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:28,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:28,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:28,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:28,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:28,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:28,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:28,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:28,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:28,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:28,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:28,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:28,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:28,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:28,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:28,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:28,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:28,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:28,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,641 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:45:29,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:29,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:30,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:31,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:45:31,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:31,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:31,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:31,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:31,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:31,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:31,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:31,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:31,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:31,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:31,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:31,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:31,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:31,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:31,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:31,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:32,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:33,643 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:45:34,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:34,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:34,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:34,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:34,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:34,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:34,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:34,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:34,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:34,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:34,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:34,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:34,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:34,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:34,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:34,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:35,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:35,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:35,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:35,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:35,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:35,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:35,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:35,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:35,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:35,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:35,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:35,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:35,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:35,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:35,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:35,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:35,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:35,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:35,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:35,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:35,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:45:35,191 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:45:35,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:35,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:35,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:35,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:35,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:35,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:35,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:35,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:36,644 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:45:38,645 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:45:46,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:46,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:46,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:46,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:46,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:46,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:46,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:46,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:46,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:46,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:46,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:46,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:46,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:46,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:46,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:46,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:46,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:46,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:46,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:46,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:46,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:46,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:46,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:46,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:46,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:46,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:46,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:46,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:46,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:46,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:46,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:46,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:46,648 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:45:50,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:45:50,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:45:50,798 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:45:53,038 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:45:53,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:53,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:53,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:53,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:53,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:53,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:53,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:53,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:53,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:53,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:53,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:53,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:53,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:53,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:53,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:53,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:55,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:55,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:55,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:55,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:55,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:55,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:55,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:55,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:55,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:55,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:55,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:55,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:55,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:55,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:55,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:55,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:45:56,652 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:46:00,653 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:46:03,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:03,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:03,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:03,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:03,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:03,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:03,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:03,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:03,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:03,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:03,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:03,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:03,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:03,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:03,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:03,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:04,655 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:46:04,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:04,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:04,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:04,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:04,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:04,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:04,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:04,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:04,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:04,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:04,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:04,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:04,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:04,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:04,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:04,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:06,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:46:06,179 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:46:06,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:46:10,657 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:46:14,659 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:46:18,661 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:46:18,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:18,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:18,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:18,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:18,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:18,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:18,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:18,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:18,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:18,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:18,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:18,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:18,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:18,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:18,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:18,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:20,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:46:20,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:20,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:20,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:20,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:20,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:20,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:20,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:20,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:20,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:20,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:20,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:20,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:20,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:20,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:20,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:20,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:21,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:46:21,407 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:46:22,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:22,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:22,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:22,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:22,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:22,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:22,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:22,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:22,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:22,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:22,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:22,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:22,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:22,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:22,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:22,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:23,111 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:46:24,663 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:46:26,664 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:46:31,666 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:46:32,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:32,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:32,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:32,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:32,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:32,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:32,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:32,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:32,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:32,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:32,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:32,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:32,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:32,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:32,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:32,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:33,667 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:46:36,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:36,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:36,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:36,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:36,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:36,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:36,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:36,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:36,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:36,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:36,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:36,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:36,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:36,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:36,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:36,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:36,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:46:36,630 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:46:36,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:36,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:36,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:36,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:36,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:36,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:36,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:36,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:36,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:36,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:36,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:36,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:36,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:36,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:36,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:36,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:37,668 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:46:38,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:38,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:38,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:38,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:38,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:38,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:38,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:38,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:38,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:38,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:38,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:38,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:38,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:38,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:38,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:38,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:39,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:46:40,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:40,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:40,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:40,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:40,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:40,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:40,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:40,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:40,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:40,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:40,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:40,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:40,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:40,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:40,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:40,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:41,670 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:46:43,671 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:46:47,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:47,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:47,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:47,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:47,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:47,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:47,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:47,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:47,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:47,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:47,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:47,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:47,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:47,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:47,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:47,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:47,672 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:46:49,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:46:51,674 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:46:51,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:46:51,847 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:46:53,186 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:46:53,675 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:46:55,676 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:46:58,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:58,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:58,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:58,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:58,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:58,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:58,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:58,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:58,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:58,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:58,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:58,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:58,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:58,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:58,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:58,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:46:59,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:47:01,678 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:47:01,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:01,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:01,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:01,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:01,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:01,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:01,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:01,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:01,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:01,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:01,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:01,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:01,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:01,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:01,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:01,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:03,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:47:05,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:47:07,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:47:07,142 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:47:07,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:07,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:07,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:07,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:07,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:07,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:07,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:07,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:07,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:07,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:07,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:07,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:07,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:07,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:07,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:07,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:07,680 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:47:09,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:47:11,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:47:13,682 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:47:15,683 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:47:16,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:16,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:16,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:16,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:16,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:16,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:16,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:16,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:16,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:16,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:16,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:16,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:16,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:16,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:16,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:16,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:17,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:17,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:17,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:17,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:17,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:17,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:17,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:17,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:17,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:17,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:17,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:17,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:17,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:17,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:17,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:17,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:17,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:47:19,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:19,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:19,685 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:47:19,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:19,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:19,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:19,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:19,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:19,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:19,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:19,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:19,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:19,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:19,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:19,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:19,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:19,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:21,685 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:47:21,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:21,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:21,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:21,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:21,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:21,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:21,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:21,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:21,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:21,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:21,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:21,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:21,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:21,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:21,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:21,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:22,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:47:22,369 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:47:23,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:23,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:23,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:23,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:23,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:23,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:23,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:23,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:23,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:23,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:23,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:23,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:23,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:23,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:23,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:23,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:23,260 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:47:23,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:47:24,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:24,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:24,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:24,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:24,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:24,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:24,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:24,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:24,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:24,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:24,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:24,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:24,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:24,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:24,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:24,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:24,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:24,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:24,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:24,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:24,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:24,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:24,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:24,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:24,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:24,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:24,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:24,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:24,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:24,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:24,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:24,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:25,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:25,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:25,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:25,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:25,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:25,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:25,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:25,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:25,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:25,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:25,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:25,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:25,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:25,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:25,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:25,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:25,687 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:47:26,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:26,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:27,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:47:28,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:28,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:28,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:28,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:28,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:28,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:28,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:28,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:28,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:28,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:28,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:28,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:28,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:28,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:28,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:28,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:28,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:28,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:28,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:28,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:28,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:28,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:28,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:28,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:28,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:28,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:28,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:28,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:28,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:28,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:28,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:28,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:29,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:29,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:29,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:29,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:29,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:29,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:29,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:29,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:29,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:29,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:29,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:29,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:29,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:29,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:29,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:29,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:29,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:47:30,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:30,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:30,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:30,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:30,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:30,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:30,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:30,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:30,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:30,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:30,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:30,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:30,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:30,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:30,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:30,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:30,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:30,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:30,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:30,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:30,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:30,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:30,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:30,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:30,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:30,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:30,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:30,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:30,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:30,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:30,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:30,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,689 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:47:31,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:31,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:32,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:32,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:32,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:32,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:32,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:32,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:32,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:32,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:32,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:32,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:32,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:32,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:32,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:32,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:32,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:32,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,690 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:47:33,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:33,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:34,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:35,016 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 01:47:35,267 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 01:47:35,345 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 01:47:35,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 01:47:35,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:47:37,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:47:37,583 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:47:38,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:38,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:38,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:38,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:38,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:38,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:38,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:38,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:38,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:38,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:38,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:38,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:38,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:38,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:38,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:38,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:43,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:47:49,695 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:47:50,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:50,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:50,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:50,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:50,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:50,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:50,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:50,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:50,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:50,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:50,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:50,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:50,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:50,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:50,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:50,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:52,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:52,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:52,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:52,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:52,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:52,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:52,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:52,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:52,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:52,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:52,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:52,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:52,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:52,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:52,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:52,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:52,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:47:52,808 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:47:53,389 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:47:53,697 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:47:57,699 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:47:58,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:58,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:58,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:58,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:58,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:58,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:58,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:58,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:58,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:58,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:58,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:58,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:58,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:58,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:58,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:47:58,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:00,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:00,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:00,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:00,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:00,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:00,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:00,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:00,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:00,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:00,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:00,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:00,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:00,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:00,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:00,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:00,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:01,700 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:48:04,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:04,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:04,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:04,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:04,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:04,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:04,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:04,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:04,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:04,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:04,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:04,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:04,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:04,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:04,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:04,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:05,701 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:48:07,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:07,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:07,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:07,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:07,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:07,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:07,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:07,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:07,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:07,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:07,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:07,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:07,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:07,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:07,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:07,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:08,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:48:08,370 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:48:09,703 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:48:13,704 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:48:14,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:14,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:14,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:14,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:14,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:14,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:14,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:14,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:14,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:14,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:14,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:14,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:14,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:14,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:14,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:14,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:16,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:48:20,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:20,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:20,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:20,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:20,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:20,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:20,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:20,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:20,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:20,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:20,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:20,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:20,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:20,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:20,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:20,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:20,707 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:48:22,708 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:48:23,460 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:48:23,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:48:23,673 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:48:26,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:48:26,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:26,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:26,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:26,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:26,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:26,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:26,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:26,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:26,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:26,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:26,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:26,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:26,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:26,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:26,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:26,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:28,710 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:48:29,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:29,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:29,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:29,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:29,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:29,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:29,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:29,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:29,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:29,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:29,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:29,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:29,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:29,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:29,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:29,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:32,711 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:48:33,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:33,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:33,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:33,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:33,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:33,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:33,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:33,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:33,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:33,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:33,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:33,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:33,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:33,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:33,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:33,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:34,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:48:36,713 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:48:38,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:48:38,895 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:48:40,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:40,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:40,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:40,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:40,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:40,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:40,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:40,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:40,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:40,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:40,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:40,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:40,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:40,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:40,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:40,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:40,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:40,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:40,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:40,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:40,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:40,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:40,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:40,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:40,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:40,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:40,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:40,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:40,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:40,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:40,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:40,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:40,714 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:48:42,715 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:48:42,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:42,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:42,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:42,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:42,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:42,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:42,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:42,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:42,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:42,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:42,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:42,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:42,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:42,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:42,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:42,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:42,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:42,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:42,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:42,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:42,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:42,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:42,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:42,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:42,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:42,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:42,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:42,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:42,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:42,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:42,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:42,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:44,716 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:48:45,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:45,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:45,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:45,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:45,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:45,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:45,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:45,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:45,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:45,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:45,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:45,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:45,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:45,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:45,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:45,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:48:48,717 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:48:50,718 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:48:52,719 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:48:53,534 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:48:54,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:48:54,140 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:48:54,720 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:48:56,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:48:58,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:49:00,722 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:49:02,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:02,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:02,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:02,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:02,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:02,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:02,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:02,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:02,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:02,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:02,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:02,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:02,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:02,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:02,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:02,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:02,723 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:49:04,724 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:49:06,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:06,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:06,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:06,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:06,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:06,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:06,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:06,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:06,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:06,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:06,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:06,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:06,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:06,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:06,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:06,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:06,725 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:49:08,725 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:49:09,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:49:09,754 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:49:10,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:10,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:10,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:10,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:10,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:10,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:10,726 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:49:10,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:10,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:10,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:10,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:10,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:10,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:10,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:10,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:10,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:10,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:12,727 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:49:14,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:49:16,729 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:49:17,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:17,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:17,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:17,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:17,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:17,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:17,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:17,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:17,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:17,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:17,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:17,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:17,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:17,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:17,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:17,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:18,729 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:49:19,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:19,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:19,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:19,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:19,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:19,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:19,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:19,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:19,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:19,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:19,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:19,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:19,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:19,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:19,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:19,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:20,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:20,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:20,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:20,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:20,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:20,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:20,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:20,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:20,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:20,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:20,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:20,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:20,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:20,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:20,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:20,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:20,730 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:49:22,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:22,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:22,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:22,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:22,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:22,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:22,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:22,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:22,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:22,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:22,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:22,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:22,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:22,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:22,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:22,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:22,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:22,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:22,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:22,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:22,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:22,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:22,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:22,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:22,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:22,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:22,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:22,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:22,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:22,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:22,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:22,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:22,731 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:49:23,610 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:49:24,732 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:49:24,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:49:24,977 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:49:25,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:25,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:25,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:25,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:25,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:25,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:25,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:25,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:25,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:25,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:25,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:25,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:25,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:25,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:25,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:25,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:26,732 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:49:26,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:26,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:26,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:26,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:26,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:26,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:26,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:26,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:26,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:26,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:26,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:26,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:26,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:26,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:26,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:26,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:27,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:27,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:27,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:27,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:27,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:27,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:27,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:27,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:27,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:27,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:27,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:27,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:27,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:27,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:27,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:27,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:28,733 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:49:29,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:29,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:29,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:29,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:29,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:29,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:29,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:29,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:29,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:29,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:29,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:29,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:29,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:29,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:29,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:29,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:29,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:29,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:29,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:29,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:29,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:29,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:29,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:29,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:29,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:29,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:29,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:29,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:29,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:29,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:29,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:29,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:30,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:30,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:30,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:30,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:30,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:30,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:30,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:30,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:30,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:30,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:30,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:30,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:30,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:30,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:30,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:30,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:30,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:30,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:30,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:30,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:30,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:30,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:30,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:30,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:30,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:30,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:30,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:30,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:30,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:30,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:30,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:30,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:30,734 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:49:31,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:31,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:31,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:31,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:31,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:31,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:31,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:31,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:31,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:31,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:31,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:31,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:31,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:31,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:31,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:31,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:31,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:31,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:31,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:31,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:31,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:31,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:31,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:31,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:31,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:31,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:31,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:31,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:31,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:31,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:31,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:31,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:32,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:32,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:32,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:32,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:32,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:32,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:32,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:32,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:32,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:32,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:32,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:32,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:32,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:32,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:32,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:32,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:32,734 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:49:33,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:33,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:34,736 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:49:37,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:37,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:40,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:49:40,348 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:49:41,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:41,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:41,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:41,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:41,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:41,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:41,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:41,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:41,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:41,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:41,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:41,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:41,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:41,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:41,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:41,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,739 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:49:44,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:44,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:48,741 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:49:51,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:51,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:51,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:51,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:51,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:51,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:51,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:51,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:51,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:51,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:51,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:51,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:51,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:51,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:51,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:51,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:53,686 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:49:54,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:49:55,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:49:55,566 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:49:56,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:56,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:56,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:56,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:56,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:56,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:56,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:56,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:56,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:56,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:56,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:56,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:56,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:56,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:56,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:56,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:49:58,745 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:50:03,746 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:50:05,747 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:50:07,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:07,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:07,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:07,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:07,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:07,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:07,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:07,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:07,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:07,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:07,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:07,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:07,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:07,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:07,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:07,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:09,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:09,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:09,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:09,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:09,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:09,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:09,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:09,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:09,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:09,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:09,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:09,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:09,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:09,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:09,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:09,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:09,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:09,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:09,749 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:50:09,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:09,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:09,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:09,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:09,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:09,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:09,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:09,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:09,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:09,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:09,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:09,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:09,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:09,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:10,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:50:10,831 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:50:12,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:12,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:12,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:12,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:12,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:12,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:12,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:12,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:12,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:12,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:12,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:12,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:12,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:12,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:12,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:12,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:13,750 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:50:15,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:15,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:15,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:15,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:15,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:15,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:15,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:15,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:15,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:15,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:15,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:15,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:15,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:15,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:15,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:15,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:17,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:17,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:17,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:17,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:17,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:17,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:17,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:17,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:17,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:17,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:17,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:17,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:17,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:17,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:17,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:17,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:17,751 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:50:19,752 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:50:23,753 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:50:23,762 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:50:25,754 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:50:26,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:50:26,086 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:50:28,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:28,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:28,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:28,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:28,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:28,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:28,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:28,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:28,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:28,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:28,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:28,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:28,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:28,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:28,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:28,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:29,755 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:50:31,756 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:50:32,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:32,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:32,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:32,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:32,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:32,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:32,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:32,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:32,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:32,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:32,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:32,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:32,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:32,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:32,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:32,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:33,757 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:50:34,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:34,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:34,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:34,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:34,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:34,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:34,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:34,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:34,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:34,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:34,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:34,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:34,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:34,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:34,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:34,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:37,758 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:50:39,759 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:50:39,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:39,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:39,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:39,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:39,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:39,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:39,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:39,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:39,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:39,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:39,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:39,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:39,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:39,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:39,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:39,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:41,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:50:41,313 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:50:41,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:50:42,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:42,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:42,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:42,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:42,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:42,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:42,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:42,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:42,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:42,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:42,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:42,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:42,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:42,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:42,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:42,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:43,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:43,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:43,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:43,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:43,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:43,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:43,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:43,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:43,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:43,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:43,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:43,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:43,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:43,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:43,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:43,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:45,761 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:50:46,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:46,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:46,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:46,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:46,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:46,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:46,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:46,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:46,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:46,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:46,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:46,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:46,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:46,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:46,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:46,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:46,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:46,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:46,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:46,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:46,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:46,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:46,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:46,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:46,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:46,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:46,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:46,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:46,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:46,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:46,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:46,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:47,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:50:48,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:48,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:48,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:48,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:48,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:48,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:48,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:48,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:48,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:48,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:48,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:48,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:48,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:48,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:48,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:48,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:50:49,763 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:50:51,763 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:50:53,764 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:50:53,833 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:50:55,765 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:50:56,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:50:56,622 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:50:59,766 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:51:01,767 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:51:03,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:51:04,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:04,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:04,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:04,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:04,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:04,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:04,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:04,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:04,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:04,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:04,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:04,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:04,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:04,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:04,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:04,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:05,769 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:51:07,770 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:51:09,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:09,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:09,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:09,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:09,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:09,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:09,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:09,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:09,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:09,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:09,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:09,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:09,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:09,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:09,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:09,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:09,770 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:51:10,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:10,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:10,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:10,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:10,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:10,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:10,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:10,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:10,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:10,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:10,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:10,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:10,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:10,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:10,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:10,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:11,771 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:51:11,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:51:11,863 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:51:13,772 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:51:15,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:15,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:15,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:15,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:15,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:15,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:15,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:15,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:15,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:15,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:15,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:15,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:15,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:15,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:15,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:15,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:15,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:51:17,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:51:19,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:51:20,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:20,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:20,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:20,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:20,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:20,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:20,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:20,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:20,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:20,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:20,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:20,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:20,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:20,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:20,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:20,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:21,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:21,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:21,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:21,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:21,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:21,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:21,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:21,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:21,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:21,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:21,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:21,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:21,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:21,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:21,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:21,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:21,775 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:51:22,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:22,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:22,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:22,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:22,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:22,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:22,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:22,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:22,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:22,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:22,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:22,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:22,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:22,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:22,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:22,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:23,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:23,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:23,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:23,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:23,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:23,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:23,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:23,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:23,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:23,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:23,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:23,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:23,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:23,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:23,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:23,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:23,776 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:51:23,904 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:51:25,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:25,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:25,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:25,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:25,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:25,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:25,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:25,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:25,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:25,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:25,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:25,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:25,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:25,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:25,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:25,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:25,777 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:51:27,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:51:27,086 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:51:27,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:27,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:27,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:27,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:27,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:27,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:27,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:27,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:27,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:27,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:27,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:27,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:27,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:27,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:27,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:27,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:27,777 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:51:28,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:28,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:28,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:28,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:28,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:28,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:28,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:28,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:28,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:28,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:28,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:28,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:28,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:28,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:28,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:28,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:28,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:28,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:28,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:28,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:28,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:28,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:28,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:28,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:28,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:28,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:28,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:28,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:28,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:28,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:28,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:28,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:29,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:51:30,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:30,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:31,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:31,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:31,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:31,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:31,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:31,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:31,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:31,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:31,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:31,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:31,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:31,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:31,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:31,540 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 01:51:31,769 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 01:51:31,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:51:31,845 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 01:51:32,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 01:51:33,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:51:39,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:39,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:39,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:39,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:39,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:39,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:39,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:39,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:39,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:39,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:39,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:39,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:39,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:39,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:39,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:39,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:40,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:40,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:40,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:40,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:40,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:40,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:40,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:40,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:40,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:40,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:40,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:40,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:40,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:40,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:40,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:40,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:41,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:51:42,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:42,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:42,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:42,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:42,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:42,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:42,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:42,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:42,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:42,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:42,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:42,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:42,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:42,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:42,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:42,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:42,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:51:42,333 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:51:42,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:42,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:42,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:42,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:42,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:42,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:42,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:42,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:42,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:42,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:42,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:42,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:42,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:42,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:42,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:42,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:45,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:47,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:47,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:47,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:47,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:47,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:47,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:47,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:47,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:47,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:47,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:47,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:47,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:47,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:47,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:47,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:47,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:47,850 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:51:48,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:48,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:48,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:48,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:48,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:48,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:48,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:48,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:48,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:48,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:48,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:48,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:48,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:48,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:48,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:48,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:50,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:50,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:50,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:50,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:50,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:50,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:50,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:50,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:50,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:50,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:50,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:50,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:50,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:50,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:50,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:50,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:51,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:51:52,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:52,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:52,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:52,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:52,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:52,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:52,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:52,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:52,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:52,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:52,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:52,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:52,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:52,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:52,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:52,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:54,001 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:51:55,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:51:56,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:56,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:56,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:56,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:56,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:56,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:56,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:56,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:56,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:56,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:56,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:56,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:56,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:56,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:56,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:56,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:51:57,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:51:57,593 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:51:59,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:52:00,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:00,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:00,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:00,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:00,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:00,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:00,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:00,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:00,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:00,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:00,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:00,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:00,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:00,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:00,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:00,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:03,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:52:05,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:05,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:05,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:05,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:05,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:05,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:05,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:05,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:05,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:05,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:05,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:05,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:05,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:05,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:05,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:05,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:07,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:07,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:07,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:07,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:07,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:07,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:07,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:07,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:07,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:07,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:07,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:07,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:07,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:07,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:07,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:07,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:07,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:52:11,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:52:12,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:52:12,902 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:52:13,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:52:13,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:13,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:13,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:13,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:13,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:13,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:13,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:13,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:13,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:13,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:13,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:13,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:13,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:13,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:13,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:13,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:15,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:15,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:15,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:15,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:15,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:15,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:15,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:15,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:15,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:15,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:15,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:15,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:15,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:15,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:15,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:15,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:16,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:16,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:16,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:16,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:16,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:16,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:16,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:16,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:16,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:16,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:16,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:16,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:16,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:16,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:16,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:16,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:17,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:17,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:17,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:17,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:17,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:17,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:17,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:17,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:17,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:17,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:17,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:17,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:17,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:17,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:17,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:17,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:17,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:52:19,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:52:21,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:21,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:21,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:21,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:21,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:21,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:21,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:21,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:21,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:21,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:21,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:21,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:21,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:21,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:21,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:21,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:23,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:52:24,077 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:52:25,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:52:28,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:52:28,159 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:52:28,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:52:32,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:32,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:32,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:32,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:32,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:32,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:32,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:32,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:32,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:32,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:32,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:32,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:32,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:32,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:32,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:32,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:32,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:52:34,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:52:35,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:35,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:35,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:35,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:35,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:35,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:35,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:35,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:35,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:35,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:35,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:35,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:35,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:35,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:35,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:35,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:36,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:36,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:36,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:36,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:36,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:36,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:36,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:36,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:36,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:36,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:36,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:36,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:36,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:36,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:36,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:36,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:36,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:52:40,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:52:41,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:41,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:41,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:41,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:41,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:41,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:41,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:41,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:41,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:41,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:41,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:41,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:41,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:41,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:41,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:41,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:42,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:52:43,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:52:43,391 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:52:43,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:43,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:43,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:43,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:43,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:43,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:43,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:43,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:43,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:43,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:43,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:43,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:43,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:43,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:43,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:43,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:44,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:52:46,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:52:47,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:47,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:47,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:47,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:47,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:47,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:47,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:47,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:47,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:47,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:47,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:47,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:47,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:47,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:47,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:47,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:48,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:48,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:48,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:48,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:48,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:48,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:48,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:48,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:48,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:48,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:48,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:48,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:48,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:48,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:48,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:48,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:48,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:52:52,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:52:53,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:53,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:53,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:53,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:53,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:53,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:53,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:53,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:53,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:53,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:53,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:53,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:53,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:53,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:53,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:53,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:54,149 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:52:54,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:52:55,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:55,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:55,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:55,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:55,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:55,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:55,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:55,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:55,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:55,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:55,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:55,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:55,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:55,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:55,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:55,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:52:56,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:52:58,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:52:58,616 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:52:58,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:53:00,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:53:02,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:53:02,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:02,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:02,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:02,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:02,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:02,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:02,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:02,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:02,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:02,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:02,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:02,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:02,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:02,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:02,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:02,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:04,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:53:06,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:53:08,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:08,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:08,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:08,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:08,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:08,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:08,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:08,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:08,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:08,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:08,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:08,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:08,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:08,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:08,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:08,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:08,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:53:10,882 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:53:11,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:11,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:11,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:11,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:11,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:11,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:11,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:11,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:11,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:11,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:11,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:11,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:11,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:11,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:11,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:11,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:12,883 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:53:13,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:53:13,958 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:53:14,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:53:16,885 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:53:17,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:17,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:17,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:17,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:17,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:17,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:17,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:17,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:17,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:17,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:17,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:17,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:17,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:17,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:17,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:17,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:18,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:53:19,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:19,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:19,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:19,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:19,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:19,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:19,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:19,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:19,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:19,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:19,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:19,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:19,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:19,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:19,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:19,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:19,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:19,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:19,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:19,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:19,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:19,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:19,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:19,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:19,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:19,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:19,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:19,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:19,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:19,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:19,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:19,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:20,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:53:21,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:21,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:21,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:21,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:21,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:21,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:21,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:21,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:21,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:21,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:21,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:21,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:21,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:21,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:21,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:21,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:22,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:53:23,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:23,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:23,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:23,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:23,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:23,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:23,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:23,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:23,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:23,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:23,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:23,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:23,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:23,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:23,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:23,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:24,221 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:53:24,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:53:26,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:26,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:26,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:26,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:26,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:26,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:26,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:26,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:26,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:26,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:26,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:26,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:26,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:26,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:26,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:26,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:26,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:53:27,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:27,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:27,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:27,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:27,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:27,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:27,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:27,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:27,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:27,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:27,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:27,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:27,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:27,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:27,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:27,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:27,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:27,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:27,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:27,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:27,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:27,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:27,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:27,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:27,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:27,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:27,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:27,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:27,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:27,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:27,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:27,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:28,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:53:29,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:29,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:29,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:29,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:29,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:29,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:29,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:29,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:29,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:29,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:29,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:29,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:29,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:29,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:29,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:29,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:29,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:29,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:29,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:29,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:29,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:29,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:29,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:29,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:29,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:29,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:29,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:29,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:29,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:53:29,309 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:53:30,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:53:33,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:33,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:33,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:33,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:33,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:33,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:33,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:33,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:33,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:33,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:33,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:33,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:33,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:33,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:33,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:33,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:38,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:53:43,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:43,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:43,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:43,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:43,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:43,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:43,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:43,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:43,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:43,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:43,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:43,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:43,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:43,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:43,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:43,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:44,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:44,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:44,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:44,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:44,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:44,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:44,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:44,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:44,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:44,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:44,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:44,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:44,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:44,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:44,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:44,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:44,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:53:45,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:53:45,014 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:53:45,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:45,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:45,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:45,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:45,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:45,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:45,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:45,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:45,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:45,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:45,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:45,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:45,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:45,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:45,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:45,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:46,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:46,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:46,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:46,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:46,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:46,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:46,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:46,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:46,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:46,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:46,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:46,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:46,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:46,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:46,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:46,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:48,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:48,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:48,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:48,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:48,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:48,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:48,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:48,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:48,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:48,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:48,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:48,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:48,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:48,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:48,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:48,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:48,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:53:50,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:50,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:50,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:50,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:50,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:50,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:50,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:50,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:50,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:50,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:50,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:50,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:50,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:50,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:50,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:50,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:52,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:53:54,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,295 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:53:54,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:54,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:56,901 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:53:58,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:58,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:58,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:58,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:58,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:58,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:58,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:58,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:58,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:58,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:58,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:58,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:58,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:58,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:58,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:58,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:59,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:59,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:59,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:59,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:59,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:59,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:59,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:59,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:59,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:59,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:59,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:59,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:59,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:59,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:59,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:53:59,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:00,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:00,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:00,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:00,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:00,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:00,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:00,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:00,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:00,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:00,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:00,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:00,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:00,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:00,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:00,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:00,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:00,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:54:00,266 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:54:00,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:54:02,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:54:05,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:05,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:05,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:05,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:05,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:05,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:05,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:05,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:05,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:05,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:05,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:05,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:05,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:05,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:05,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:05,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:06,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:06,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:06,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:06,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:06,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:06,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:06,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:06,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:06,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:06,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:06,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:06,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:06,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:06,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:06,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:06,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:06,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:54:10,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:54:12,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:54:14,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:14,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:14,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:14,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:14,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:14,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:14,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:14,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:14,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:14,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:14,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:14,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:14,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:14,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:14,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:14,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:15,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:54:15,551 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:54:16,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:54:17,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:17,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:17,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:17,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:17,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:17,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:17,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:17,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:17,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:17,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:17,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:17,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:17,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:17,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:17,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:17,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:18,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:54:19,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:19,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:19,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:19,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:19,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:19,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:19,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:19,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:19,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:19,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:19,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:19,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:19,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:19,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:19,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:19,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:20,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:20,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:20,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:20,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:20,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:20,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:20,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:20,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:20,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:20,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:20,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:20,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:20,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:20,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:20,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:20,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:22,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:54:23,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:23,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:23,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:23,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:23,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:23,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:23,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:23,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:23,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:23,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:23,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:23,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:23,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:23,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:23,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:23,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:24,372 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:54:24,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:54:26,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:54:29,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:29,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:29,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:29,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:29,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:29,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:29,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:29,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:29,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:29,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:29,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:29,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:29,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:29,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:29,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:29,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:30,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:54:30,772 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:54:30,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:54:31,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:31,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:31,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:31,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:31,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:31,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:31,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:31,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:31,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:31,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:31,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:31,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:31,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:31,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:31,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:31,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:32,916 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:54:33,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:33,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:33,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:33,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:33,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:33,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:33,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:33,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:33,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:33,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:33,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:33,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:33,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:33,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:33,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:33,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:35,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:35,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:35,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:35,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:35,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:35,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:35,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:35,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:35,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:35,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:35,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:35,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:35,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:35,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:35,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:35,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:35,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:54:39,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:54:41,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:54:43,921 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:54:45,921 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:54:45,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:54:45,992 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:54:47,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:47,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:47,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:47,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:47,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:47,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:47,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:47,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:47,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:47,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:47,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:47,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:47,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:47,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:47,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:47,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:47,922 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:54:49,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:49,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:54:51,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:54:53,925 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:54:54,450 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:54:55,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:54:57,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:54:59,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,927 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:54:59,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:54:59,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:01,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:55:01,377 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:55:01,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:55:03,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:55:05,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:55:07,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:55:09,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:55:10,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:10,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:10,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:10,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:10,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:10,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:10,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:10,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:10,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:10,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:10,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:10,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:10,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:10,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:10,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:10,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:10,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:10,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:10,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:10,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:10,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:10,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:10,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:10,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:10,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:10,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:10,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:10,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:10,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:10,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:10,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:10,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:11,932 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:55:13,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:55:15,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:55:16,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:55:16,595 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:55:17,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:17,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:17,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:17,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:17,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:17,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:17,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:17,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:17,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:17,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:17,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:17,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:17,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:17,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:17,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:17,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:17,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:55:19,935 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:55:20,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:20,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:21,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:55:23,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:23,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:23,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:23,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:23,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:23,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:23,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:23,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:23,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:23,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:23,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:23,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:23,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:23,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:23,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:23,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:23,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:55:24,526 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:55:25,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:25,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:25,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:25,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:25,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:25,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:25,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:25,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:25,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:25,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:25,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:25,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:25,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:25,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:25,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:25,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:25,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:25,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:25,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:25,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:25,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:25,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:25,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:25,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:25,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:25,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:25,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:25,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:25,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:25,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:25,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:25,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:25,937 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:55:26,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:26,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:26,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:26,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:26,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:26,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:26,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:26,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:26,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:26,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:26,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:26,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:26,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:26,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:26,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:26,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:26,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:26,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:26,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:26,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:26,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:26,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:26,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:26,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:26,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:26,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:26,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:26,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:26,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:26,945 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 01:55:27,152 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 01:55:27,219 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 01:55:28,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 01:55:28,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:55:31,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:31,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:31,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:31,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:31,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:31,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:31,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:31,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:31,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:31,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:31,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:31,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:31,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:31,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:31,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:31,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:31,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:55:31,856 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:55:34,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:34,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:34,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:34,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:34,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:34,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:34,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:34,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:34,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:34,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:34,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:34,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:34,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:34,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:34,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:34,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:37,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:37,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:37,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:37,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:37,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:37,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:37,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:37,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:37,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:37,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:37,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:37,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:37,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:37,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:37,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:37,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:38,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:55:38,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:38,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:38,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:38,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:38,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:38,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:38,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:38,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:38,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:38,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:38,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:38,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:38,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:38,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:38,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:38,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:42,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:55:47,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:55:47,078 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:55:47,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:47,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:47,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:47,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:47,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:47,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:47,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:47,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:47,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:47,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:47,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:47,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:47,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:47,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:47,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:47,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:48,074 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:55:49,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:49,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:49,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:49,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:49,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:49,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:49,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:49,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:49,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:49,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:49,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:49,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:49,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:49,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:49,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:49,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:51,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:51,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:51,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:51,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:51,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:51,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:51,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:51,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:51,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:51,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:51,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:51,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:51,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:51,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:51,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:51,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:52,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:55:52,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:52,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:52,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:52,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:52,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:52,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:52,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:52,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:52,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:52,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:52,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:52,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:52,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:52,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:52,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:52,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:54,620 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:55:55,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:55,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:55,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:55,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:55,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:55,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:55,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:55,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:55,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:55,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:55,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:55,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:55,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:55,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:55,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:55,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:56,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:55:56,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:56,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:56,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:56,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:56,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:56,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:56,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:56,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:56,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:56,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:56,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:56,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:56,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:56,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:56,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:56,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:58,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:58,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:58,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:58,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:58,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:58,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:58,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:58,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:58,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:58,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:58,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:58,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:58,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:58,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:58,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:58,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:58,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:58,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:58,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:58,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:58,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:58,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:58,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:58,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:58,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:58,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:58,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:58,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:58,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:58,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:58,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:58,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:59,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:59,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:59,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:59,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:59,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:59,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:59,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:59,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:59,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:59,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:59,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:59,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:59,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:59,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:59,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:55:59,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:00,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:56:02,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:56:02,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:56:02,389 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:56:02,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:02,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:04,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:04,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:04,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:04,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:04,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:04,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:04,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:04,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:04,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:04,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:04,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:04,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:04,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:04,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:04,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:04,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:04,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:04,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:04,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:04,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:04,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:04,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:04,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:04,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:04,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:04,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:04,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:04,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:04,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:04,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:04,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:04,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:06,081 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:56:07,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:07,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:07,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:07,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:07,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:07,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:07,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:07,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:07,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:07,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:07,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:07,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:07,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:07,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:07,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:07,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:09,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:09,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:09,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:09,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:09,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:09,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:09,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:09,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:09,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:09,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:09,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:09,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:09,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:09,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:09,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:09,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:10,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:56:10,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:10,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:10,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:10,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:10,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:10,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:10,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:10,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:10,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:10,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:10,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:10,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:10,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:10,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:10,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:10,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:10,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:10,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:10,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:10,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:10,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:10,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:10,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:10,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:10,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:10,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:10,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:10,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:10,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:10,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:10,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:10,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:12,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:56:17,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:56:17,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:56:17,617 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:56:19,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:56:20,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:20,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:20,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:20,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:20,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:20,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:20,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:20,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:20,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:20,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:20,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:20,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:20,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:20,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:20,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:20,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:21,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:21,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:21,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:21,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:21,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:21,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:21,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:21,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:21,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:21,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:21,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:21,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:21,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:21,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:21,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:21,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:21,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:21,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:21,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:21,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:21,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:21,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:21,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:21,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:21,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:21,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:21,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:21,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:21,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:21,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:21,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:21,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:23,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:56:24,695 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:56:25,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:56:27,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:27,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:27,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:27,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:27,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:27,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:27,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:27,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:27,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:27,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:27,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:27,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:27,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:27,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:27,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:27,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:28,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:28,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:28,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:28,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:28,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:28,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:28,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:28,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:28,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:28,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:28,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:28,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:28,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:28,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:28,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:28,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:29,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:56:31,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:56:32,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:56:32,972 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:56:33,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:56:37,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:56:38,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:38,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:38,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:38,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:38,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:38,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:38,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:38,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:38,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:38,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:38,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:38,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:38,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:38,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:38,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:38,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:39,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:56:40,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:40,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:40,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:40,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:40,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:40,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:40,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:40,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:40,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:40,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:40,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:40,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:40,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:40,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:40,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:40,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:40,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:40,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:40,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:40,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:40,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:40,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:40,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:40,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:40,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:40,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:40,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:40,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:40,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:40,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:40,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:40,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:41,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:56:41,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:41,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:41,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:41,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:41,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:41,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:41,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:41,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:41,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:41,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:41,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:41,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:41,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:41,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:41,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:41,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:43,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:56:45,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:56:48,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:56:48,278 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:56:49,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:56:51,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:56:52,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:52,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:52,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:52,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:52,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:52,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:52,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:52,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:52,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:52,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:52,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:52,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:52,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:52,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:52,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:52,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:53,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:56:54,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:54,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:54,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:54,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:54,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:54,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:54,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:54,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:54,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:54,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:54,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:54,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:54,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:54,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:54,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:54,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:54,769 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:56:55,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:56:55,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:55,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:55,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:55,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:55,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:55,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:55,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:55,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:55,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:55,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:55,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:55,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:55,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:55,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:55,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:55,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:57,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:57,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:57,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:57,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:57,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:57,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:57,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:57,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:57,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:57,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:57,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:57,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:57,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:57,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:57,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:57,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:56:57,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:56:59,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:57:01,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:57:02,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:02,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:03,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:57:03,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:57:03,530 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:57:05,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:57:07,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:57:09,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:57:11,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:57:12,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:12,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:12,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:12,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:12,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:12,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:12,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:12,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:12,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:12,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:12,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:12,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:12,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:12,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:12,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:12,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:13,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:57:14,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:14,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:14,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:14,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:14,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:14,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:14,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:14,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:14,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:14,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:14,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:14,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:14,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:14,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:14,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:14,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:15,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:57:17,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:57:18,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:57:18,748 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:57:19,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:57:21,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:57:21,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:21,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:21,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:21,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:21,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:21,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:21,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:21,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:21,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:21,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:21,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:21,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:21,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:21,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:21,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:21,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:23,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:57:23,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:23,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:23,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:23,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:23,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:23,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:23,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:23,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:23,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:23,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:23,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:23,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:23,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:23,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:23,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:23,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:24,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:24,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:24,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:24,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:24,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:24,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:24,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:24,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:24,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:24,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:24,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:24,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:24,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:24,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:24,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:24,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:24,839 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:57:25,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:57:25,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:25,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:25,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:25,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:25,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:25,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:25,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:25,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:25,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:25,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:25,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:25,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:25,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:25,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:25,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:25,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:26,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:26,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:26,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:26,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:26,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:26,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:26,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:26,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:26,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:26,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:26,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:26,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:26,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:26,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:26,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:26,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:27,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:57:27,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:27,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:27,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:27,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:27,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:27,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:27,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:27,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:27,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:27,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:27,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:27,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:27,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:27,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:27,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:27,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:27,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:27,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:27,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:27,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:27,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:27,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:27,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:27,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:27,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:27,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:27,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:27,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:29,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:57:31,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:31,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:31,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:31,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:31,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:31,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:31,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:31,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:31,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:31,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:31,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:31,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:31,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:31,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:31,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:31,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:33,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:57:33,972 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:57:39,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:57:40,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:40,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:40,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:40,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:40,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:40,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:40,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:40,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:40,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:40,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:40,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:40,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:40,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:40,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:40,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:40,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:43,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:43,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:43,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:43,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:43,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:43,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:43,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:43,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:43,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:43,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:43,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:43,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:43,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:43,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:43,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:43,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:45,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:57:45,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:45,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:45,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:45,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:45,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:45,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:45,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:45,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:45,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:45,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:45,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:45,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:45,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:45,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:45,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:45,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:49,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:57:49,250 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:57:50,121 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:57:50,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:50,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:50,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:50,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:50,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:50,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:50,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:50,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:50,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:50,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:50,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:50,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:50,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:50,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:50,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:50,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:53,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:53,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:53,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:53,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:53,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:53,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:53,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:53,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:53,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:53,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:54,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:54,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:54,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:54,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:54,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:54,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:54,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:57:54,914 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:57:56,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:56,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:56,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:56,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:56,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:56,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:56,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:56,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:56,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:56,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:56,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:56,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:56,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:56,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:56,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:56,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:57:58,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:58:01,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:01,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:01,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:01,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:01,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:01,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:01,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:01,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:01,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:01,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:01,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:01,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:01,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:01,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:01,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:01,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:01,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:01,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:01,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:01,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:01,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:01,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:01,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:01,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:01,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:01,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:01,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:01,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:01,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:01,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:01,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:01,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:02,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:58:02,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:02,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:02,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:02,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:02,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:02,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:02,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:02,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:02,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:02,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:02,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:02,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:02,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:02,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:02,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:02,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:04,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:04,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:04,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:04,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:04,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:04,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:04,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:04,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:04,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:04,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:04,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:04,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:04,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:04,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:04,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:04,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:04,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:58:04,474 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:58:04,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:04,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:04,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:04,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:04,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:04,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:04,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:04,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:04,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:04,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:04,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:04,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:04,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:04,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:04,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:04,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:06,128 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:58:06,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:06,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:06,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:06,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:06,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:06,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:06,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:06,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:06,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:06,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:06,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:06,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:06,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:06,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:06,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:06,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:08,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:58:08,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:08,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:08,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:08,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:08,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:08,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:08,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:08,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:08,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:08,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:08,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:08,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:08,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:08,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:08,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:08,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:09,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:11,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:11,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:11,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:11,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:11,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:11,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:11,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:11,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:11,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:11,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:11,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:11,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:11,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:11,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:11,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:11,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:12,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:58:14,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:14,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:14,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:14,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:14,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:14,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:14,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:14,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:14,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:14,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:14,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:14,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:14,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:14,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:14,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:14,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:16,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:16,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:16,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:16,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:16,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:16,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:16,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:16,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:16,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:16,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:16,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:16,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:16,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:16,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:16,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:16,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:16,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:58:17,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:17,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:17,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:17,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:17,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:17,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:17,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:17,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:17,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:17,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:17,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:17,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:17,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:17,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:17,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:17,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:17,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:17,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:17,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:17,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:17,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:17,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:17,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:17,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:17,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:17,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:17,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:17,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:17,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:17,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:17,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:17,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:18,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:18,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:18,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:18,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:18,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:18,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:18,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:18,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:18,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:18,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:18,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:18,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:18,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:18,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:18,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:18,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:18,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:58:19,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:58:19,795 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:58:22,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:58:24,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:24,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:24,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:24,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:24,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:24,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:24,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:24,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:24,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:24,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:24,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:24,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:24,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:24,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:24,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:24,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:24,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:58:24,989 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:58:26,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:26,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:26,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:26,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:26,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:26,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:26,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:26,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:26,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:26,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:26,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:26,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:26,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:26,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:26,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:26,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:27,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:27,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:27,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:27,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:27,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:27,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:27,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:27,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:27,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:27,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:27,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:27,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:27,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:27,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:27,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:28,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:28,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:58:30,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:58:32,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:58:32,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:32,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:32,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:32,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:32,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:32,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:32,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:32,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:32,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:32,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:32,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:32,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:32,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:32,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:32,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:32,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:35,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:58:35,150 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:58:35,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:35,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:35,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:35,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:35,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:35,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:35,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:35,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:35,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:35,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:35,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:35,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:35,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:35,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:35,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:35,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:36,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:58:38,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:58:40,140 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:58:41,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:41,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:41,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:41,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:41,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:41,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:41,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:41,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:41,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:41,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:41,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:41,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:41,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:41,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:41,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:41,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:42,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:58:43,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:43,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:43,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:43,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:43,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:43,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:44,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:44,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:44,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:44,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:44,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:44,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:44,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:44,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:44,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:44,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:44,142 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:58:47,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:47,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:47,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:47,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:47,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:47,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:47,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:47,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:47,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:47,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:47,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:47,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:47,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:47,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:47,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:47,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:48,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:58:48,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:48,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:48,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:48,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:48,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:48,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:48,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:48,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:48,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:48,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:48,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:48,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:48,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:48,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:48,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:48,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:50,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:58:50,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:58:50,385 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:58:52,145 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:58:54,146 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:58:55,064 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:58:56,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:58:57,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:57,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:57,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:57,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:57,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:57,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:57,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:57,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:57,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:57,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:57,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:57,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:57,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:57,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:57,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:57,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:58,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:58:58,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:58,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:58,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:58,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:58,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:58,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:58,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:58,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:58,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:58,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:58,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:58,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:58,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:58,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:58,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:58:58,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:00,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:59:01,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:01,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:01,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:01,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:01,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:01,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:01,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:01,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:01,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:01,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:01,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:01,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:01,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:01,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:01,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:01,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:02,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:59:03,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:03,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:03,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:03,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:03,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:03,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:03,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:03,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:03,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:03,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:03,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:03,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:03,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:03,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:03,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:03,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:03,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:03,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:03,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:03,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:03,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:03,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:03,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:03,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:03,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:03,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:03,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:03,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:03,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:03,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:03,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:03,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:04,150 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:59:05,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:59:05,612 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:59:06,150 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:59:08,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:59:08,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:08,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:08,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:08,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:08,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:08,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:08,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:08,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:08,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:08,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:08,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:08,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:08,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:08,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:08,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:08,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:09,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:09,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:09,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:09,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:09,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:09,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:09,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:09,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:09,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:09,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:09,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:09,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:09,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:09,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:09,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:09,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:10,152 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:59:12,153 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:59:14,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:59:15,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:15,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:15,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:15,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:15,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:15,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:15,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:15,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:15,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:15,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:15,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:15,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:15,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:15,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:15,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:15,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:15,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:15,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:15,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:15,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:15,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:15,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:15,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:15,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:15,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:15,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:15,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:15,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:15,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:15,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:15,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:15,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:16,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:59:18,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:59:20,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:59:20,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:59:20,837 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:59:22,157 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:59:22,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:22,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:22,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:22,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:22,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:22,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:22,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:22,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:22,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:22,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:22,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:22,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:22,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:22,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:22,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:22,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:24,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:59:25,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:25,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:25,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:25,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:25,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:25,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:25,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:25,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:25,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:25,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:25,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:25,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:25,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:25,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:25,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:25,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:25,133 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:59:25,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:25,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:25,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:25,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:25,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:25,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:25,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:25,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:25,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:25,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:25,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:25,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:25,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:25,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:25,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:25,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:26,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:59:27,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:27,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:27,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:27,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:27,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:27,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:27,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:27,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:27,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:27,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:27,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:27,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:27,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:27,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:27,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:27,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:27,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:27,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:27,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:27,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:27,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:27,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:27,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:27,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:27,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:27,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:27,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:27,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:28,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:28,220 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:59:28,249 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 01:59:28,452 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 01:59:28,561 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 01:59:29,215 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 01:59:30,216 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:59:31,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:31,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:31,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:31,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:31,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:31,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:31,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:31,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:31,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:31,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:31,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:31,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:31,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:31,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:31,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:31,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:36,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:59:36,060 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:59:37,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:37,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:37,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:37,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:37,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:37,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:37,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:37,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:37,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:37,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:37,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:37,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:37,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:37,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:37,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:37,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:38,218 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:59:42,220 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:59:46,221 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:59:49,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:49,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:51,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 01:59:51,488 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 01:59:52,224 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:59:53,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:53,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:53,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:53,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:53,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:53,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:53,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:53,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:53,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:53,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:53,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:53,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:53,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:53,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:53,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:53,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:55,223 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 01:59:56,253 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 01:59:59,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:59,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:59,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:59,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:59,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:59,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:59,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:59,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:59,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:59,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:59,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:59,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:59,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:59,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:59,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:59,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:59,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:59,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:59,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:59,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:59,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:59,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:59,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:59,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:59,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:59,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:59,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:59,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:59,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:59,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:59,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 01:59:59,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:00,254 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:00:03,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:00:05,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:05,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:05,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:05,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:05,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:05,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:05,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:05,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:05,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:05,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:05,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:05,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:05,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:05,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:05,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:05,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:06,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:00:06,755 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:00:07,257 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:00:07,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:07,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:07,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:07,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:07,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:07,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:07,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:07,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:07,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:07,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:07,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:07,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:07,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:07,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:07,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:07,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:08,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:08,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:08,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:08,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:08,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:08,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:08,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:08,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:08,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:08,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:08,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:08,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:08,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:08,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:08,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:08,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:09,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:09,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:09,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:09,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:09,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:09,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:09,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:09,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:09,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:09,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:09,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:09,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:09,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:09,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:09,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:09,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:10,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:10,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:10,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:10,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:10,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:10,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:10,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:10,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:10,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:10,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:10,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:10,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:10,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:10,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:10,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:10,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:11,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:11,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:11,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:11,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:11,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:11,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:11,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:11,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:11,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:11,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:11,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:11,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:11,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:11,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:11,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:11,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:11,259 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:00:14,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:14,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:14,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:14,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:14,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:14,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:14,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:14,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:14,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:14,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:14,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:14,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:14,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:14,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:14,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:14,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:15,260 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:00:17,261 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:00:17,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:17,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:17,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:17,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:17,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:17,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:17,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:17,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:17,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:17,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:17,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:17,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:17,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:17,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:17,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:17,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:17,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:17,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:17,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:17,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:17,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:17,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:17,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:17,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:17,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:17,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:17,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:17,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:17,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:17,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:17,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:17,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:19,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:19,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:19,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:19,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:19,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:19,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:19,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:19,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:19,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:19,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:19,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:19,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:19,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:19,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:19,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:19,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:20,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:21,263 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:00:21,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:00:21,980 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:00:22,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:22,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:22,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:22,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:22,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:22,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:22,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:22,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:22,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:22,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:22,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:22,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:22,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:22,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:22,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:22,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:23,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:23,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:23,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:23,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:23,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:23,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:23,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:23,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:23,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:23,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:23,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:23,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:23,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:23,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:23,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:23,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:25,264 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:00:25,298 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:00:26,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:26,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:26,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:26,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:26,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:26,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:26,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:26,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:26,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:26,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:26,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:26,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:26,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:26,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:26,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:26,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:26,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:26,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:26,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:26,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:26,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:26,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:26,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:26,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:26,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:26,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:26,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:26,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:26,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:26,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:26,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:26,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:27,265 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:00:29,266 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:00:30,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:30,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:30,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:30,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:30,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:30,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:30,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:30,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:30,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:30,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:30,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:30,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:30,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:30,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:30,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:30,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:30,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:30,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:30,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:30,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:30,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:30,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:30,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:30,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:30,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:30,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:30,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:30,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:30,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:30,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:30,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:30,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:33,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:00:35,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:00:35,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:35,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:35,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:35,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:35,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:35,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:35,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:35,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:35,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:35,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:35,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:35,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:35,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:35,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:35,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:35,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:37,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:00:37,234 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:00:37,270 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:00:38,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:38,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:38,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:38,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:38,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:38,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:38,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:38,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:38,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:38,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:38,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:38,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:38,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:38,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:38,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:38,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:41,271 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:00:43,272 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:00:43,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:43,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:43,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:43,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:43,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:43,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:43,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:43,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:43,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:43,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:43,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:43,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:43,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:43,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:43,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:43,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:45,273 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:00:47,274 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:00:49,275 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:00:49,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:49,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:49,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:49,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:49,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:49,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:49,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:49,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:49,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:49,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:49,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:49,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:49,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:49,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:49,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:49,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:50,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:50,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:50,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:50,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:50,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:50,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:50,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:50,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:50,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:50,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:50,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:50,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:50,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:50,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:50,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:50,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:52,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:00:52,462 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:00:52,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:52,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:52,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:52,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:52,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:52,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:52,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:52,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:52,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:52,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:52,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:52,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:52,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:52,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:52,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:52,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:53,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:53,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:53,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:53,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:53,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:53,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:53,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:53,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:53,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:53,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:53,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:53,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:53,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:53,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:53,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:53,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:00:53,277 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:00:55,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:00:55,376 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:00:57,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:00:59,279 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:01:01,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:01:03,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:01:04,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:04,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:04,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:04,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:04,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:04,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:04,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:04,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:04,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:04,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:04,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:04,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:04,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:04,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:04,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:04,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:04,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:04,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:04,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:04,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:04,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:04,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:04,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:04,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:04,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:04,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:04,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:04,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:04,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:04,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:04,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:04,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:05,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:01:05,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:05,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:05,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:05,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:05,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:05,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:05,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:05,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:05,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:05,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:05,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:05,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:05,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:05,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:05,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:05,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:07,283 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:01:07,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:01:07,681 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:01:07,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:07,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:07,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:07,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:07,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:07,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:07,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:07,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:07,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:07,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:07,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:07,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:07,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:07,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:07,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:07,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:07,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:07,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:07,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:07,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:07,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:07,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:07,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:07,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:07,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:07,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:07,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:07,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:07,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:07,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:07,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:07,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:09,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:01:11,285 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:01:13,286 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:01:13,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:13,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:13,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:13,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:13,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:13,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:13,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:13,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:13,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:13,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:13,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:13,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:13,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:13,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:13,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:13,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:14,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:14,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:14,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:14,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:14,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:14,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:14,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:14,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:14,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:14,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:14,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:14,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:14,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:14,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:14,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:14,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:15,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:01:17,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:01:19,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:19,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:19,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:19,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:19,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:19,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:19,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:19,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:19,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:19,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:19,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:19,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:19,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:19,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:19,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:19,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:19,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:01:19,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:19,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:19,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:19,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:19,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:19,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:19,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:19,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:19,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:19,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:19,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:19,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:19,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:19,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:19,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:19,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:21,290 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:01:22,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:01:22,906 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:01:23,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:01:25,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:25,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:25,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:25,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:25,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:25,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:25,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:25,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:25,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:25,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:25,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:25,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:25,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:25,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:25,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:25,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:25,452 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:01:26,292 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:01:28,293 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:01:28,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:28,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:28,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:28,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:28,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:28,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:28,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:28,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:28,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:28,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:28,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:28,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:28,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:28,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:28,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:28,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:29,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:29,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:29,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:29,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:29,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:29,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:29,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:29,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:29,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:29,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:29,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:29,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:30,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:01:32,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:01:35,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:35,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:35,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:35,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:35,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:35,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:35,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:35,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:35,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:35,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:35,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:35,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:35,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:35,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:35,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:35,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:38,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:01:38,128 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:01:38,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:38,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:38,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:38,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:38,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:38,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:38,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:38,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:38,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:38,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:38,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:38,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:38,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:38,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:38,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:38,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:42,298 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:01:44,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:44,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:44,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:44,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:44,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:44,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:44,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:44,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:44,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:44,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:44,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:44,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:44,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:44,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:44,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:44,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:46,300 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:01:52,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:01:52,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:52,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:52,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:52,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:52,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:52,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:52,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:52,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:52,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:52,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:52,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:52,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:52,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:52,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:52,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:52,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:52,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:52,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:52,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:52,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:52,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:52,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:52,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:52,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:52,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:52,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:52,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:52,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:52,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:52,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:52,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:52,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:53,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:01:53,350 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:01:55,531 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:01:56,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:01:58,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:01:58,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:58,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:58,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:58,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:58,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:58,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:58,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:58,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:58,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:58,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:58,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:58,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:58,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:58,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:58,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:01:58,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:00,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:00,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:00,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:00,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:00,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:00,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:00,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:00,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:00,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:00,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:00,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:00,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:00,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:00,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:00,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:00,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:02,306 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:02:02,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:02,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:02,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:02,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:02,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:02,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:02,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:02,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:02,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:02,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:02,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:02,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:02,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:02,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:02,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:02,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:06,308 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:02:08,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:02:08,717 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:02:09,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:09,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:09,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:09,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:09,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:09,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:09,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:09,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:09,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:09,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:09,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:09,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:09,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:09,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:09,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:09,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:09,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:09,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:09,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:09,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:09,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:09,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:09,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:09,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:09,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:09,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:09,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:09,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:09,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:09,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:09,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:09,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:10,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:02:10,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:10,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:10,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:10,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:10,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:10,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:10,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:10,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:10,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:10,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:10,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:10,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:10,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:10,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:10,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:10,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,310 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:02:12,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:12,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:16,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:02:18,313 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:02:18,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:18,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:18,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:18,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:18,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:18,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:18,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:18,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:18,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:18,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:18,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:18,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:18,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:18,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:18,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:18,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:20,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:20,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:20,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:20,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:20,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:20,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:20,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:20,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:20,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:20,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:20,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:20,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:20,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:20,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:20,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:20,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:21,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:21,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:21,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:21,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:21,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:21,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:21,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:21,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:21,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:21,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:21,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:21,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:21,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:21,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:21,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:21,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:21,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:21,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:21,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:21,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:21,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:21,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:21,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:21,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:21,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:21,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:21,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:21,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:21,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:21,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:21,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:21,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:22,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:02:23,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:02:23,942 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:02:24,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:24,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:24,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:24,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:24,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:24,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:24,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:24,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:24,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:24,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:24,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:24,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:24,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:24,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:24,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:24,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:24,316 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:02:25,605 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:02:25,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:25,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:25,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:25,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:25,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:25,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:25,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:25,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:25,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:25,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:25,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:25,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:25,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:25,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:25,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:25,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:26,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:26,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:26,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:26,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:26,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:26,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:26,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:26,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:26,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:26,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:26,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:26,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:26,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:26,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:26,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:26,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:28,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:28,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:28,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:28,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:28,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:28,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:28,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:28,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:28,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:28,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:28,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:28,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:28,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:28,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:28,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:28,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:28,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:02:28,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:28,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:28,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:28,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:28,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:28,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:28,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:28,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:28,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:28,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:28,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:28,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:28,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:28,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:28,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:28,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:29,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:29,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:29,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:29,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:29,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:29,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:29,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:29,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:29,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:29,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:29,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:29,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:29,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:29,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:29,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:29,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:30,318 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:02:32,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:32,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:32,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:32,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:32,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:32,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:32,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:32,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:32,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:32,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:32,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:32,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:32,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:32,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:32,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:32,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:32,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:32,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:32,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:32,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:32,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:32,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:32,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:32,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:32,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:32,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:32,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:32,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:32,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:32,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:32,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:32,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:32,319 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:02:33,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:33,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:33,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:33,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:33,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:33,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:33,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:33,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:33,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:33,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:33,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:33,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:33,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:33,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:33,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:33,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:33,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:33,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:33,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:33,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:33,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:33,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:33,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:33,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:33,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:33,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:33,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:33,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:33,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:33,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:33,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:33,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:34,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:02:34,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:34,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:34,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:34,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:34,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:34,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:34,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:34,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:34,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:34,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:34,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:34,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:34,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:34,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:34,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:34,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:36,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:36,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:36,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:36,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:36,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:36,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:36,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:36,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:36,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:36,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:36,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:36,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:36,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:36,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:36,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:36,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:38,322 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:02:39,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:02:39,174 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:02:40,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:02:41,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:41,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:41,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:41,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:41,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:41,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:41,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:41,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:41,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:41,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:41,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:41,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:41,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:41,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:41,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:41,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:42,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:02:44,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:44,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:44,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:44,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:44,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:44,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:44,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:44,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:44,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:44,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:44,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:44,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:44,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:44,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:44,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:44,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:45,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:02:47,326 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:02:48,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:48,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:48,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:48,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:48,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:48,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:48,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:48,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:48,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:48,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:48,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:48,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:48,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:48,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:48,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:48,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:49,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:02:50,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:50,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:50,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:50,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:50,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:50,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:50,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:50,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:50,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:50,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:50,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:50,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:50,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:50,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:50,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:50,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:51,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:02:53,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:02:54,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:02:54,397 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:02:55,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:02:55,682 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:02:56,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:56,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:56,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:56,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:56,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:56,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:56,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:56,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:56,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:56,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:56,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:56,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:56,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:56,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:56,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:56,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:57,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:02:58,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:58,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:58,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:58,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:58,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:58,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:58,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:58,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:58,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:58,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:58,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:58,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:58,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:58,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:58,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:58,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:59,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:59,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:59,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:59,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:59,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:59,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:59,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:59,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:59,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:59,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:59,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:59,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:59,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:59,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:59,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:59,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:02:59,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:03:01,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:03:03,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:03:04,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:04,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:04,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:04,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:04,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:04,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:04,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:04,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:04,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:04,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:04,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:04,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:04,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:04,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:04,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:04,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:05,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:03:06,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:06,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:06,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:06,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:06,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:06,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:06,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:06,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:06,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:06,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:06,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:06,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:06,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:06,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:06,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:06,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:06,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:06,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:06,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:06,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:06,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:06,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:06,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:06,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:06,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:06,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:06,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:06,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:06,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:06,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:06,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:06,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:07,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:07,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:07,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:07,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:07,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:07,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:07,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:07,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:07,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:07,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:07,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:07,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:07,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:07,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:07,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:07,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:07,335 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:03:07,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:07,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:07,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:07,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:07,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:07,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:07,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:07,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:07,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:07,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:07,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:07,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:07,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:07,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:07,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:07,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:09,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:03:09,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:03:09,620 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:03:11,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:03:12,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:12,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:12,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:12,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:12,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:12,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:12,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:12,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:12,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:12,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:12,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:12,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:12,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:12,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:12,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:12,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:13,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:03:14,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:14,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:14,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:14,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:14,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:14,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:14,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:14,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:14,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:14,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:14,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:14,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:14,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:14,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:14,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:14,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:15,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:03:17,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:03:19,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:03:19,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:19,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:19,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:19,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:19,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:19,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:19,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:19,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:19,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:19,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:19,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:19,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:19,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:19,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:19,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:19,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:20,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:20,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:20,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:20,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:20,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:20,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:20,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:20,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:20,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:20,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:20,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:20,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:20,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:20,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:20,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:20,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:21,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:03:23,342 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:03:24,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:03:24,872 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:03:24,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:24,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:24,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:24,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:24,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:24,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:24,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:24,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:24,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:24,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:24,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:24,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:24,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:24,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:24,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:24,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:25,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:03:25,759 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:03:26,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:26,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:26,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:26,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:26,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:26,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:26,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:26,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:26,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:26,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:26,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:26,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:26,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:03:26,892 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 02:03:27,128 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 02:03:27,187 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 02:03:27,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 02:03:27,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:03:28,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:03:29,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:03:31,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:03:33,346 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:03:35,346 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:03:37,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:03:39,348 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:03:40,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:03:40,204 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:03:41,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:03:43,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:03:45,350 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:03:47,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:03:49,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:03:51,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:03:53,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:03:55,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:03:55,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:03:55,523 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:03:55,857 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:03:57,354 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:03:59,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:04:01,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:04:03,356 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:04:05,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:04:07,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:04:09,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:04:10,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:04:10,747 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:04:11,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:04:13,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:04:15,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:04:17,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:04:19,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:04:21,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:04:23,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:04:25,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:04:25,933 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:04:25,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:04:25,979 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:04:27,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:04:29,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:04:31,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:04:34,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:04:36,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:04:38,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:04:40,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:04:41,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:04:41,196 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:04:42,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:04:44,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:04:46,371 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:04:48,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:04:50,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:04:52,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:04:54,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:04:56,004 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:04:56,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:04:56,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:04:56,605 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:04:58,376 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:05:00,377 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:05:02,377 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:05:04,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:05:06,379 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:05:08,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:05:10,381 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:05:11,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:05:11,982 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:05:12,382 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:05:14,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:05:16,384 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:05:18,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:05:20,386 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:05:22,386 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:05:24,387 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:05:26,079 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:05:26,388 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:05:27,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:05:27,273 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:05:28,389 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:05:30,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:05:32,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:05:34,391 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:05:36,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:05:38,393 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:05:40,393 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:05:42,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:05:42,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:05:42,894 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:05:44,395 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:05:46,396 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:05:48,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:05:50,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:05:52,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:05:54,399 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:05:56,156 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:05:56,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:05:58,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:05:58,115 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:05:58,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:06:00,402 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:06:02,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:06:04,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:06:06,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:06:08,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:06:10,406 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:06:12,407 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:06:13,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:06:13,352 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:06:14,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:06:16,409 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:06:18,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:06:21,411 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:06:23,411 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:06:25,412 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:06:26,231 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:06:27,413 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:06:28,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:06:28,762 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:06:29,414 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:06:31,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:06:33,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:06:35,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:06:37,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:06:39,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:06:41,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:06:43,419 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:06:43,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:06:43,995 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:06:45,419 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:06:47,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:06:49,421 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:06:51,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:06:53,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:06:55,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:06:56,307 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:06:57,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:06:59,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:06:59,340 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:06:59,425 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:07:01,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:07:03,427 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:07:05,428 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:07:07,429 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:07:09,430 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:07:11,431 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:07:13,432 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:07:14,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:07:14,640 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:07:15,433 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:07:17,434 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:07:19,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:07:21,436 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:07:23,437 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:07:25,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:07:26,382 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:07:27,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:07:29,439 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:07:29,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:07:29,874 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:07:32,441 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:07:34,442 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:07:36,443 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:07:38,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:07:40,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:07:42,446 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:07:44,447 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:07:45,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:07:45,101 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:07:46,448 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:07:48,448 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:07:50,449 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:07:52,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:07:54,451 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:07:56,452 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:07:56,457 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:07:58,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:08:00,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:08:00,356 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:08:00,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:08:02,455 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:08:04,455 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:08:06,456 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:08:08,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:08:10,458 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:08:12,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:08:14,461 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:08:15,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:08:15,576 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:08:16,462 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:08:18,462 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:08:20,463 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:08:22,464 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:08:24,464 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:08:26,465 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:08:26,532 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:08:28,466 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:08:30,467 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:08:30,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:08:30,833 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:08:32,467 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:08:34,468 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:08:36,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:08:38,470 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:08:40,471 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:08:43,472 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:08:45,473 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:08:46,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:08:46,089 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:08:47,474 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:08:49,475 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:08:51,476 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:08:53,477 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:08:55,478 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:08:56,605 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:08:57,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:08:59,480 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:09:01,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:09:01,361 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:09:01,481 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:09:03,482 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:09:05,483 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:09:07,484 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:09:09,485 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:09:11,486 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:09:13,487 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:09:15,488 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:09:16,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:09:16,682 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:09:17,489 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:09:19,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:09:21,491 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:09:23,492 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:09:25,493 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:09:26,676 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:09:27,494 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:09:29,495 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:09:31,496 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:09:31,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:09:31,969 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:09:33,497 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:09:35,498 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:09:37,498 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:09:39,499 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:09:41,500 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:09:43,501 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:09:45,502 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:09:47,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:09:47,224 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:09:47,503 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:09:49,504 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:09:51,504 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:09:54,506 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:09:56,506 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:09:56,754 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:09:58,507 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:10:00,508 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:10:02,510 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:10:02,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:10:02,836 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:10:04,510 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:10:06,511 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:10:08,512 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:10:10,513 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:10:12,513 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:10:14,514 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:10:16,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:10:18,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:10:18,130 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:10:18,516 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:10:20,517 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:10:22,518 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:10:24,519 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:10:26,519 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:10:26,829 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:10:28,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:10:30,521 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:10:32,522 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:10:33,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:10:33,403 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:10:34,523 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:10:36,524 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:10:38,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:10:40,526 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:10:42,526 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:10:44,527 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:10:46,528 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:10:48,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:10:48,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:10:48,720 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:10:50,530 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:10:52,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:10:54,532 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:10:56,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:10:56,904 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:10:58,534 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:11:00,535 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:11:02,536 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:11:04,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:11:04,071 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:11:04,537 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:11:06,538 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:11:08,539 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:11:10,539 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:11:12,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:11:14,541 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:11:16,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:11:18,543 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:11:19,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:11:19,310 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:11:20,544 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:11:23,545 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:11:25,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:11:26,981 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:11:27,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:11:29,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:11:31,549 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:11:33,550 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:11:34,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:11:34,563 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:11:35,551 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:11:37,552 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:11:39,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:11:41,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:11:43,555 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:11:45,556 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:11:47,557 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:11:49,558 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:11:49,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:11:49,848 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:11:51,558 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:11:53,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:11:55,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:11:57,055 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:11:57,561 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:11:59,562 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:12:01,563 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:12:03,563 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:12:05,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:12:05,203 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:12:05,564 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:12:07,565 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:12:09,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:12:11,567 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:12:13,568 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:12:15,568 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:12:17,569 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:12:19,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:12:20,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:12:20,432 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:12:21,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:12:23,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:12:25,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:12:27,121 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:12:27,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:12:29,574 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:12:31,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:12:33,576 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:12:35,576 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:12:35,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:12:35,658 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:12:37,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:12:39,578 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:12:41,579 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:12:43,580 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:12:45,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:12:47,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:12:49,583 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:12:50,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:12:50,913 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:12:52,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:12:54,585 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:12:56,585 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:12:57,196 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:12:58,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:13:00,587 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:13:02,587 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:13:04,588 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:13:06,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:13:06,178 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:13:06,589 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:13:08,590 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:13:10,590 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:13:12,591 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:13:14,592 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:13:16,592 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:13:18,593 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:13:20,594 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:13:21,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:13:21,427 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:13:22,595 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:13:24,595 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:13:26,596 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:13:27,263 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:13:28,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:13:30,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:13:32,598 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:13:34,599 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:13:36,599 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:13:36,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:13:36,737 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:13:38,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:13:40,601 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:13:42,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:13:44,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:13:46,603 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:13:48,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:13:50,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:13:52,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:13:52,058 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:13:52,605 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:13:54,606 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:13:56,607 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:13:57,319 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:13:58,608 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:14:00,609 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:14:02,610 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:14:04,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:14:06,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:14:07,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:14:07,436 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:14:08,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:14:10,613 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:14:12,614 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:14:14,614 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:14:17,615 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:14:19,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:14:21,617 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:14:22,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:14:22,684 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:14:23,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:14:25,619 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:14:27,395 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:14:27,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:14:29,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:14:31,621 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:14:33,622 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:14:35,623 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:14:37,623 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:14:37,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:14:37,929 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:14:39,624 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:14:41,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:14:43,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:14:45,626 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:14:47,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:14:49,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:14:51,629 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:14:53,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:14:53,190 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:14:53,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:14:55,631 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:14:57,472 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:14:57,632 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:14:59,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:15:01,634 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:15:03,635 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:15:05,636 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:15:07,637 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:15:08,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:15:08,418 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:15:09,638 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:15:11,639 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:15:14,640 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:15:16,641 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:15:18,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:15:20,643 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:15:22,644 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:15:23,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:15:23,761 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:15:24,645 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:15:26,646 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:15:27,548 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:15:28,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:15:30,648 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:15:32,649 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:15:34,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:15:36,651 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:15:38,652 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:15:39,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:15:39,043 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:15:40,653 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:15:42,654 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:15:44,655 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:15:46,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:15:48,657 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:15:50,658 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:15:52,659 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:15:54,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:15:54,394 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:15:54,660 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:15:56,661 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:15:57,622 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:15:58,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:16:00,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:16:02,663 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:16:04,664 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:16:06,665 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:16:08,665 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:16:09,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:16:09,642 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:16:10,666 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:16:12,667 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:16:14,668 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:16:16,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:16:18,670 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:16:20,671 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:16:22,672 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:16:24,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:16:24,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:16:24,951 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:16:26,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:16:27,697 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:16:28,674 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:16:30,675 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:16:32,676 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:16:34,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:16:36,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:16:38,678 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:16:40,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:16:40,173 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:16:40,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:16:42,680 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:16:44,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:16:46,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:16:48,682 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:16:50,683 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:16:52,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:16:54,685 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:16:55,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:16:55,553 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:16:56,685 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:16:57,773 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:16:58,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:17:00,687 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:17:02,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:17:04,689 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:17:06,690 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:17:09,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:17:10,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:17:10,901 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:17:11,692 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:17:13,693 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:17:15,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:17:17,695 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:17:19,696 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:17:21,697 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:17:23,698 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:17:25,699 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:17:26,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:17:26,124 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:17:27,700 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:17:27,850 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:17:29,701 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:17:31,702 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:17:33,703 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:17:35,704 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:17:37,704 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:17:39,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:17:41,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:17:41,351 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:17:41,706 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:17:43,707 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:17:45,708 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:17:47,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:17:49,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:17:51,710 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:17:53,711 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:17:55,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:17:56,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:17:56,605 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:17:57,713 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:17:57,925 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:17:59,714 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:18:01,715 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:18:03,716 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:18:05,717 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:18:07,718 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:18:09,719 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:18:11,720 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:18:11,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:18:11,894 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:18:13,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:18:15,722 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:18:17,722 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:18:19,723 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:18:21,724 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:18:23,725 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:18:26,726 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:18:27,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:18:27,230 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:18:28,000 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:18:28,727 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:18:30,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:18:32,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:18:34,729 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:18:36,730 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:18:38,731 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:18:40,732 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:18:42,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:18:42,549 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:18:42,733 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:18:44,734 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:18:46,734 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:18:48,735 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:18:50,736 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:18:52,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:18:54,738 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:18:56,739 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:18:57,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:18:57,809 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:18:58,075 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:18:58,740 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:19:00,741 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:19:02,742 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:19:04,742 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:19:06,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:19:08,744 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:19:10,744 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:19:12,745 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:19:13,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:19:13,098 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:19:14,746 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:19:16,746 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:19:18,747 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:19:20,748 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:19:22,749 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:19:24,749 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:19:26,750 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:19:28,151 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:19:28,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:19:28,430 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:19:28,751 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:19:30,751 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:19:32,752 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:19:34,753 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:19:36,754 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:19:38,754 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:19:40,755 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:19:42,756 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:19:43,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:19:43,700 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:19:44,756 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:19:46,757 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:19:48,758 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:19:50,758 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:19:52,759 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:19:55,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:19:57,761 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:19:58,224 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:19:59,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:19:59,055 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:19:59,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:20:01,763 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:20:03,764 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:20:05,765 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:20:07,765 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:20:09,766 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:20:11,767 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:20:13,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:20:14,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:20:14,340 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:20:15,769 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:20:17,769 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:20:19,770 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:20:21,771 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:20:23,772 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:20:25,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:20:27,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:20:28,297 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:20:29,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:20:29,623 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:20:29,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:20:31,775 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:20:33,776 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:20:35,777 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:20:37,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:20:39,779 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:20:41,780 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:20:43,781 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:20:44,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:20:44,847 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:20:45,782 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:20:47,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:20:49,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:20:51,785 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:20:53,786 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:20:55,787 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:20:57,788 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:20:58,374 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:20:59,789 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:21:00,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:21:00,231 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:21:01,790 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:21:03,791 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:21:05,792 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:21:07,792 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:21:09,793 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:21:11,794 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:21:13,795 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:21:15,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:21:15,532 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:21:15,796 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:21:17,797 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:21:19,798 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:21:21,799 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:21:23,799 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:21:26,800 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:21:28,451 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:21:28,801 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:21:30,802 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:21:30,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:21:30,822 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:21:32,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:21:34,804 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:21:36,805 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:21:38,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:21:40,807 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:21:42,808 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:21:44,809 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:21:46,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:21:46,091 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:21:46,810 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:21:48,811 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:21:50,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:21:52,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:21:54,813 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:21:56,814 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:21:58,527 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:21:58,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:22:00,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:22:01,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:22:01,486 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:22:02,817 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:22:04,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:22:06,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:22:08,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:22:10,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:22:12,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:22:14,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:22:16,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:22:16,787 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:22:16,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:22:18,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:22:20,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:22:22,826 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:22:24,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:22:26,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:22:28,604 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:22:28,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:22:30,829 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:22:32,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:22:32,062 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:22:32,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:22:34,831 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:22:36,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:22:38,833 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:22:40,834 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:22:42,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:22:44,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:22:46,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:22:47,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:22:47,458 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:22:48,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:22:50,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:22:52,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:22:54,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:22:56,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:22:58,664 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:22:58,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:23:00,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:23:02,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:23:02,766 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:23:02,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:23:04,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:23:06,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:23:08,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:23:10,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:23:12,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:23:15,846 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:23:17,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:23:17,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:23:17,991 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:23:19,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:23:21,849 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:23:23,850 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:23:25,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:23:27,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:23:28,734 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:23:29,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:23:31,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:23:33,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:23:33,227 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:23:33,854 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:23:35,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:23:37,856 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:23:39,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:23:41,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:23:43,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:23:45,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:23:47,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:23:48,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:23:48,482 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:23:49,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:23:51,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:23:53,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:23:55,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:23:57,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:23:58,810 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:23:59,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:24:01,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:24:03,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:24:03,799 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:24:03,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:24:05,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:24:07,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:24:09,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:24:11,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:24:13,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:24:15,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:24:17,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:24:19,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:24:19,119 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:24:19,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:24:21,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:24:23,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:24:25,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:24:27,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:24:28,887 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:24:29,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:24:31,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:24:33,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:24:34,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:24:34,343 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:24:35,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:24:37,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:24:39,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:24:41,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:24:43,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:24:45,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:24:47,882 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:24:49,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:24:49,569 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:24:49,883 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:24:51,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:24:53,885 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:24:55,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:24:57,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:24:58,963 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:24:59,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:25:01,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:25:03,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:25:05,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:25:05,044 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:25:05,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:25:08,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:25:10,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:25:12,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:25:14,894 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:25:16,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:25:18,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:25:20,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:25:20,263 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:25:20,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:25:22,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:25:24,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:25:26,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:25:28,900 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:25:29,040 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:25:30,901 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:25:32,902 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:25:34,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:25:35,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:25:35,590 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:25:36,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:25:38,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:25:40,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:25:42,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:25:44,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:25:46,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:25:48,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:25:50,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:25:50,908 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:25:50,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:25:52,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:25:54,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:25:56,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:25:58,916 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:25:59,111 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:26:00,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:26:02,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:26:04,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:26:06,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:26:06,175 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:26:06,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:26:08,921 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:26:10,922 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:26:12,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:26:14,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:26:16,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:26:18,925 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:26:20,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:26:21,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:26:21,472 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:26:22,927 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:26:24,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:26:26,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:26:28,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:26:29,179 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:26:30,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:26:32,932 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:26:34,932 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:26:36,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:26:36,700 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:26:36,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:26:38,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:26:40,935 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:26:42,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:26:44,937 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:26:46,938 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:26:48,939 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:26:50,940 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:26:51,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:26:51,929 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:26:52,941 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:26:54,942 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:26:56,943 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:26:58,944 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:26:59,257 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:27:00,944 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:27:02,945 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:27:04,946 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:27:06,947 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:27:07,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:27:07,341 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:27:08,948 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:27:10,949 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:27:13,950 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:27:15,951 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:27:17,952 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:27:19,953 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:27:21,954 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:27:22,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:27:22,601 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:27:23,954 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:27:25,955 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:27:27,956 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:27:29,323 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:27:29,957 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:27:31,958 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:27:33,958 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:27:35,959 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:27:37,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:27:37,823 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:27:37,960 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:27:39,961 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:27:41,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:27:43,963 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:27:45,964 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:27:47,965 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:27:49,966 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:27:51,967 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:27:53,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:27:53,089 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:27:53,968 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:27:55,969 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:27:57,970 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:27:59,390 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:27:59,971 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:28:01,972 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:28:03,973 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:28:05,973 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:28:07,974 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:28:08,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:28:08,313 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:28:09,975 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:28:11,976 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:28:13,978 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:28:15,978 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:28:17,980 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:28:19,980 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:28:21,981 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:28:23,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:28:23,686 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:28:23,982 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:28:25,983 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:28:27,984 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:28:29,458 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:28:29,985 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:28:31,986 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:28:33,987 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:28:35,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:28:37,989 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:28:39,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:28:39,004 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:28:39,990 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:28:41,991 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:28:43,991 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:28:45,992 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:28:47,993 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:28:49,994 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:28:51,994 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:28:53,995 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:28:54,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:28:54,298 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:28:55,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:28:57,997 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:28:59,525 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:28:59,998 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:29:01,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:29:04,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:29:06,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:29:08,001 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:29:09,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:29:09,590 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:29:11,003 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:29:13,004 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:29:15,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:29:17,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:29:19,007 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:29:21,008 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:29:23,009 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:29:24,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:29:24,910 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:29:25,009 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:29:27,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:29:29,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:29:29,585 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:29:31,012 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:29:33,013 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:29:35,014 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:29:37,015 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:29:39,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:29:40,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:29:40,130 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:29:41,017 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:29:43,017 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:29:45,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:29:47,019 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:29:49,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:29:51,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:29:53,021 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:29:55,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:29:55,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:29:55,446 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:29:57,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:29:59,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:29:59,654 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:30:01,025 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:30:03,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:30:05,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:30:07,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:30:09,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:30:10,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:30:10,670 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:30:11,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:30:13,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:30:15,031 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:30:17,032 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:30:19,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:30:21,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:30:23,034 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:30:25,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:30:25,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:30:25,891 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:30:27,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:30:29,724 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:30:30,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:30:32,038 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:30:34,039 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:30:36,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:30:38,041 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:30:40,042 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:30:41,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:30:41,105 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:30:42,042 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:30:44,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:30:46,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:30:48,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:30:50,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:30:52,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:30:54,047 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:30:56,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:30:56,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:30:56,346 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:30:58,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:30:59,801 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:31:00,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:31:02,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:31:04,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:31:06,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:31:08,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:31:10,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:31:11,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:31:11,665 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:31:12,056 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:31:14,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:31:16,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:31:18,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:31:20,060 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:31:22,061 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:31:24,061 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:31:26,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:31:26,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:31:26,933 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:31:28,063 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:31:29,873 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:31:30,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:31:32,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:31:34,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:31:36,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:31:38,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:31:40,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:31:42,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:31:42,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:31:42,167 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:31:44,071 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:31:46,071 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:31:48,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:31:50,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:31:52,074 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:31:54,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:31:56,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:31:57,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:31:57,478 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:31:58,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:31:59,947 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:32:00,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:32:02,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:32:05,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:32:07,081 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:32:09,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:32:11,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:32:12,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:32:12,950 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:32:13,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:32:15,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:32:17,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:32:19,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:32:21,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:32:23,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:32:25,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:32:27,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:32:28,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:32:28,198 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:32:29,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:32:30,020 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:32:31,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:32:33,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:32:35,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:32:37,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:32:39,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:32:41,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:32:43,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:32:43,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:32:43,448 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:32:45,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:32:47,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:32:49,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:32:51,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:32:53,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:32:55,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:32:57,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:32:58,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:32:58,782 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:32:59,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:33:00,097 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:33:02,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:33:04,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:33:06,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:33:08,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:33:10,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:33:12,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:33:14,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:33:14,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:33:14,214 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:33:16,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:33:18,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:33:20,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:33:22,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:33:24,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:33:26,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:33:28,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:33:29,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:33:29,447 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:33:30,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:33:30,174 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:33:32,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:33:34,121 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:33:36,121 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:33:38,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:33:40,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:33:42,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:33:44,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:33:44,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:33:44,809 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:33:46,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:33:48,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:33:50,128 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:33:52,128 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:33:54,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:33:56,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:33:58,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:34:00,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:34:00,116 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:34:00,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:34:00,373 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:34:02,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:34:04,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:34:06,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:34:08,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:34:10,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:34:12,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:34:14,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:34:15,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:34:15,423 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:34:16,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:34:18,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:34:20,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:34:22,140 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:34:24,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:34:26,142 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:34:28,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:34:30,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:34:30,327 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:34:30,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:34:30,655 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:34:32,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:34:34,145 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:34:36,146 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:34:39,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:34:41,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:34:43,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:34:45,150 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:34:45,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:34:45,877 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:34:47,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:34:49,152 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:34:51,153 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:34:53,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:34:55,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:34:57,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:34:59,157 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:35:00,404 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:35:01,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:35:01,131 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:35:01,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:35:03,159 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:35:05,159 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:35:07,160 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:35:09,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:35:11,163 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:35:13,163 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:35:15,164 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:35:16,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:35:16,451 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:35:17,165 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:35:19,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:35:21,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:35:23,168 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:35:25,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:35:27,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:35:29,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:35:30,480 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:35:31,172 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:35:31,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:35:31,671 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:35:33,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:35:35,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:35:37,175 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:35:39,176 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:35:41,176 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:35:43,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:35:45,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:35:46,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:35:46,895 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:35:47,179 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:35:49,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:35:51,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:35:53,182 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:35:55,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:35:57,184 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:35:59,185 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:36:00,554 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:36:01,186 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:36:02,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:36:02,208 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:36:03,187 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:36:05,188 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:36:07,189 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:36:09,189 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:36:11,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:36:13,191 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:36:16,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:36:17,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:36:17,506 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:36:18,194 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:36:20,194 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:36:22,195 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:36:24,196 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:36:26,197 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:36:28,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:36:30,199 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:36:30,635 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:36:32,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:36:32,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:36:32,728 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:36:34,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:36:36,202 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:36:38,203 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:36:40,204 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:36:42,205 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:36:44,206 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:36:46,206 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:36:48,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:36:48,050 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:36:48,207 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:36:50,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:36:52,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:36:54,209 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:36:56,210 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:36:58,211 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:37:00,212 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:37:00,709 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:37:02,212 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:37:03,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:37:03,350 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:37:04,213 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:37:06,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:37:08,215 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:37:10,216 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:37:12,217 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:37:14,218 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:37:16,219 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:37:18,219 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:37:18,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:37:18,573 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:37:20,220 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:37:22,221 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:37:24,222 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:37:26,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:37:28,224 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:37:30,225 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:37:30,785 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:37:33,226 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:37:33,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:37:33,906 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:37:35,227 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:37:37,228 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:37:39,228 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:37:41,229 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:37:43,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:37:45,231 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:37:47,232 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:37:49,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:37:49,211 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:37:49,233 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:37:51,233 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:37:53,234 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:37:55,235 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:37:57,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:37:59,237 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:38:00,859 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:38:01,237 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:38:03,238 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:38:04,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:38:04,628 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:38:05,239 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:38:07,240 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:38:09,241 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:38:11,241 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:38:13,242 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:38:15,243 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:38:17,244 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:38:19,245 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:38:19,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:38:19,994 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:38:21,245 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:38:23,246 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:38:25,247 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:38:27,248 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:38:29,249 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:38:30,931 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:38:31,249 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:38:33,250 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:38:35,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:38:35,225 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:38:35,251 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:38:37,252 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:38:39,252 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:38:41,253 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:38:43,254 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:38:45,255 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:38:48,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:38:50,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:38:50,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:38:50,592 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:38:52,257 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:38:54,258 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:38:56,259 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:38:58,259 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:39:00,260 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:39:01,008 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:39:02,261 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:39:04,262 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:39:06,263 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:39:06,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:39:06,396 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:39:08,264 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:39:10,265 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:39:12,265 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:39:14,266 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:39:16,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:39:18,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:39:20,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:39:21,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:39:21,635 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:39:22,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:39:24,270 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:39:26,271 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:39:28,272 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:39:30,273 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:39:31,084 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:39:32,274 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:39:34,275 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:39:36,275 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:39:36,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:39:36,858 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:39:38,276 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:39:40,277 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:39:42,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:39:44,279 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:39:46,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:39:48,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:39:50,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:39:52,283 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:39:52,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:39:52,286 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:39:55,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:39:57,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:39:59,286 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:40:01,160 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:40:01,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:40:03,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:40:05,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:40:07,290 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:40:07,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:40:07,619 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:40:09,290 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:40:11,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:40:13,292 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:40:15,293 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:40:17,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:40:19,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:40:21,296 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:40:22,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:40:22,855 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:40:23,297 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:40:25,298 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:40:27,299 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:40:29,300 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:40:31,233 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:40:31,301 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:40:33,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:40:35,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:40:37,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:40:38,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:40:38,080 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:40:39,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:40:41,306 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:40:43,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:40:45,308 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:40:47,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:40:49,310 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:40:51,311 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:40:53,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:40:53,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:40:53,392 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:40:55,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:40:57,313 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:40:59,314 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:41:01,308 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:41:01,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:41:03,316 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:41:05,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:41:07,318 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:41:08,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:41:08,694 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:41:09,319 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:41:11,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:41:13,321 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:41:15,322 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:41:17,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:41:19,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:41:21,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:41:23,326 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:41:23,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:41:23,926 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:41:25,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:41:27,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:41:30,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:41:31,383 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:41:32,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:41:34,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:41:36,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:41:38,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:41:39,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:41:39,148 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:41:40,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:41:42,335 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:41:44,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:41:46,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:41:48,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:41:50,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:41:52,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:41:54,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:41:54,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:41:54,418 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:41:56,342 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:41:58,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:42:00,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:42:01,460 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:42:02,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:42:04,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:42:06,346 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:42:08,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:42:09,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:42:09,681 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:42:10,348 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:42:12,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:42:14,350 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:42:16,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:42:18,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:42:20,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:42:22,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:42:24,354 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:42:25,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:42:25,037 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:42:26,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:42:28,356 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:42:30,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:42:31,535 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:42:32,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:42:34,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:42:36,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:42:38,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:42:40,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:42:40,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:42:40,470 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:42:42,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:42:44,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:42:46,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:42:48,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:42:50,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:42:52,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:42:54,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:42:55,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:42:55,788 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:42:56,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:42:58,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:43:00,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:43:01,611 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:43:02,371 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:43:04,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:43:06,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:43:08,381 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:43:11,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:43:11,049 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:43:11,382 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:43:13,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:43:15,384 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:43:17,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:43:19,386 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:43:21,387 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:43:23,388 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:43:25,389 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:43:26,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:43:26,292 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:43:27,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:43:29,391 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:43:31,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:43:31,691 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:43:33,393 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:43:35,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:43:37,395 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:43:39,396 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:43:41,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:43:41,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:43:41,510 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:43:43,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:43:45,399 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:43:47,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:43:49,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:43:51,402 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:43:53,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:43:55,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:43:56,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:43:56,763 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:43:57,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:43:59,406 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:44:01,407 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:44:01,767 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:44:03,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:44:05,409 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:44:07,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:44:09,411 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:44:11,412 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:44:11,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:44:11,982 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:44:13,413 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:44:15,414 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:44:17,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:44:19,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:44:21,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:44:23,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:44:25,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:44:27,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:44:27,307 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:44:27,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:44:29,419 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:44:31,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:44:31,842 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:44:33,421 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:44:35,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:44:37,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:44:39,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:44:42,425 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:44:42,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:44:42,530 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:44:44,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:44:46,427 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:44:48,428 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:44:50,429 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:44:52,430 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:44:54,431 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:44:56,432 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:44:57,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:44:57,812 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:44:58,432 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:45:00,433 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:45:01,920 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:45:02,434 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:45:04,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:45:06,436 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:45:08,437 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:45:10,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:45:12,439 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:45:13,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:45:13,104 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:45:14,440 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:45:16,441 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:45:18,442 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:45:20,442 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:45:22,443 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:45:24,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:45:26,445 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:45:28,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:45:28,357 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:45:28,446 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:45:30,447 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:45:31,987 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:45:32,447 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:45:34,448 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:45:36,449 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:45:38,449 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:45:40,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:45:42,451 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:45:43,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:45:43,578 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:45:44,452 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:45:46,452 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:45:48,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:45:50,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:45:52,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:45:54,455 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:45:56,456 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:45:58,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:45:58,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:45:58,806 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:46:00,458 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:46:02,061 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:46:03,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:46:05,460 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:46:07,461 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:46:09,462 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:46:11,463 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:46:13,464 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:46:14,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:46:14,048 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:46:15,465 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:46:17,466 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:46:19,467 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:46:21,468 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:46:23,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:46:25,470 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:46:27,471 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:46:29,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:46:29,428 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:46:29,472 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:46:31,473 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:46:32,136 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:46:33,474 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:46:35,475 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:46:37,476 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:46:39,477 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:46:41,477 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:46:43,478 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:46:44,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:46:44,654 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:46:45,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:46:47,480 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:46:49,481 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:46:51,482 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:46:53,483 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:46:55,483 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:46:57,484 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:46:59,485 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:46:59,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:46:59,913 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:47:01,486 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:47:02,211 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:47:03,486 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:47:05,487 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:47:07,488 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:47:09,489 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:47:11,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:47:13,491 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:47:15,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:47:15,134 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:47:15,492 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:47:17,493 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:47:19,494 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:47:21,495 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:47:23,496 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:47:25,496 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:47:27,497 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:47:30,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:47:30,367 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:47:32,289 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:47:45,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:47:45,621 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:48:00,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:48:00,885 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:48:02,365 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:48:16,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:48:16,151 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:48:26,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:48:26,600 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 02:48:26,650 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 02:48:26,734 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 02:48:27,519 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 02:48:27,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:48:29,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:48:31,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:48:31,400 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:48:32,450 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:48:36,523 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:48:46,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:48:46,646 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:48:56,532 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:49:01,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:49:01,872 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:49:02,532 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:49:17,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:49:17,096 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:49:32,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:49:32,325 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:49:32,611 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:49:47,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:49:47,578 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:50:02,688 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:50:02,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:50:02,890 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:50:18,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:50:18,155 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:50:32,765 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:50:33,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:50:33,403 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:50:48,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:50:48,628 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:51:02,841 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:51:03,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:51:03,851 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:51:19,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:51:19,134 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:51:32,917 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:51:34,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:51:34,361 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:51:49,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:51:49,591 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:52:02,995 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:52:04,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:52:04,860 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:52:20,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:52:20,082 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:52:33,074 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:52:35,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:52:35,324 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:52:49,629 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:52:50,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:52:50,569 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:52:50,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:52:52,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:53:03,154 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:53:04,635 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:53:05,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:53:05,792 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:53:10,637 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:53:10,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:10,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:10,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:10,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:10,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:10,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:10,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:10,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:10,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:10,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:10,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:10,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:10,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:10,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:10,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:10,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:13,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:13,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:13,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:13,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:13,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:13,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:13,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:13,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:13,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:13,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:13,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:13,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:13,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:13,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:13,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:13,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:14,638 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:53:15,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:15,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:15,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:15,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:15,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:15,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:15,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:15,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:15,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:15,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:15,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:15,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:15,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:15,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:15,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:15,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:18,639 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:53:21,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:53:21,018 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:53:21,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:21,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:21,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:21,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:21,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:21,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:21,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:21,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:21,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:21,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:21,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:21,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:21,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:21,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:21,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:21,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:22,640 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:53:22,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:22,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:22,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:22,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:22,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:22,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:22,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:22,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:22,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:22,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:22,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:23,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:23,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:23,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:23,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:23,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:26,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:53:26,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:26,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:26,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:26,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:26,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:26,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:26,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:26,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:26,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:26,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:26,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:26,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:26,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:26,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:26,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:26,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:26,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:26,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:26,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:26,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:26,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:26,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:26,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:26,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:26,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:26,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:26,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:26,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:26,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:26,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:26,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:26,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:30,643 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:53:30,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:30,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:30,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:30,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:30,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:30,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:30,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:30,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:30,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:30,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:30,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:30,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:30,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:30,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:30,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:30,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:32,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:32,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:32,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:32,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:32,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:32,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:32,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:32,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:32,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:32,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:32,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:32,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:32,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:32,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:32,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:32,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:33,230 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:53:34,645 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:53:36,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:53:36,368 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:53:37,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:37,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:37,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:37,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:37,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:37,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:37,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:37,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:37,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:37,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:37,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:37,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:37,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:37,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:37,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:37,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:38,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:38,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:38,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:38,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:38,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:38,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:38,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:38,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:38,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:38,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:38,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:38,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:38,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:38,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:38,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:38,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:39,646 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:53:41,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:53:41,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:41,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:41,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:41,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:41,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:41,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:41,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:41,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:41,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:41,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:41,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:41,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:41,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:41,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:41,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:41,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:44,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:44,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:44,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:44,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:44,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:44,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:44,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:44,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:44,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:44,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:44,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:44,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:44,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:44,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:44,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:44,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:45,648 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:53:46,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:46,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:46,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:46,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:46,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:46,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:46,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:46,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:46,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:46,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:46,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:46,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:46,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:46,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:46,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:46,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:46,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:46,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:46,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:46,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:46,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:46,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:46,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:46,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:46,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:46,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:46,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:46,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:46,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:46,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:46,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:46,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:47,649 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:53:47,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:47,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:47,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:47,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:47,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:47,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:47,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:47,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:47,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:47,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:47,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:47,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:47,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:47,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:47,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:47,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:47,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:47,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:48,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:48,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:48,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:48,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:48,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:48,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:48,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:48,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:48,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:48,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:48,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:48,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:48,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:48,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:51,655 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:53:51,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:53:51,717 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:53:53,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:53:53,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:53,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:53,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:53,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:53,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:53,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:53,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:53,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:53,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:53,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:54,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:54,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:54,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:54,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:54,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:54,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:55,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:55,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:55,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:55,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:55,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:55,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:55,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:55,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:55,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:55,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:55,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:55,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:55,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:55,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:55,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:55,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:55,657 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:53:56,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:56,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:56,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:56,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:56,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:56,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:56,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:56,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:56,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:56,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:56,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:56,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:56,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:56,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:56,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:56,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:58,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:58,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:58,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:58,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:58,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:58,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:58,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:58,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:58,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:58,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:58,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:58,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:58,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:58,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:58,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:58,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:59,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:59,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:59,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:59,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:59,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:59,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:59,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:59,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:59,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:59,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:59,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:59,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:59,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:59,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:59,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:59,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:59,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:59,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:59,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:59,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:59,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:59,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:59,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:59,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:59,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:59,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:59,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:59,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:59,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:59,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:59,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:59,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:53:59,658 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:54:00,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:00,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:00,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:00,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:00,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:00,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:00,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:00,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:00,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:00,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:00,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:00,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:00,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:00,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:00,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:00,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:00,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:00,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:00,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:00,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:00,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:00,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:00,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:00,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:00,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:00,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:00,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:00,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:00,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:00,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:00,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:00,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:01,659 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:54:01,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:01,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:01,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:01,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:01,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:01,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:01,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:01,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:01,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:01,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:01,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:01,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:01,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:01,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:01,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:01,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:03,299 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:54:03,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:03,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:03,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:03,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:03,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:03,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:03,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:03,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:03,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:03,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:03,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:03,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:03,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:03,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:03,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:03,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:03,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:03,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:03,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:03,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:03,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:03,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:03,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:03,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:03,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:03,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:03,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:03,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:03,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:03,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:03,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:03,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:03,660 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:54:06,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:06,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:06,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:06,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:06,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:06,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:06,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:06,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:06,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:06,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:06,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:06,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:06,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:06,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:06,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:06,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:06,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:54:06,975 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:54:07,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:54:08,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:08,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:08,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:08,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:08,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:08,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:08,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:08,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:08,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:08,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:08,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:08,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:08,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:08,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:08,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:08,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:09,663 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:54:11,664 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:54:13,665 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:54:14,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:14,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:14,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:14,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:14,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:14,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:14,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:14,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:14,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:14,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:14,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:14,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:14,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:14,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:14,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:14,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:15,666 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:54:16,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:16,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:16,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:16,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:16,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:16,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:16,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:16,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:16,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:16,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:16,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:16,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:16,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:16,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:16,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:16,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:17,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:17,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:17,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:17,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:17,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:17,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:17,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:17,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:17,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:17,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:17,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:17,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:17,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:17,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:17,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:17,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:18,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:18,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:18,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:18,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:18,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:18,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:18,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:18,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:18,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:18,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:18,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:18,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:18,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:18,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:18,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:18,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:19,667 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:54:21,668 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:54:22,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:54:22,366 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:54:22,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:22,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:22,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:22,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:22,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:22,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:22,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:22,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:22,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:22,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:22,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:22,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:22,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:22,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:22,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:22,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:23,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:54:25,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:54:27,670 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:54:28,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:28,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:28,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:28,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:28,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:28,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:28,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:28,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:28,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:28,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:28,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:28,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:28,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:28,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:28,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:28,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:29,671 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:54:30,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:30,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:30,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:30,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:30,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:30,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:30,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:30,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:30,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:30,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:30,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:30,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:30,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:30,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:30,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:30,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:30,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:30,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:30,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:30,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:30,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:30,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:30,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:30,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:30,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:30,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:30,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:30,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:30,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:30,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:30,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:30,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:31,672 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:54:33,374 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:54:33,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:54:35,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:54:37,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:37,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:37,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:37,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:37,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:37,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:37,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:37,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:37,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:37,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:37,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:37,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:37,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:37,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:37,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:37,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:37,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:54:37,590 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:54:37,674 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:54:38,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:38,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:38,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:38,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:38,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:38,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:38,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:38,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:38,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:38,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:38,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:38,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:38,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:38,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:38,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:38,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:38,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:38,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:38,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:38,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:38,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:38,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:38,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:38,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:38,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:38,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:38,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:38,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:38,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:38,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:38,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:38,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:39,675 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:54:39,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:39,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:39,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:39,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:39,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:39,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:39,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:39,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:39,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:39,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:39,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:39,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:39,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:39,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:39,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:39,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:40,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:40,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:40,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:40,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:40,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:40,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:40,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:40,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:40,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:40,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:40,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:40,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:40,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:40,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:40,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:40,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:41,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:41,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:41,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:41,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:41,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:41,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:41,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:41,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:41,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:41,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:41,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:41,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:41,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:41,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:41,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:41,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:41,676 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:54:43,676 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:54:45,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:54:46,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:46,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:46,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:46,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:46,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:46,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:46,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:46,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:46,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:46,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:46,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:46,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:46,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:46,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:46,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:46,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:47,678 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:54:49,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:54:50,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:50,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:50,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:50,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:50,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:50,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:50,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:50,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:50,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:50,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:50,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:50,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:50,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:50,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:50,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:50,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:51,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:51,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:51,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:51,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:51,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:51,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:51,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:51,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:51,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:51,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:51,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:51,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:51,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:51,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:51,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:51,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:51,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:54:52,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:54:52,883 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:54:53,680 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:54:54,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:54,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:54,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:54,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:55,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:55,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:55,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:55,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:55,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:55,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:55,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:55,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:54:55,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:54:57,682 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:55:01,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:01,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:01,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:01,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:01,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:01,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:01,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:01,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:01,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:01,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:01,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:01,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:01,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:01,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:01,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:01,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:03,452 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:55:07,685 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:55:08,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:55:08,114 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:55:11,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:55:17,689 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:55:19,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:19,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:19,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:19,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:19,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:19,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:19,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:19,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:19,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:19,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:19,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:19,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:19,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:19,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:19,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:19,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:21,690 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:55:23,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:55:23,341 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:55:25,692 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:55:28,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:28,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:28,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:28,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:28,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:28,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:28,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:28,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:28,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:28,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:28,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:28,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:28,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:28,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:28,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:28,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:29,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:29,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:29,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:29,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:29,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:29,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:29,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:29,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:29,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:29,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:29,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:29,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:29,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:29,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:29,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:29,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:29,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:55:31,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:55:32,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:32,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:32,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:32,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:32,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:32,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:32,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:32,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:32,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:32,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:32,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:32,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:32,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:32,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:32,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:32,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:33,526 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:55:33,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:33,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:33,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:33,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:33,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:33,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:33,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:33,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:33,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:33,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:33,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:33,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:33,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:33,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:33,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:33,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:35,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:35,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:35,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:35,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:35,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:35,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:35,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:35,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:35,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:35,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:35,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:35,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:35,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:35,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:35,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:35,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:35,696 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:55:38,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:55:38,563 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:55:38,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:38,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:38,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:38,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:38,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:38,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:38,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:38,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:38,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:38,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:38,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:38,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:38,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:38,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:38,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:38,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:39,697 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:55:41,698 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:55:42,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:42,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:42,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:42,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:42,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:42,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:42,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:42,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:42,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:42,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:42,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:42,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:42,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:42,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:42,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:42,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:45,700 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:55:47,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:47,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:47,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:47,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:47,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:47,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:47,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:47,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:47,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:47,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:47,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:47,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:47,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:47,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:47,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:47,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:48,701 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:55:49,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:49,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:49,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:49,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:49,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:49,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:49,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:49,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:49,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:49,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:49,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:49,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:49,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:49,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:49,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:49,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:49,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:49,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:49,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:49,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:49,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:49,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:49,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:49,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:49,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:49,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:49,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:49,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:49,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:49,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:49,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:49,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:51,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:51,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:51,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:51,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:51,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:51,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:51,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:51,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:51,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:51,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:51,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:51,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:51,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:51,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:51,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:51,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:52,703 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:55:53,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:53,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:53,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:53,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:53,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:53,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:53,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:53,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:53,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:53,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:53,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:53,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:53,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:53,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:53,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:53,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:53,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:55:53,804 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:55:54,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,704 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:55:54,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:54,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:57,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:57,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:57,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:57,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:57,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:57,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:57,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:57,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:57,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:57,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:57,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:57,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:57,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:57,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:57,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:57,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:58,706 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:55:59,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:59,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:59,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:59,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:59,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:59,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:59,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:59,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:59,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:59,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:59,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:59,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:59,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:59,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:59,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:55:59,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:00,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:00,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:00,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:00,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:00,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:00,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:00,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:00,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:00,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:00,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:00,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:00,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:00,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:00,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:00,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:00,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:00,706 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:56:01,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:01,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:01,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:01,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:01,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:01,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:01,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:01,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:01,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:01,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:01,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:01,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:01,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:01,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:01,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:01,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:02,707 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:56:03,598 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:56:03,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:03,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:03,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:03,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:03,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:03,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:03,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:03,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:03,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:03,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:03,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:03,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:03,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:03,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:03,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:03,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:04,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:04,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:04,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:04,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:04,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:04,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:04,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:04,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:04,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:04,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:04,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:04,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:04,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:04,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:04,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:04,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:04,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:04,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:04,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:04,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:04,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:04,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:04,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:04,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:04,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:04,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:04,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:04,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:04,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:04,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:04,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:04,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:04,708 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:56:06,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:06,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:07,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:07,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:07,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:07,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:07,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:07,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:07,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:07,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:07,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:07,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:07,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:07,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:07,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:07,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:07,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:07,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:07,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:07,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:07,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:07,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:07,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:07,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:07,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:07,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:07,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:07,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:07,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:07,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:07,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:07,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:07,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:07,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:08,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:56:09,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:56:09,124 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:56:10,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:10,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:10,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:10,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:10,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:10,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:10,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:10,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:10,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:10,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:10,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:10,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:10,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:10,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:10,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:10,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:10,710 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:56:12,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:12,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:12,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:12,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:12,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:12,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:12,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:12,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:12,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:12,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:12,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:12,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:12,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:12,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:12,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:12,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:12,711 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:56:14,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:56:16,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:56:17,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:17,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:18,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:18,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:18,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:18,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:18,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:18,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:18,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:18,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:18,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:18,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:18,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:18,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:18,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:18,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:18,713 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:56:20,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:20,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:20,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:20,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:20,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:20,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:20,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:20,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:20,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:20,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:20,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:20,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:20,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:20,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:20,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:20,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:20,714 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:56:20,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:20,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:20,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:20,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:20,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:20,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:20,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:20,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:20,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:20,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:20,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:20,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:20,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:20,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:20,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:20,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:22,714 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:56:23,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:23,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:23,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:23,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:23,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:23,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:23,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:23,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:23,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:23,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:23,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:23,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:23,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:23,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:23,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:23,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:24,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:56:24,476 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:56:24,715 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:56:26,716 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:56:28,717 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:56:29,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:29,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:29,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:29,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:29,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:29,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:29,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:29,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:29,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:29,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:29,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:29,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:29,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:29,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:29,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:29,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:30,718 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:56:32,719 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:56:33,666 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:56:34,720 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:56:34,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:34,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:34,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:34,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:34,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:34,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:34,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:34,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:34,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:34,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:34,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:34,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:34,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:34,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:34,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:34,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:35,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:35,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:35,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:35,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:35,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:35,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:35,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:35,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:35,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:35,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:35,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:35,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:35,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:35,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:35,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:35,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:35,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:35,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:35,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:35,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:35,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:35,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:35,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:35,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:35,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:35,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:35,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:35,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:35,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:35,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:35,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:35,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:36,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:56:38,722 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:56:39,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:56:39,700 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:56:40,723 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:56:40,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:40,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:40,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:40,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:40,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:40,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:40,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:40,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:40,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:40,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:40,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:40,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:40,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:40,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:40,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:40,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:41,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:41,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:41,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:41,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:41,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:41,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:41,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:41,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:41,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:41,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:41,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:41,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:41,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:41,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:41,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:41,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:41,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:41,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:41,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:41,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:41,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:41,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:41,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:41,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:41,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:41,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:41,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:41,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:41,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:41,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:41,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:41,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:42,724 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:56:43,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:43,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:44,725 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:56:46,725 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:56:47,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:47,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:47,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:47,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:47,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:47,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:47,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:47,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:47,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:47,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:47,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:47,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:47,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:47,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:47,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:47,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:48,726 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:56:50,727 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:56:51,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:51,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:51,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:51,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:51,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:51,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:51,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:51,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:51,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:51,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:51,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:51,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:51,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:51,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:51,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:51,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:52,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:52,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:52,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:52,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:52,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:52,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:52,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:52,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:52,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:52,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:52,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:52,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:52,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:52,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:52,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:52,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:52,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:56:54,729 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:56:54,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:56:54,964 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:56:55,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:55,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:55,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:55,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:55,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:55,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:55,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:55,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:55,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:55,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:55,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:55,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:55,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:56:55,666 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 02:56:55,893 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 02:56:55,960 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 02:56:56,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 02:56:56,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:57:03,981 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:57:06,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:57:10,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:57:10,192 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:57:12,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:57:16,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:57:20,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:57:24,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:24,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:24,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:24,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:24,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:24,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:24,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:24,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:24,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:24,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:24,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:24,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:24,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:24,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:24,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:24,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:24,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:57:25,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:57:25,414 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:57:25,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:25,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:25,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:25,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:25,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:25,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:25,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:25,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:25,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:25,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:25,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:25,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:25,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:25,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:25,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:25,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:28,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:57:30,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:57:31,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:31,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:31,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:31,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:31,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:31,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:31,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:31,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:31,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:31,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:31,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:31,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:31,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:31,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:31,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:31,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:34,056 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:57:34,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:57:36,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:36,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:36,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:36,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:36,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:36,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:36,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:36,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:36,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:36,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:36,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:36,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:36,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:36,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:36,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:36,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:37,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:37,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:37,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:37,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:37,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:37,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:37,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:37,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:37,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:37,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:37,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:37,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:37,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:37,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:37,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:37,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:38,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:57:38,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:38,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:38,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:38,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:38,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:38,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:38,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:38,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:38,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:38,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:38,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:38,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:38,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:38,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:38,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:38,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:40,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:40,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:40,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:40,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:40,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:40,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:40,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:40,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:40,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:40,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:40,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:40,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:40,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:40,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:40,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:40,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:40,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:57:40,643 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:57:40,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:57:42,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:42,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:42,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:42,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:42,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:42,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:42,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:42,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:42,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:42,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:42,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:42,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:42,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:42,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:42,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:42,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:44,882 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:57:45,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:45,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:45,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:45,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:45,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:45,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:45,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:45,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:45,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:45,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:45,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:45,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:45,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:45,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:45,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:45,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:46,883 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:57:50,885 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:57:52,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:57:54,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:57:55,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:57:55,978 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:57:56,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:56,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:57,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:57,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:57,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:57,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:57,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:57,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:57,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:57,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:57,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:57,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:57,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:57,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:57,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:57,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:57,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:57,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:58,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:57:59,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:57:59,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:00,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:58:04,127 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:58:04,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:04,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:04,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:04,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:04,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:04,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:04,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:04,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:04,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:04,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:04,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:04,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:04,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:04,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:04,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:04,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:04,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:04,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:04,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:04,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:04,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:04,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:04,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:04,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:04,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:04,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:04,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:04,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:04,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:04,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:04,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:04,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:04,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:58:05,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:05,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:05,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:05,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:05,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:05,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:05,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:05,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:05,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:05,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:05,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:05,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:05,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:05,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:05,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:05,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:06,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:06,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:06,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:06,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:06,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:06,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:06,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:06,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:06,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:06,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:06,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:06,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:06,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:06,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:06,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:06,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:07,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:58:08,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:08,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:08,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:08,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:08,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:08,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:08,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:08,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:08,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:08,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:08,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:08,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:08,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:08,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:08,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:08,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:09,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:09,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:09,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:09,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:09,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:09,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:09,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:09,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:09,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:09,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:09,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:09,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:09,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:09,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:09,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:09,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:09,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:58:10,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:10,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:10,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:10,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:10,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:10,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:10,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:10,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:10,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:10,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:10,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:10,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:10,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:10,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:10,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:10,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:11,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:58:11,205 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:58:11,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:11,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:11,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:11,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:11,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:11,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:11,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:11,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:11,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:11,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:11,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:11,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:11,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:11,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:11,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:11,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:11,894 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:58:12,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:12,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:12,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:12,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:12,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:12,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:12,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:12,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:12,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:12,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:12,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:12,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:12,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:12,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:12,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:12,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:12,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:12,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:12,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:12,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:12,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:12,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:12,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:12,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:12,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:12,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:12,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:12,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:12,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:12,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:12,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:12,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:13,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:58:15,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:58:16,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:16,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:16,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:16,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:16,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:16,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:16,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:16,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:16,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:16,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:16,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:16,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:16,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:16,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:16,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:16,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:16,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:16,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:16,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:16,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:16,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:16,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:16,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:16,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:16,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:16,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:16,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:16,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:16,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:16,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:16,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:16,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:17,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:17,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:17,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:17,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:17,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:17,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:17,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:17,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:17,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:17,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:17,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:17,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:17,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:17,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:17,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:17,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:17,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:17,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:17,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:17,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:17,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:17,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:17,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:17,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:17,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:17,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:17,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:17,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:17,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:17,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:17,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:17,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:17,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:58:21,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:21,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:21,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:21,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:21,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:21,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:21,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:21,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:21,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:21,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:21,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:21,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:21,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:21,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:21,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:21,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:21,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:58:23,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:23,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:23,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:23,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:23,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:23,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:23,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:23,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:23,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:23,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:23,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:23,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:23,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:23,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:23,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:23,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:23,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:23,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:23,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:23,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:23,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:23,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:23,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:23,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:23,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:23,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:23,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:23,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:23,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:23,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:23,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:23,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:23,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:58:25,900 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:58:26,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:26,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:26,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:26,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:26,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:26,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:26,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:26,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:26,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:26,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:26,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:26,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:26,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:26,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:26,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:26,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:26,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:58:26,459 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:58:27,900 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:58:29,901 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:58:31,902 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:58:32,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:32,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:32,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:32,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:32,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:32,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:32,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:32,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:32,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:32,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:32,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:32,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:32,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:32,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:32,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:32,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:33,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:58:34,196 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:58:35,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:58:37,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:58:38,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:38,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:38,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:38,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:38,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:38,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:38,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:38,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:38,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:38,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:38,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:38,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:38,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:38,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:38,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:38,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:39,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:39,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:39,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:39,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:39,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:39,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:39,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:39,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:39,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:39,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:39,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:39,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:39,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:39,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:39,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:39,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:39,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:39,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:39,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:39,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:39,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:39,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:39,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:39,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:39,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:39,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:39,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:39,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:39,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:39,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:39,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:39,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:39,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:58:41,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:58:41,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:58:41,917 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:58:41,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:41,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:41,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:41,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:41,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:41,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:41,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:41,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:41,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:41,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:41,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:41,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:41,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:41,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:41,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:41,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:43,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:43,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:43,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:43,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:43,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:43,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:43,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:43,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:43,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:43,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:43,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:43,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:43,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:43,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:43,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:43,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:43,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:58:44,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:44,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:44,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:44,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:44,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:44,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:44,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:44,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:44,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:44,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:44,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:44,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:44,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:44,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:44,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:44,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:45,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:45,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:45,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:45,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:45,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:45,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:45,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:45,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:45,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:45,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:45,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:45,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:45,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:45,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:45,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:45,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:45,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:45,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:45,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:45,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:45,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:45,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:45,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:45,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:45,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:45,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:45,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:45,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:45,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:45,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:45,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:45,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:45,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:58:46,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:46,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:46,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:46,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:46,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:46,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:46,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:46,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:46,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:46,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:46,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:46,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:46,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:46,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:46,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:46,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:47,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:58:48,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:48,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:48,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:48,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:48,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:48,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:48,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:48,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:48,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:48,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:48,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:48,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:48,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:48,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:48,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:48,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:49,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:58:51,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:58:53,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:58:54,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:54,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:54,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:54,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:54,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:54,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:54,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:54,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:54,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:54,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:54,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:54,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:54,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:54,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:54,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:54,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:54,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:54,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:54,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:54,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:54,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:54,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:54,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:54,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:54,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:54,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:54,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:54,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:58:55,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:58:57,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:58:57,200 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:58:57,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:59:00,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:00,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:00,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:00,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:00,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:00,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:00,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:00,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:00,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:00,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:00,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:00,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:00,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:00,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:00,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:00,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:04,272 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:59:07,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:59:11,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:59:12,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:59:12,806 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:59:15,921 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:59:19,922 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:59:23,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:59:25,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:25,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:25,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:25,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:25,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:25,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:25,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:25,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:25,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:25,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:25,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:25,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:25,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:26,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:26,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:26,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:27,925 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:59:28,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:59:28,138 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:59:31,927 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:59:33,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:33,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:33,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:33,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:33,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:33,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:33,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:33,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:33,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:33,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:33,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:33,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:33,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:33,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:33,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:33,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:34,347 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 02:59:35,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:59:37,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:59:38,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:38,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:38,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:38,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:38,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:38,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:38,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:38,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:38,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:38,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:38,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:38,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:38,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:38,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:38,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:38,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:41,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:59:43,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:59:43,366 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:59:45,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:45,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:45,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:45,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:45,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:45,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:45,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:45,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:45,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:45,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:45,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:45,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:45,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:45,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:45,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:45,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:45,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:59:47,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:47,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:47,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:47,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:47,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:47,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:47,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:47,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:47,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:47,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:47,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:47,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:47,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:47,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:47,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:47,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:47,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:47,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:47,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:47,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:47,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:47,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:47,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:47,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:47,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:47,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:47,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:47,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:47,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:47,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:47,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:47,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:47,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:59:50,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:50,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:50,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:50,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:50,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:50,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:50,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:50,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:50,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:50,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:50,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:50,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:50,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:50,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:50,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:50,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:50,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:50,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:50,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:50,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:50,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:50,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:50,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:50,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:50,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:50,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:50,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:50,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:50,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:50,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:50,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:50,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:51,935 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:59:53,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:59:54,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:54,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:54,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:54,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:54,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:54,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:54,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:54,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:54,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:54,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:54,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:54,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:54,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:54,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:54,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:54,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:55,937 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 02:59:58,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 02:59:58,723 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 02:59:59,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:59,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:59,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:59,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:59,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:59,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:59,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:59,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:59,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:59,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:59,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:59,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:59,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:59,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:59,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:59,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 02:59:59,939 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:00:01,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:01,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:01,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:01,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:01,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:01,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:01,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:01,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:01,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:01,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:01,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:01,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:01,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:01,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:01,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:01,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:01,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:01,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:01,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:01,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:01,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:01,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:01,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:01,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:01,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:01,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:01,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:01,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:01,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:01,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:01,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:01,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:01,940 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:00:03,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:03,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:03,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:03,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:03,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:03,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:03,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:03,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:03,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:03,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:03,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:03,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:03,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:03,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:03,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:03,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:03,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:03,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:03,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:03,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:03,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:03,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:03,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:03,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:03,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:03,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:03,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:03,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:03,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:03,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:03,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:03,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:04,423 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:00:04,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:04,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:04,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:04,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:04,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:04,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:04,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:04,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:04,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:04,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:04,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:04,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:04,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:04,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:04,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:04,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:04,941 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:00:06,942 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:00:07,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:08,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:08,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:08,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:08,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:08,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:08,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:08,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:08,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:08,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:08,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:08,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:08,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:08,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:08,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:08,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:08,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:08,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:08,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:08,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:08,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:08,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:08,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:08,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:08,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:08,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:08,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:08,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:08,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:08,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:08,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:08,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:10,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:10,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:10,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:10,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:10,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:10,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:10,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:10,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:10,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:10,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:10,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:10,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:10,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:10,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:10,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:10,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:10,944 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:00:11,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:11,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:11,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:11,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:11,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:11,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:11,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:11,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:11,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:11,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:11,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:11,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:11,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:11,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:11,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:11,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:12,945 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:00:13,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:00:13,944 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:00:13,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:13,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:13,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:13,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:13,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:13,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:13,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:13,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:14,946 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:00:16,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:16,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:16,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:16,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:16,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:16,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:16,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:16,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:16,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:16,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:16,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:16,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:16,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:16,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:16,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:16,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:16,947 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:00:17,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:17,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:17,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:17,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:17,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:17,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:17,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:17,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:17,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:17,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:17,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:17,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:17,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:17,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:17,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:17,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:18,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:18,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:18,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:18,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:18,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:18,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:18,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:18,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:18,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:18,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:18,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:18,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:18,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:18,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:18,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:18,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:20,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:20,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:20,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:20,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:20,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:20,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:20,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:20,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:20,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:20,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:20,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:20,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:20,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:20,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:20,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:20,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:20,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:20,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:20,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:20,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:20,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:20,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:20,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:20,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:20,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:20,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:20,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:20,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:20,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:20,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:20,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:20,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:20,949 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:00:21,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:21,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:21,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:21,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:21,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:21,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:21,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:21,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:21,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:21,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:21,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:21,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:21,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:21,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:21,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:21,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:22,950 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:00:23,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:23,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:24,951 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:00:26,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:26,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:26,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:26,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:26,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:26,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:26,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:26,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:26,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:26,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:26,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:26,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:26,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:26,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:26,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:26,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:26,952 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:00:27,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:27,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:27,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:27,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:27,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:27,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:27,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:27,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:27,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:27,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:27,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:27,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:27,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:27,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:27,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:27,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:28,952 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:00:29,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:00:29,188 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:00:30,953 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:00:31,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:31,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:31,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:31,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:31,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:31,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:31,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:31,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:31,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:31,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:31,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:31,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:31,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:31,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:31,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:31,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:32,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:32,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:32,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:32,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:32,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:32,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:32,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:32,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:32,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:32,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:32,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:32,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:32,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:32,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:32,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:32,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:32,954 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:00:34,497 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:00:34,955 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:00:36,956 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:00:37,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:37,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:37,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:37,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:37,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:37,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:37,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:37,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:37,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:37,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:37,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:37,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:37,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:37,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:37,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:37,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:38,957 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:00:40,958 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:00:42,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:42,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:42,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:42,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:42,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:42,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:42,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:42,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:42,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:42,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:42,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:42,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:42,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:42,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:42,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:42,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:42,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:42,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:42,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:42,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:42,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:42,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:42,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:42,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:42,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:42,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:42,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:42,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:42,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:42,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:42,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:42,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:42,958 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:00:44,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:44,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:44,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:44,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:44,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:44,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:00:44,405 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:00:44,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:44,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:44,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:44,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:44,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:44,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:44,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:44,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:44,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:44,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:44,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:44,959 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:00:45,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:45,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:45,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:45,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:45,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:45,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:45,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:45,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:45,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:45,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:45,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:45,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:45,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:45,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:45,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:45,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:46,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:46,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:46,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:46,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:46,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:46,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:46,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:46,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:46,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:46,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:46,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:46,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:46,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:46,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:46,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:46,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:46,960 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:00:47,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:47,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:47,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:47,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:47,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:47,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:47,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:47,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:47,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:47,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:47,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:47,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:47,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:47,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:47,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:47,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:48,961 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:00:50,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:00:51,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:51,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:51,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:51,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:51,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:51,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:51,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:51,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:51,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:51,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:51,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:51,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:51,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:51,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:51,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:51,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:52,963 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:00:54,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:54,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:54,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:54,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:54,964 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:00:55,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:55,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:55,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:55,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:55,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:55,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:55,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:55,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:55,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:00:55,288 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 03:00:55,508 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 03:00:55,572 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 03:00:55,964 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 03:00:56,965 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:00:57,965 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:00:59,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:00:59,629 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:01:04,592 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:01:04,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:04,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:04,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:04,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:04,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:04,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:04,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:04,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:04,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:04,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:04,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:04,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:04,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:04,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:04,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:04,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:06,969 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:01:12,971 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:01:14,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:01:14,851 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:01:16,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:16,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:16,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:16,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:16,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:16,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:16,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:16,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:16,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:16,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:16,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:16,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:16,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:16,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:16,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:16,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:16,973 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:01:20,974 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:01:24,977 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:01:28,978 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:01:30,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:01:30,135 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:01:32,980 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:01:33,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:33,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:33,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:33,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:33,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:33,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:33,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:33,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:33,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:33,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:33,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:33,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:33,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:33,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:33,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:33,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:34,664 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:01:36,982 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:01:37,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:37,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:37,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:37,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:37,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:37,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:37,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:37,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:37,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:37,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:37,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:37,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:37,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:37,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:37,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:37,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:38,982 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:01:42,984 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:01:44,985 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:01:45,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:01:45,358 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:01:46,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:46,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:46,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:46,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:46,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:46,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:46,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:46,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:46,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:46,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:46,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:46,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:46,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:46,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:46,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:46,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:48,987 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:01:51,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:51,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:51,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:51,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:51,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:51,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:51,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:51,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:51,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:51,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:51,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:51,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:51,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:51,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:51,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:51,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:52,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:01:53,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:53,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:53,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:53,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:53,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:53,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:53,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:53,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:53,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:53,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:53,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:53,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:53,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:53,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:53,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:53,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:54,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:54,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:54,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:54,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:54,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:54,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:54,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:54,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:54,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:54,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:54,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:54,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:54,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:54,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:54,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:54,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:54,989 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:01:56,990 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:01:57,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:57,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:57,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:57,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:57,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:57,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:57,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:57,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:57,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:57,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:57,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:57,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:57,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:57,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:57,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:57,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:58,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:58,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:58,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:58,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:58,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:58,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:58,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:58,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:58,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:58,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:58,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:58,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:58,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:58,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:58,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:01:58,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:00,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:02:00,657 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:02:00,992 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:02:03,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:03,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:03,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:03,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:03,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:03,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:03,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:03,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:03,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:03,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:03,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:03,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:03,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:03,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:03,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:03,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:03,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:03,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:03,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:03,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:03,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:03,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:03,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:03,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:03,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:03,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:03,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:03,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:03,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:03,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:03,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:03,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:03,993 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:02:04,734 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:02:05,994 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:02:07,995 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:02:08,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:08,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:08,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:08,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:08,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:08,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:08,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:08,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:08,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:08,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:08,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:08,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:08,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:08,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:08,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:08,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:08,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:08,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:08,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:08,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:08,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:08,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:08,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:08,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:08,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:08,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:08,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:08,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:08,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:08,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:08,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:08,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:11,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:02:12,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:12,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:12,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:12,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:12,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:12,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:12,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:12,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:12,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:12,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:12,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:12,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:12,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:12,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:12,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:12,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:12,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:12,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:12,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:12,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:12,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:12,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:12,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:12,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:12,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:12,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:12,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:12,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:12,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:12,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:12,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:12,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:13,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:13,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:13,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:13,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:13,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:13,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:13,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:13,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:13,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:13,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:13,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:13,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:13,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:13,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:13,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:13,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:13,997 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:02:14,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:14,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:14,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:14,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:14,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:14,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:14,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:14,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:14,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:14,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:14,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:14,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:14,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:14,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:14,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:14,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:15,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:02:15,880 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:02:15,998 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:02:16,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:16,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:16,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:16,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:16,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:16,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:16,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:16,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:16,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:16,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:16,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:16,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:16,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:17,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:17,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:17,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:17,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:17,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:17,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:17,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:17,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:17,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:17,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:17,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:17,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:17,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:17,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:17,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:17,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:17,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:17,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:17,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:17,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:02:18,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:18,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:20,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:02:22,001 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:02:22,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:22,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:23,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:23,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:23,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:23,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:23,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:23,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:23,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:23,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:23,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:23,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:23,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:23,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:23,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:23,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:23,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:23,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:24,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:02:25,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:25,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:25,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:25,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:25,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:25,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:25,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:25,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:25,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:25,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:25,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:25,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:25,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:25,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:25,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:25,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:25,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:25,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:25,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:25,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:25,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:25,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:25,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:25,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:25,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:25,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:25,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:25,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:25,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:25,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:25,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:25,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:26,003 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:02:26,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:26,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:26,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:26,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:26,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:26,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:26,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:26,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:26,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:26,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:26,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:26,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:26,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:26,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:26,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:26,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:26,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:26,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:26,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:26,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:26,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:26,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:26,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:26,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:26,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:26,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:26,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:26,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:26,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:26,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:26,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:26,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:27,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:27,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:27,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:27,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:27,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:27,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:27,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:27,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:27,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:27,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:27,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:27,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:27,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:27,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:27,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:27,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:28,004 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:02:29,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:29,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:29,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:29,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:29,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:29,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:29,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:29,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:29,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:29,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:29,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:29,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:29,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:29,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:29,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:29,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:30,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:02:30,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:30,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:30,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:30,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:30,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:30,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:30,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:30,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:30,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:30,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:30,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:30,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:30,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:30,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:30,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:30,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:31,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:02:31,189 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:02:32,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:02:34,007 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:02:34,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:34,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:34,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:34,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:34,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:34,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:34,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:34,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:34,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:34,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:34,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:34,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:34,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:34,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:34,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:34,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:34,809 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:02:35,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:35,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:35,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:35,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:35,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:35,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:35,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:35,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:35,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:35,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:35,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:35,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:35,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:35,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:35,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:35,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:36,007 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:02:36,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:36,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:36,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:36,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:36,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:36,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:36,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:36,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:36,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:36,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:36,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:36,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:36,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:36,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:36,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:36,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:38,008 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:02:40,009 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:02:41,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:41,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:41,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:41,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:41,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:41,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:41,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:41,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:41,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:41,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:41,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:41,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:41,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:41,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:41,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:41,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:42,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:02:44,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:02:46,012 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:02:46,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:02:46,409 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:02:46,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:46,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:46,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:46,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:46,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:46,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:46,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:46,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:46,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:46,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:46,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:46,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:46,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:46,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:46,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:46,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:47,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:47,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:47,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:47,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:47,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:47,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:47,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:47,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:47,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:47,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:47,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:47,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:47,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:47,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:47,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:47,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:47,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:47,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:47,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:47,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:47,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:47,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:47,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:47,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:47,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:47,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:47,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:47,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:47,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:47,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:47,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:47,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:48,013 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:02:48,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:48,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:48,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:48,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:48,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:48,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:48,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:48,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:48,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:48,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:48,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:48,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:48,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:48,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:48,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:48,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:48,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:48,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:48,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:48,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:48,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:48,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:48,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:48,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:48,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:48,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:48,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:48,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:48,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:48,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:48,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:48,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:50,014 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:02:50,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:50,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:50,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:50,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:50,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:50,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:50,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:50,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:50,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:50,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:50,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:50,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:50,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:50,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:50,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:50,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:51,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:51,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:51,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:51,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:51,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:51,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:51,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:51,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:51,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:51,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:51,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:51,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:51,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:51,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:51,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:51,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:51,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:51,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:51,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:51,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:51,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:51,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:51,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:51,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:51,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:51,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:51,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:51,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:51,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:51,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:51,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:51,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:52,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:02:52,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:52,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:52,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:52,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:52,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:52,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:52,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:52,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:52,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:52,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:52,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:52,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:52,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:52,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:52,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:52,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:54,017 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:02:54,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:54,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:54,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:54,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:54,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:54,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:54,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:54,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:54,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:54,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:54,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:54,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:54,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:54,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:54,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:54,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:55,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:55,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:55,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:55,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:55,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:55,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:55,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:55,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:55,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:55,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:55,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:55,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:02:56,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:02:58,019 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:03:01,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:03:01,636 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:03:04,881 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:03:07,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:07,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:07,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:07,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:07,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:07,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:07,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:07,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:07,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:07,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:07,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:07,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:07,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:07,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:07,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:07,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:08,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:03:12,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:03:16,025 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:03:16,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:03:16,860 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:03:20,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:03:20,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:20,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:20,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:20,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:20,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:20,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:20,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:20,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:20,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:20,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:20,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:20,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:20,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:20,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:20,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:20,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:24,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:03:28,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:03:32,032 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:03:32,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:03:32,118 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:03:34,956 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:03:36,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:03:38,034 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:03:42,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:03:42,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:42,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:42,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:42,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:42,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:42,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:42,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:42,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:42,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:42,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:42,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:42,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:42,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:42,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:42,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:42,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:44,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:03:44,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:44,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:44,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:44,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:44,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:44,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:44,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:44,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:44,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:44,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:44,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:44,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:44,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:44,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:44,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:44,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:47,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:03:47,481 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:03:49,039 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:03:51,039 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:03:52,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:52,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:52,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:52,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:52,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:52,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:52,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:52,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:52,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:52,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:52,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:52,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:52,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:52,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:52,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:52,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:54,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:54,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:54,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:54,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:54,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:54,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:54,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:54,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:54,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:54,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:54,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:54,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:54,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:54,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:54,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:54,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:55,041 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:03:55,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:55,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:55,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:55,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:55,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:55,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:55,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:55,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:55,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:55,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:55,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:55,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:55,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:55,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:55,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:55,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:57,042 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:03:57,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:57,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:57,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:57,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:57,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:57,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:57,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:57,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:57,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:57,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:57,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:57,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:57,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:57,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:57,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:03:57,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:00,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:00,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:00,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:00,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:00,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:00,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:00,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:00,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:00,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:00,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:00,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:00,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:00,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:00,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:00,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:00,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:01,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:04:02,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:04:02,704 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:04:03,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:04:05,029 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:04:05,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:04:07,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:07,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:07,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:07,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:07,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:07,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:07,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:07,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:07,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:07,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:07,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:07,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:07,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:07,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:07,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:07,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,047 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:04:09,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:09,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:11,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:04:13,049 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:04:13,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:13,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:13,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:13,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:13,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:13,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:13,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:13,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:13,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:13,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:13,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:13,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:13,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:13,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:13,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:13,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:15,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:04:16,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:16,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:17,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:04:17,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:04:17,993 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:04:18,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:18,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:19,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:04:19,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:19,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:19,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:19,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:19,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:19,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:19,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:19,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:19,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:19,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:19,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:19,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:19,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:19,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:19,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:19,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:19,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:19,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:19,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:19,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:19,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:19,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:19,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:19,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:19,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:19,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:19,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:19,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:19,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:19,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:19,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:19,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:20,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:20,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:20,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:20,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:20,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:20,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:20,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:20,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:20,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:20,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:20,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:20,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:20,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:20,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:20,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:20,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:21,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:04:23,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:04:23,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:23,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:23,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:23,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:23,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:23,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:23,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:23,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:23,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:23,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:23,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:23,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:23,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:23,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:23,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:23,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:25,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:04:26,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:26,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:26,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:26,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:26,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:26,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:26,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:26,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:26,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:26,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:26,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:26,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:26,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:26,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:26,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:26,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:27,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:04:27,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:27,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:27,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:27,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:27,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:27,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:27,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:27,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:27,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:27,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:27,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:27,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:27,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:27,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:27,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:27,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:28,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:28,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:28,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:28,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:28,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:28,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:28,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:28,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:28,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:28,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:28,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:28,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:28,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:28,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:28,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:28,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:29,056 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:04:29,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:29,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:29,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:29,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:29,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:29,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:29,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:29,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:29,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:29,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:29,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:29,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:29,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:29,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:29,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:29,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:30,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:31,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:04:31,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:31,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:31,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:31,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:31,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:31,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:31,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:31,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:31,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:31,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:31,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:31,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:31,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:31,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:31,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:31,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:31,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:31,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:31,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:31,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:31,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:31,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:31,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:31,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:31,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:31,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:31,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:31,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:31,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:31,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:31,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:31,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:33,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:04:33,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:04:33,266 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:04:35,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:04:35,106 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:04:35,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:35,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:35,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:35,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:35,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:35,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:35,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:35,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:35,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:35,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:35,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:35,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:35,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:35,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:35,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:35,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:37,059 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:04:38,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:38,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:38,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:38,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:38,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:38,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:38,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:38,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:38,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:38,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:38,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:38,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:38,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:38,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:38,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:38,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:39,060 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:04:39,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:39,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:39,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:39,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:39,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:39,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:39,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:39,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:39,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:39,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:39,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:39,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:39,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:39,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:39,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:39,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:39,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:39,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:39,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:39,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:39,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:39,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:39,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:39,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:39,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:39,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:39,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:39,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:39,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:39,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:39,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:39,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:41,061 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:04:43,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:04:43,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:43,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:43,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:43,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:43,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:43,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:43,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:43,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:43,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:43,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:43,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:43,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:43,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:43,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:43,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:43,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:45,063 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:04:47,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:04:48,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:04:48,515 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:04:48,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:48,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:48,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:48,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:48,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:48,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:48,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:48,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:48,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:48,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:48,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:48,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:48,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:48,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:48,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:48,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:48,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:48,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:48,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:48,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:48,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:48,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:48,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:48,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:48,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:48,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:48,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:48,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:48,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:48,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:48,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:48,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:49,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:04:49,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:49,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:49,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:49,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:49,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:49,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:49,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:49,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:49,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:49,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:49,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:49,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:49,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:49,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:49,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:49,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:49,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:49,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:49,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:49,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:49,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:49,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:49,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:49,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:49,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:49,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:49,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:49,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:49,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:49,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:49,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:49,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:50,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:50,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:50,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:50,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:50,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:50,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:50,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:50,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:50,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:50,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:50,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:50,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:50,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:50,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:50,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:50,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:50,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:50,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:50,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:50,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:50,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:50,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:50,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:50,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:50,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:50,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:50,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:50,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:50,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:51,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:51,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:51,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:51,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:04:51,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:51,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:51,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:51,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:51,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:51,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:51,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:51,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:51,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:51,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:51,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:51,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:51,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:51,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:51,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:51,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:52,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:52,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:52,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:52,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:52,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:52,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:52,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:52,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:52,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:52,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:52,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:52,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:52,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:52,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:52,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:52,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:53,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:04:53,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:53,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:53,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:53,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:53,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:53,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:53,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:53,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:53,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:53,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:53,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:53,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:53,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:53,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:53,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:53,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:54,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:54,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:54,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:54,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:54,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:54,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:54,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:54,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:54,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:54,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:54,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:54,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:54,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:54,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:54,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:54,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:54,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:54,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:54,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:54,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:54,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:54,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:54,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:54,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:54,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:55,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:55,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:55,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:55,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:04:55,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:04:55,254 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 03:04:55,489 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 03:04:55,557 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 03:04:56,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 03:04:57,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:05:03,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:05:03,738 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:05:05,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:05:05,190 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:05:11,074 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:05:13,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:13,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:13,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:13,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:13,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:13,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:13,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:13,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:13,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:13,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:13,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:13,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:13,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:13,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:13,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:13,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:15,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:05:19,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:05:19,011 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:05:19,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:05:23,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:05:23,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:23,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:23,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:23,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:23,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:23,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:23,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:23,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:23,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:23,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:23,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:23,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:23,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:23,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:23,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:23,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:27,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:05:31,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:05:34,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:05:34,239 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:05:35,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:05:35,258 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:05:37,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:05:41,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:05:43,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:43,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:43,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:43,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:43,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:43,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:44,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:44,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:44,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:44,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:44,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:44,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:44,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:44,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:44,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:44,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:45,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:05:46,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:46,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:46,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:46,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:46,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:46,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:46,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:46,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:46,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:46,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:46,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:46,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:46,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:46,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:46,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:46,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:47,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:05:49,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:05:49,468 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:05:51,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:05:53,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:05:55,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:55,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:55,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:55,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:55,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:55,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:55,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:55,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:55,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:55,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:55,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:55,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:55,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:55,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:55,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:55,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:55,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:05:56,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:56,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:56,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:56,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:56,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:56,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:56,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:56,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:56,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:56,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:56,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:56,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:56,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:56,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:56,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:56,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:56,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:56,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:56,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:56,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:56,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:56,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:56,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:56,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:56,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:56,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:56,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:56,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:56,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:56,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:56,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:56,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:57,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:57,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:57,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:57,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:57,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:57,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:57,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:57,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:57,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:57,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:57,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:57,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:57,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:57,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:57,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:57,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:05:59,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:06:00,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:00,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:00,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:00,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:00,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:00,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:00,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:00,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:00,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:00,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:00,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:00,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:00,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:00,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:00,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:00,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:02,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:06:04,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:06:04,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:06:04,733 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:06:05,327 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:06:06,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:06:10,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:06:11,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:11,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:11,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:11,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:11,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:11,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:11,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:11,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:11,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:11,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:11,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:11,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:11,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:11,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:11,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:11,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:11,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:11,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:11,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:11,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:11,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:11,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:11,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:11,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:11,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:11,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:11,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:11,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:11,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:11,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:11,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:11,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:12,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:06:13,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:13,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:14,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:06:16,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:06:18,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:06:19,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:19,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:20,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:06:20,026 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:06:20,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:06:20,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:20,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:20,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:20,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:20,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:20,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:20,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:20,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:20,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:20,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:20,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:20,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:20,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:20,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:20,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:20,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:20,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:20,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:20,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:20,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:20,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:20,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:20,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:20,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:20,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:20,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:20,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:20,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:20,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:20,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:20,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:20,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:21,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:21,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:21,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:21,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:21,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:21,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:21,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:21,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:21,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:21,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:21,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:21,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:21,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:21,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:21,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:21,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:21,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:21,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:21,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:21,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:21,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:21,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:21,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:21,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:21,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:21,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:21,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:21,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:21,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:21,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:21,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:21,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:22,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:06:23,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:23,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:23,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:23,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:23,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:23,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:23,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:23,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:23,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:23,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:23,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:23,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:23,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:23,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:23,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:23,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:24,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:06:24,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:24,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:24,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:24,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:24,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:24,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:24,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:24,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:24,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:24,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:24,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:24,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:24,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:24,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:24,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:24,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:25,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:25,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:25,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:25,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:25,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:25,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:25,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:25,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:25,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:25,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:25,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:25,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:25,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:25,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:25,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:25,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:26,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:06:28,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:06:29,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:29,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:29,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:29,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:29,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:29,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:29,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:29,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:29,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:29,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:29,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:29,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:29,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:29,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:29,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:29,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:29,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:29,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:29,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:29,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:29,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:29,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:29,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:29,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:29,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:29,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:29,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:29,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:29,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:29,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:29,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:29,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:30,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:06:30,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:30,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:30,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:30,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:30,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:30,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:30,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:30,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:30,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:30,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:30,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:30,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:30,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:30,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:30,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:30,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:30,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:30,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:30,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:30,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:30,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:30,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:30,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:30,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:30,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:30,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:30,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:30,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:30,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:30,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:30,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:30,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:32,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:06:32,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:32,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:32,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:32,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:32,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:32,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:32,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:32,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:32,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:32,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:32,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:32,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:32,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:32,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:32,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:32,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:32,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:32,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:32,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:32,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:32,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:32,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:32,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:32,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:32,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:32,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:32,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:32,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:32,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:32,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:32,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:32,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:34,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:34,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:34,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:34,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:34,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:34,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:34,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:34,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:34,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:34,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:34,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:34,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:34,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:34,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:34,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:34,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:34,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:06:35,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:06:35,290 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:06:35,513 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:06:35,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:35,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:35,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:35,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:35,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:35,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:35,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:35,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:35,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:35,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:35,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:35,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:35,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:35,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:35,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:35,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:36,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:06:36,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:36,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:36,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:36,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:36,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:36,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:36,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:36,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:36,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:36,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:36,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:36,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:36,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:36,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:36,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:36,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:37,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:37,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:37,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:37,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:37,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:37,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:37,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:37,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:37,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:37,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:37,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:37,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:37,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:37,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:37,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:37,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:38,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:06:40,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:06:40,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:40,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:40,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:40,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:40,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:40,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:40,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:40,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:40,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:40,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:40,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:40,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:40,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:40,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:40,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:40,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:42,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:06:42,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:42,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:42,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:42,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:42,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:42,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:42,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:42,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:42,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:42,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:42,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:42,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:42,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:42,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:42,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:42,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:44,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:06:45,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:45,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:45,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:45,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:45,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:45,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:45,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:45,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:45,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:45,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:45,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:45,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:45,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:45,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:45,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:45,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:46,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:06:47,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:47,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:47,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:47,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:47,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:47,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:47,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:47,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:47,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:47,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:47,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:47,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:47,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:47,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:47,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:47,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:48,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:06:50,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:06:50,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:06:50,560 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:06:51,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:51,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:51,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:51,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:51,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:51,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:51,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:51,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:51,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:51,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:51,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:51,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:51,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:51,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:51,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:51,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:51,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:51,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:51,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:51,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:51,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:51,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:51,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:51,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:51,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:51,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:51,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:51,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:51,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:51,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:51,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:51,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:06:52,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:52,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:53,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:53,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:53,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:53,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:53,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:53,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:53,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:53,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:53,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:53,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:53,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:53,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:53,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:53,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:53,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:53,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:54,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:06:55,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:55,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:06:56,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:06:58,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:07:00,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:00,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:00,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:00,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:00,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:00,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:00,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:00,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:00,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:00,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:00,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:00,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:00,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:00,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:00,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:00,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:05,469 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:07:05,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:07:05,785 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:07:06,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:07:08,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:08,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:08,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:08,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:08,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:08,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:08,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:08,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:08,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:08,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:08,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:08,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:08,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:08,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:08,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:08,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:12,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:07:16,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:07:17,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:17,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:17,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:17,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:17,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:17,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:17,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:17,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:17,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:17,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:17,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:17,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:17,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:17,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:17,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:17,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:20,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:07:21,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:07:21,011 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:07:24,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:07:26,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:07:30,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:07:33,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:33,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:33,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:33,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:33,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:33,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:33,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:33,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:33,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:33,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:33,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:33,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:33,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:33,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:33,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:33,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:34,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:07:35,546 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:07:36,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:07:36,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:07:36,236 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:07:40,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:07:42,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:07:46,140 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:07:48,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:07:50,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:50,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:50,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:50,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:50,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:50,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:50,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:50,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:50,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:50,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:50,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:50,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:50,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:50,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:50,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:50,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:50,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:50,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:50,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:50,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:50,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:50,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:50,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:50,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:50,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:50,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:50,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:50,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:50,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:50,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:50,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:50,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:51,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:07:51,488 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:07:52,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:07:54,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:07:56,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:07:57,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:57,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:57,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:57,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:57,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:57,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:57,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:57,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:57,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:57,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:57,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:57,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:57,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:57,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:57,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:57,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:57,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:57,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:57,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:57,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:57,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:57,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:57,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:57,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:57,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:57,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:57,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:57,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:57,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:57,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:57,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:57,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:07:58,145 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:08:00,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:00,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:00,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:00,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:00,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:00,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:00,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:00,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:00,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:00,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:00,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:00,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:00,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:00,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:00,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:00,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:00,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:00,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:00,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:00,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:00,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:00,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:00,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:00,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:00,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:00,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:00,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:00,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:00,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:00,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:00,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:00,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:02,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:08:04,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:08:04,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:04,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:04,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:04,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:04,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:04,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:04,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:04,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:04,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:04,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:04,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:04,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:04,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:04,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:04,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:04,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:05,621 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:08:06,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:08:06,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:08:06,706 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:08:08,150 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:08:10,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:08:13,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:13,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:13,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:13,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:13,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:13,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:13,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:13,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:13,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:13,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:13,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:13,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:13,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:13,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:13,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:13,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:14,152 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:08:14,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:14,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:14,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:14,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:14,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:14,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:14,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:14,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:14,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:14,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:14,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:14,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:14,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:14,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:14,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:14,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:15,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:15,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:15,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:15,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:15,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:15,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:15,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:15,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:15,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:15,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:15,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:15,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:15,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:15,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:15,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:15,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:17,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:17,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:17,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:17,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:17,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:17,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:17,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:17,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:17,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:17,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:17,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:17,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:17,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:17,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:17,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:17,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:17,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:08:17,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:17,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:17,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:17,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:17,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:17,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:17,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:17,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:17,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:17,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:17,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:17,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:17,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:17,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:17,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:17,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:18,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:18,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:18,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:18,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:18,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:18,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:18,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:18,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:18,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:18,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:18,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:18,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:18,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:18,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:18,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:18,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:19,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:08:19,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:19,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:19,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:19,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:19,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:19,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:19,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:19,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:19,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:19,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:19,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:19,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:19,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:19,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:19,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:19,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:20,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:20,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:20,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:20,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:20,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:20,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:20,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:20,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:20,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:20,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:20,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:20,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:20,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:20,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:20,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:20,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:20,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:20,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:20,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:20,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:20,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:20,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:20,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:20,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:20,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:20,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:20,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:20,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:20,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:20,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:20,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:20,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:21,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:21,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:21,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:21,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:21,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:21,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:21,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:21,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:21,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:21,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:21,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:21,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:21,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:21,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:21,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:21,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:21,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:08:21,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:21,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:21,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:21,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:21,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:21,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:21,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:21,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:21,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:21,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:21,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:21,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:21,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:21,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:21,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:21,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:21,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:08:21,941 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:08:22,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:22,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:22,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:22,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:22,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:22,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:22,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:22,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:22,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:22,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:22,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:22,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:22,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:22,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:22,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:22,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:23,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:23,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:23,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:23,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:23,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:23,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:23,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:23,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:23,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:23,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:23,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:23,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:23,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:23,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:23,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:23,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:23,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:08:23,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:23,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:23,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:23,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:23,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:23,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:23,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:23,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:23,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:23,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:23,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:23,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:23,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:23,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:23,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:23,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:25,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:08:26,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:26,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:26,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:26,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:26,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:26,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:26,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:26,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:26,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:26,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:26,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:26,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:26,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:26,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:26,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:26,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:27,157 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:08:29,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:08:29,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:29,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:29,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:29,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:29,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:29,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:29,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:29,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:29,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:29,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:29,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:29,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:29,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:29,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:29,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:29,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:29,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:29,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:29,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:29,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:29,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:29,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:29,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:29,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:29,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:29,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:29,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:29,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:29,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:29,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:29,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:29,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:30,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:30,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:30,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:30,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:30,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:30,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:30,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:30,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:30,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:30,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:30,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:30,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:30,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:30,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:30,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:30,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:31,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:31,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:31,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:31,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:31,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:31,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:31,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:31,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:31,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:31,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:31,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:31,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:31,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:31,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:31,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:31,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:31,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:31,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:31,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:31,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:31,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:31,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:31,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:31,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:31,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:31,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:31,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:31,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:31,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:31,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:31,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:31,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:31,159 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:08:33,159 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:08:34,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:34,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:34,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:34,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:34,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:34,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:34,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:34,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:34,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:34,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:34,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:34,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:34,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:34,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:34,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:34,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:34,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:34,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:34,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:34,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:34,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:34,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:34,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:34,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:34,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:34,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:34,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:34,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:34,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:34,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:34,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:34,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:35,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:35,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:35,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:35,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:35,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:35,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:35,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:35,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:35,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:35,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:35,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:35,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:35,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:35,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:35,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:35,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:35,160 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:08:35,695 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:08:35,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:35,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:35,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:35,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:35,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:35,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:35,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:35,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:35,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:35,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:35,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:35,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:35,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:35,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:35,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:35,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:37,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:37,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:37,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:37,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:37,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:37,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:37,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:37,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:37,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:37,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:37,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:37,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:37,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:37,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:37,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:37,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:37,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:08:37,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:08:37,181 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:08:39,162 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:08:39,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:39,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:39,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:39,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:39,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:39,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:39,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:39,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:39,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:39,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:39,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:39,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:39,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:39,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:39,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:39,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:41,162 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:08:43,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:43,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:43,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:43,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:43,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:43,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:43,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:43,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:43,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:43,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:43,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:43,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:43,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:43,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:43,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:43,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:43,163 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:08:44,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:44,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:44,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:44,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:44,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:44,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:44,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:44,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:44,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:44,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:44,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:44,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:44,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:44,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:44,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:44,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:45,164 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:08:45,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:45,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:45,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:45,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:45,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:45,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:45,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:45,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:45,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:45,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:45,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:45,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:45,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:45,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:45,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:45,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:47,164 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:08:48,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:48,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:48,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:48,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:48,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:48,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:48,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:48,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:48,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:48,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:48,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:48,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:48,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:48,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:48,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:48,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:48,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:48,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:48,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:48,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:48,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:48,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:48,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:48,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:48,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:48,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:48,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:48,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:48,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:48,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:48,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:48,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:49,165 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:08:49,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:49,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:49,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:49,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:49,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:49,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:49,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:49,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:49,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:49,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:49,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:49,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:49,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:49,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:49,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:49,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:08:51,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:51,725 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 03:08:51,952 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 03:08:52,027 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 03:08:52,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 03:08:52,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:08:52,425 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:08:53,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:08:54,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:08:55,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:55,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:55,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:55,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:55,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:55,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:55,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:55,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:55,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:55,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:55,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:55,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:55,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:55,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:55,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:08:55,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:03,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:09:03,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:03,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:03,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:03,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:03,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:03,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:03,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:03,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:04,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:04,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:04,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:04,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:04,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:04,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:04,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:04,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:05,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:05,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:05,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:05,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:05,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:05,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:05,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:05,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:05,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:05,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:05,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:05,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:05,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:05,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:05,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:05,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:06,064 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:09:07,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:09:07,761 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:09:08,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:08,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:08,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:08,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:08,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:08,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:08,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:08,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:08,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:08,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:08,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:08,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:08,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:08,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:08,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:08,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:09,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:09:13,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:09:14,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:14,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:14,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:14,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:14,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:14,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:14,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:14,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:14,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:14,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:14,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:14,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:14,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:14,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:14,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:14,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:17,176 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:09:21,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:09:22,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:22,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:22,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:22,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:22,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:22,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:22,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:22,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:22,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:22,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:22,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:22,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:22,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:22,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:22,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:22,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:23,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:09:23,035 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:09:25,179 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:09:27,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:09:31,182 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:09:33,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:09:36,139 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:09:36,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:36,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:36,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:36,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:36,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:36,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:36,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:36,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:36,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:36,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:36,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:36,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:36,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:36,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:36,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:36,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:37,184 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:09:38,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:09:38,260 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:09:39,185 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:09:43,186 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:09:47,188 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:09:49,189 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:09:51,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:09:51,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:51,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:51,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:51,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:51,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:51,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:51,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:51,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:51,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:51,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:51,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:51,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:51,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:51,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:51,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:51,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:53,191 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:09:53,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:09:53,508 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:09:54,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:54,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:54,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:54,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:54,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:54,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:54,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:54,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:54,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:54,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:54,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:54,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:54,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:54,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:54,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:54,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:57,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:57,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:57,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:57,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:57,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:57,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:57,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:57,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:57,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:57,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:57,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:57,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:57,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:57,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:57,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:57,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:09:57,192 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:09:59,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:10:00,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:00,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:00,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:00,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:00,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:00,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:00,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:00,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:00,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:00,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:00,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:00,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:00,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:00,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:00,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:00,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:01,194 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:10:01,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:01,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:01,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:01,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:01,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:01,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:01,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:01,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:01,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:01,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:01,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:01,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:01,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:01,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:01,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:01,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:02,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:02,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:02,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:02,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:02,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:02,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:02,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:02,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:02,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:02,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:02,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:02,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:02,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:02,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:02,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:02,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:03,195 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:10:05,196 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:10:06,216 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:10:07,197 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:10:08,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:10:08,800 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:10:09,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:10:10,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:10,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:10,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:10,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:10,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:10,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:10,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:10,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:10,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:10,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:10,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:10,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:10,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:10,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:10,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:10,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:11,199 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:10:13,200 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:10:14,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:14,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:14,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:14,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:14,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:14,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:14,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:14,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:14,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:14,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:14,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:14,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:14,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:14,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:14,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:14,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:15,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:15,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:15,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:15,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:15,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:15,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:15,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:15,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:15,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:15,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:15,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:15,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:15,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:15,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:15,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:15,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:10:15,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:17,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:17,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:17,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:17,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:17,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:17,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:17,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:17,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:17,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:17,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:17,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:17,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:17,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:17,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:17,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:17,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:17,202 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:10:17,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:17,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:17,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:17,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:17,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:17,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:17,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:17,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:17,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:17,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:17,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:17,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:17,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:17,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:17,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:17,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:18,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:18,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:18,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:18,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:18,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:18,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:18,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:18,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:18,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:18,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:18,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:18,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:18,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:18,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:18,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:18,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:18,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:18,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:18,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:18,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:18,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:18,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:18,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:18,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:18,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:18,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:18,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:18,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:18,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:18,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:18,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:18,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:19,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:19,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:19,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:19,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:19,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:19,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:19,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:19,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:19,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:19,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:19,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:19,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:19,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:19,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:19,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:19,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:19,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:19,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:19,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:19,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:19,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:19,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:19,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:19,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:19,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:19,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:19,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:19,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:19,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:19,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:19,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:19,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:19,203 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:10:21,203 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:10:21,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:21,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:23,204 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:10:24,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:10:24,074 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:10:24,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:24,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:24,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:24,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:24,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:24,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:24,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:24,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:24,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:24,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:24,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:24,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:24,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:24,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:24,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:24,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:24,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:24,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:24,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:24,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:24,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:24,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:24,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:24,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:24,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:24,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:24,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:24,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:24,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:24,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:24,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:24,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:26,205 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:10:27,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:27,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:27,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:27,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:27,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:27,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:27,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:27,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:27,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:27,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:27,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:27,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:27,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:27,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:27,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:27,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:28,206 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:10:29,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:29,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:30,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:10:30,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:30,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:30,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:30,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:30,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:30,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:30,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:30,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:30,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:30,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:30,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:30,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:30,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:30,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:30,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:30,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,209 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:10:32,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:32,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:33,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:33,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:33,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:33,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:33,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:33,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:33,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:33,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:33,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:33,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:33,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:33,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:33,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:33,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:33,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:33,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:33,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:33,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:33,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:33,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:33,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:33,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:33,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:33,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:33,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:33,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:33,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:33,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:33,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:33,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:33,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:33,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:34,210 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:10:36,211 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:10:36,293 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:10:38,212 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:10:39,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:39,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:39,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:39,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:39,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:39,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:39,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:39,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:39,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:39,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:39,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:39,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:39,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:39,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:39,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:39,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:39,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:10:39,412 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:10:40,213 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:10:40,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:40,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:40,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:40,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:40,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:40,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:40,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:40,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:40,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:40,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:40,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:40,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:40,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:40,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:40,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:40,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:42,213 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:10:42,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:42,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:42,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:42,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:42,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:42,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:42,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:42,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:42,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:42,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:42,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:42,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:42,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:42,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:42,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:42,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:44,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:10:44,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:44,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:44,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:44,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:44,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:44,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:44,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:44,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:44,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:44,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:44,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:44,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:44,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:44,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:44,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:44,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:45,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:45,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:45,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:45,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:45,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:45,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:45,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:45,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:45,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:45,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:45,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:45,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:45,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:45,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:45,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:45,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:45,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:45,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:45,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:45,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:45,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:45,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:45,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:45,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:45,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:45,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:45,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:45,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:45,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:45,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:45,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:45,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:46,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:46,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:46,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:46,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:46,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:46,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:46,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:46,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:46,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:46,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:46,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:46,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:46,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:46,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:46,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:46,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:46,216 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:10:46,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:46,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:46,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:46,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:46,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:46,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:46,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:46,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:46,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:46,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:46,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:46,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:48,217 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:10:54,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:10:54,638 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:10:54,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:54,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:54,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:54,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:54,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:54,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:54,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:54,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:54,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:54,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:54,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:54,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:54,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:54,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:54,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:54,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:56,220 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:10:57,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:57,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:57,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:57,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:57,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:57,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:57,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:57,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:57,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:57,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:57,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:57,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:57,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:57,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:57,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:57,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:59,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:59,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:59,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:59,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:59,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:59,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:59,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:59,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:59,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:59,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:59,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:59,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:59,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:59,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:59,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:10:59,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:02,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:11:03,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:03,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:03,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:03,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:03,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:03,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:03,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:03,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:03,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:03,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:03,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:03,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:03,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:03,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:03,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:03,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:05,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:05,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:05,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:05,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:05,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:05,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:05,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:05,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:05,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:05,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:05,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:05,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:05,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:05,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:05,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:05,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:06,224 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:11:06,369 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:11:07,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:07,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:07,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:07,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:07,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:07,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:07,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:07,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:08,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:08,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:08,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:08,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:08,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:08,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:08,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:08,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:09,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:11:09,868 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:11:10,226 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:11:14,228 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:11:15,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:15,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:15,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:15,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:15,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:15,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:15,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:15,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:15,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:15,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:15,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:15,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:15,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:15,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:15,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:15,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:18,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:11:20,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:11:20,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:20,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:20,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:20,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:20,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:20,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:20,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:20,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:21,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:21,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:21,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:21,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:21,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:21,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:21,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:21,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:24,232 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:11:25,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:11:25,102 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:11:28,234 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:11:30,234 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:11:34,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:11:35,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:35,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:35,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:35,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:35,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:35,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:35,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:35,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:35,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:35,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:35,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:35,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:35,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:35,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:35,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:35,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:36,237 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:11:36,444 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:11:40,239 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:11:40,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:11:40,321 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:11:42,240 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:11:46,241 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:11:48,242 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:11:49,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:49,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:49,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:49,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:49,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:49,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:49,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:49,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:49,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:49,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:49,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:49,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:49,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:49,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:49,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:49,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:50,243 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:11:52,244 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:11:52,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:52,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:52,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:52,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:52,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:52,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:52,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:52,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:52,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:52,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:52,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:52,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:52,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:52,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:52,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:52,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:54,244 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:11:55,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:11:55,541 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:11:57,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:57,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:57,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:57,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:57,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:57,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:57,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:57,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:57,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:57,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:57,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:57,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:57,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:57,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:57,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:57,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:58,246 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:11:59,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:59,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:59,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:59,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:59,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:59,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:59,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:59,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:59,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:59,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:59,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:59,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:59,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:59,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:59,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:59,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:59,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:59,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:59,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:59,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:59,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:59,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:59,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:59,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:59,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:59,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:59,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:59,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:59,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:59,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:59,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:11:59,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:00,247 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:12:02,247 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:12:02,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:02,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:02,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:02,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:02,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:02,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:02,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:02,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:02,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:02,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:02,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:02,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:02,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:02,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:02,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:02,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:04,248 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:12:06,249 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:12:06,520 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:12:09,250 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:12:10,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:10,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:10,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:10,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:10,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:10,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:10,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:10,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:10,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:10,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:10,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:10,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:10,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:10,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:10,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:10,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:10,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:12:10,783 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:12:11,251 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:12:11,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:11,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:11,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:11,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:11,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:11,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:11,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:11,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:11,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:11,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:11,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:11,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:11,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:11,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:11,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:11,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:11,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:11,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:11,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:11,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:11,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:11,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:11,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:11,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:11,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:11,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:11,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:11,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:11,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:11,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:11,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:11,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:13,252 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:12:15,253 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:12:16,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:16,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:17,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:17,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:17,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:17,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:17,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:17,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:17,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:17,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:17,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:17,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:17,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:17,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:17,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:17,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:17,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:17,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:17,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:17,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:17,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:17,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:17,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:17,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:17,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:17,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:17,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:17,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:17,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:17,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:17,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:17,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:17,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:17,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:17,254 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:12:18,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:18,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:18,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:18,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:18,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:18,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:18,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:18,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:18,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:18,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:18,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:18,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:18,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:18,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:18,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:18,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:19,255 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:12:20,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:20,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:20,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:20,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:20,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:20,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:20,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:20,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:20,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:20,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:20,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:20,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:20,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:20,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:20,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:20,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:12:21,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:21,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:22,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:22,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:22,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:22,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:22,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:22,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:22,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:22,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:22,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:22,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:22,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:22,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:22,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:22,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:22,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:22,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:23,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:23,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:23,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:23,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:23,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:23,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:23,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:23,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:23,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:23,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:23,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:23,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:23,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:23,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:23,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:23,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:23,257 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:12:25,258 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:12:25,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:25,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:25,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:25,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:25,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:25,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:25,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:25,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:25,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:25,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:25,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:25,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:25,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:25,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:25,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:25,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:26,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:12:26,069 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:12:26,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:26,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:26,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:26,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:26,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:26,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:26,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:26,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:26,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:26,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:26,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:26,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:26,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:26,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:26,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:26,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:27,259 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:12:29,260 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:12:29,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:29,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:29,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:29,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:29,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:29,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:29,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:29,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:29,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:29,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:29,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:29,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:29,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:29,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:29,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:29,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:29,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:29,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:29,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:29,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:29,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:29,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:29,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:29,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:29,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:29,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:29,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:29,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:29,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:29,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:29,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:29,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:30,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:31,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:31,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:31,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:31,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:31,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:31,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:31,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:31,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:31,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:31,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:31,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:31,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:31,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:31,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:31,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:31,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:31,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:31,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:31,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:31,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:31,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:31,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:31,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:31,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:31,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:31,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:31,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:31,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:31,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:31,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:31,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:31,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:31,261 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:12:33,262 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:12:33,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:33,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:33,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:33,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:33,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:33,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:33,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:33,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:33,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:33,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:33,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:33,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:33,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:33,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:33,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:33,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:35,263 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:12:36,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:36,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:36,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:36,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:36,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:36,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:36,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:36,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:36,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:36,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:36,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:36,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:36,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:36,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:36,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:36,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:36,592 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:12:37,264 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:12:39,265 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:12:39,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:39,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:39,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:39,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:39,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:39,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:39,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:39,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:39,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:39,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:39,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:39,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:39,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:39,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:39,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:39,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:39,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:39,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:39,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:39,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:39,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:39,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:39,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:39,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:39,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:39,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:39,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:39,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:39,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:39,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:39,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:39,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:41,266 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:12:41,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:12:41,319 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:12:42,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:42,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:42,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:42,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:42,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:42,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:42,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:42,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:42,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:42,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:42,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:42,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:42,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:42,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:42,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:42,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:42,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:42,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:42,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:42,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:42,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:42,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:42,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:42,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:42,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:42,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:42,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:42,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:42,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:12:42,427 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 03:12:42,579 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 03:12:42,659 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 03:12:43,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 03:12:43,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:12:45,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:12:47,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:12:49,270 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:12:51,271 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:12:53,272 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:12:55,273 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:12:56,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:12:56,726 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:12:57,273 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:12:59,274 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:13:01,275 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:13:03,276 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:13:05,277 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:13:06,723 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:13:07,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:13:09,279 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:13:11,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:13:11,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:13:11,971 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:13:13,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:13:15,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:13:17,283 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:13:19,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:13:21,285 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:13:23,285 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:13:25,286 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:13:27,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:13:27,197 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:13:27,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:13:29,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:13:31,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:13:33,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:13:35,290 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:13:36,785 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:13:37,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:13:40,292 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:13:42,293 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:13:42,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:13:42,483 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:13:44,293 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:13:46,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:13:48,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:13:50,296 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:13:52,297 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:13:54,297 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:13:56,298 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:13:57,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:13:57,828 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:13:58,299 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:14:00,300 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:14:02,301 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:14:04,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:14:06,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:14:06,857 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:14:08,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:14:10,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:14:12,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:14:13,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:14:13,093 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:14:14,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:14:16,306 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:14:18,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:14:20,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:14:22,308 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:14:24,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:14:26,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:14:28,310 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:14:28,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:14:28,359 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:14:30,311 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:14:32,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:14:34,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:14:36,314 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:14:36,932 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:14:38,314 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:14:40,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:14:42,316 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:14:43,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:14:43,681 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:14:44,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:14:46,318 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:14:48,319 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:14:50,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:14:52,321 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:14:54,322 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:14:56,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:14:58,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:14:58,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:14:58,971 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:15:00,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:15:02,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:15:04,326 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:15:06,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:15:06,994 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:15:08,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:15:10,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:15:12,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:15:14,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:15:14,200 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:15:14,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:15:16,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:15:18,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:15:21,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:15:23,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:15:25,335 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:15:27,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:15:29,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:15:29,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:15:29,426 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:15:31,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:15:33,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:15:35,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:15:37,050 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:15:37,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:15:39,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:15:41,342 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:15:43,342 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:15:44,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:15:44,689 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:15:45,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:15:47,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:15:49,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:15:51,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:15:53,346 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:15:55,346 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:15:57,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:15:59,348 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:15:59,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:15:59,913 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:16:01,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:16:03,350 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:16:05,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:16:07,113 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:16:07,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:16:09,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:16:11,354 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:16:13,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:16:15,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:16:15,216 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:16:15,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:16:17,356 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:16:19,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:16:21,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:16:23,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:16:25,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:16:27,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:16:29,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:16:30,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:16:30,477 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:16:31,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:16:33,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:16:35,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:16:37,168 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:16:37,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:16:39,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:16:41,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:16:43,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:16:45,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:16:46,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:16:46,218 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:16:47,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:16:50,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:16:52,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:16:54,371 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:16:56,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:16:58,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:17:00,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:17:01,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:17:01,450 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:17:02,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:17:04,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:17:06,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:17:07,227 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:17:08,376 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:17:10,376 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:17:12,377 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:17:14,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:17:16,379 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:17:16,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:17:16,783 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:17:18,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:17:20,381 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:17:22,382 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:17:24,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:17:26,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:17:28,384 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:17:30,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:17:32,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:17:32,017 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:17:32,386 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:17:34,386 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:17:36,387 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:17:37,303 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:17:38,388 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:17:40,388 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:17:42,389 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:17:44,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:17:46,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:17:47,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:17:47,238 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:17:48,391 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:17:50,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:17:52,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:17:54,393 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:17:56,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:17:58,395 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:18:00,395 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:18:02,396 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:18:02,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:18:02,596 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:18:04,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:18:06,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:18:07,378 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:18:08,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:18:10,399 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:18:12,399 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:18:14,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:18:17,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:18:17,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:18:17,830 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:18:19,402 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:18:21,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:18:23,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:18:25,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:18:27,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:18:29,406 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:18:31,407 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:18:33,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:18:33,132 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:18:33,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:18:35,409 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:18:37,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:18:37,452 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:18:39,411 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:18:41,412 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:18:43,412 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:18:45,413 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:18:47,414 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:18:48,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:18:48,355 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:18:49,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:18:51,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:18:53,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:18:55,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:18:57,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:18:59,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:19:01,419 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:19:03,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:19:03,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:19:03,666 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:19:05,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:19:07,421 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:19:07,525 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:19:09,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:19:11,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:19:13,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:19:15,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:19:17,425 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:19:18,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:19:18,940 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:19:19,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:19:21,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:19:23,427 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:19:25,428 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:19:27,429 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:19:29,430 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:19:31,431 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:19:33,431 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:19:34,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:19:34,156 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:19:35,432 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:19:37,433 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:19:37,602 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:19:39,434 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:19:41,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:19:43,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:19:45,436 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:19:47,437 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:19:49,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:19:49,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:19:49,456 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:19:51,439 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:19:53,441 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:19:55,442 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:19:58,443 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:20:00,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:20:02,445 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:20:04,446 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:20:04,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:20:04,867 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:20:06,447 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:20:07,676 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:20:08,447 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:20:10,448 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:20:12,449 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:20:14,449 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:20:16,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:20:18,451 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:20:20,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:20:20,131 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:20:20,452 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:20:22,452 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:20:24,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:20:26,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:20:28,455 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:20:30,456 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:20:32,456 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:20:34,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:20:35,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:20:35,528 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:20:36,458 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:20:37,752 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:20:38,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:20:40,460 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:20:42,461 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:20:44,461 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:20:46,462 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:20:48,463 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:20:50,465 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:20:50,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:20:50,749 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:20:52,465 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:20:54,466 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:20:56,467 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:20:58,468 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:21:00,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:21:02,470 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:21:04,471 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:21:05,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:21:05,968 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:21:06,472 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:21:07,825 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:21:08,472 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:21:10,473 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:21:12,474 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:21:14,475 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:21:16,476 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:21:18,477 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:21:20,478 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:21:21,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:21:21,264 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:21:22,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:21:24,480 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:21:26,481 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:21:29,482 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:21:31,483 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:21:33,484 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:21:35,485 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:21:36,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:21:36,623 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:21:37,486 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:21:37,900 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:21:39,487 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:21:41,488 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:21:43,489 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:21:45,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:21:47,491 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:21:49,492 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:21:51,493 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:21:51,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:21:51,842 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:21:53,494 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:21:55,495 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:21:57,496 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:21:59,497 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:22:01,498 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:22:03,499 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:22:05,500 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:22:07,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:22:07,211 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:22:07,500 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:22:07,975 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:22:09,501 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:22:11,502 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:22:13,503 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:22:15,504 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:22:17,505 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:22:19,506 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:22:21,507 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:22:22,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:22:22,528 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:22:23,508 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:22:25,509 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:22:27,510 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:22:29,511 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:22:31,512 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:22:33,513 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:22:35,514 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:22:37,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:22:37,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:22:37,828 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:22:38,051 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:22:39,516 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:22:41,517 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:22:43,517 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:22:45,518 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:22:47,519 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:22:49,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:22:51,521 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:22:53,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:22:53,050 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:22:54,522 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:22:56,523 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:22:58,524 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:23:00,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:23:02,526 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:23:04,527 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:23:06,528 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:23:08,125 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:23:08,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:23:08,392 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:23:08,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:23:10,530 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:23:12,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:23:14,532 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:23:16,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:23:18,534 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:23:20,535 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:23:22,536 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:23:23,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:23:23,833 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:23:24,537 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:23:26,538 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:23:28,538 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:23:30,539 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:23:32,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:23:34,541 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:23:36,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:23:38,196 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:23:38,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:23:39,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:23:39,146 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:23:40,543 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:23:42,544 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:23:44,545 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:23:46,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:23:48,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:23:50,547 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:23:52,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:23:54,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:23:54,370 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:23:54,549 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:23:56,550 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:23:58,550 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:24:00,551 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:24:02,552 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:24:04,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:24:06,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:24:08,271 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:24:08,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:24:09,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:24:09,693 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:24:10,555 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:24:12,555 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:24:14,556 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:24:16,557 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:24:18,557 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:24:20,558 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:24:22,559 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:24:24,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:24:24,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:24:24,917 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:24:26,561 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:24:28,561 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:24:30,562 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:24:32,563 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:24:35,564 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:24:37,564 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:24:38,346 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:24:39,565 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:24:40,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:24:40,142 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:24:41,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:24:43,567 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:24:45,567 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:24:47,569 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:24:49,569 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:24:51,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:24:53,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:24:55,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:24:55,475 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:24:55,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:24:57,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:24:59,574 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:25:01,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:25:03,576 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:25:05,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:25:07,578 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:25:08,421 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:25:09,579 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:25:10,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:25:10,750 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:25:11,580 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:25:13,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:25:15,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:25:17,583 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:25:19,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:25:21,585 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:25:23,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:25:25,587 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:25:26,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:25:26,088 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:25:27,588 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:25:29,588 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:25:31,589 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:25:33,590 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:25:35,591 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:25:37,592 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:25:38,495 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:25:39,593 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:25:41,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:25:41,351 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:25:41,594 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:25:43,595 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:25:45,596 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:25:47,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:25:49,598 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:25:51,599 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:25:54,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:25:56,601 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:25:56,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:25:56,618 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:25:58,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:26:00,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:26:02,603 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:26:04,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:26:06,605 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:26:08,571 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:26:08,606 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:26:10,607 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:26:11,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:26:11,853 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:26:12,608 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:26:14,609 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:26:16,610 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:26:18,610 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:26:20,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:26:22,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:26:24,613 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:26:26,614 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:26:27,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:26:27,140 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:26:28,614 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:26:30,615 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:26:32,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:26:34,617 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:26:36,617 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:26:38,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:26:38,646 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:26:40,619 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:26:42,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:26:42,593 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:26:42,619 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:26:44,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:26:46,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:26:48,621 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:26:50,622 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:26:52,623 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:26:54,623 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:26:56,624 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:26:57,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:26:57,964 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:26:58,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:27:00,626 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:27:02,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:27:04,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:27:06,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:27:08,629 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:27:08,718 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:27:10,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:27:12,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:27:13,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:27:13,396 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:27:14,631 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:27:16,632 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:27:18,632 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:27:20,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:27:22,634 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:27:25,635 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:27:27,636 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:27:28,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:27:28,639 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:27:29,636 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:27:31,637 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:27:33,638 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:27:35,639 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:27:37,640 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:27:38,793 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:27:39,641 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:27:41,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:27:43,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:27:43,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:27:43,968 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:27:45,643 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:27:47,644 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:27:49,645 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:27:51,645 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:27:53,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:27:55,648 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:27:57,649 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:27:59,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:27:59,345 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:27:59,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:28:01,651 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:28:03,651 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:28:05,652 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:28:07,653 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:28:08,867 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:28:09,654 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:28:11,655 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:28:13,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:28:14,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:28:14,676 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:28:15,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:28:17,657 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:28:19,658 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:28:21,659 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:28:23,659 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:28:25,660 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:28:27,661 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:28:29,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:28:30,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:28:30,049 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:28:31,663 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:28:33,664 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:28:35,665 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:28:37,665 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:28:38,944 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:28:39,666 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:28:41,667 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:28:43,668 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:28:45,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:28:45,421 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:28:45,668 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:28:47,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:28:49,670 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:28:51,671 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:28:53,672 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:28:55,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:28:57,674 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:28:59,675 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:29:00,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:29:00,827 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:29:01,676 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:29:03,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:29:05,678 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:29:07,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:29:09,019 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:29:09,680 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:29:11,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:29:13,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:29:15,682 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:29:16,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:29:16,103 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:29:17,683 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:29:19,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:29:22,685 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:29:24,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:29:26,687 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:29:28,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:29:30,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:29:31,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:29:31,426 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:29:32,690 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:29:34,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:29:36,692 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:29:38,693 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:29:39,092 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:29:40,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:29:42,695 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:29:44,696 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:29:46,697 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:29:46,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:29:46,736 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:29:48,698 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:29:50,698 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:29:52,699 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:29:54,701 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:29:56,701 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:29:58,702 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:30:00,703 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:30:01,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:30:01,959 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:30:02,704 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:30:04,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:30:06,706 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:30:08,707 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:30:09,165 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:30:10,708 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:30:12,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:30:14,710 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:30:16,711 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:30:17,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:30:17,394 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:30:18,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:30:20,713 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:30:22,714 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:30:24,715 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:30:26,716 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:30:28,716 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:30:30,717 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:30:32,718 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:30:32,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:30:32,724 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:30:34,719 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:30:36,720 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:30:38,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:30:39,241 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:30:40,722 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:30:42,723 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:30:45,724 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:30:47,725 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:30:47,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:30:47,951 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:30:49,726 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:30:51,727 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:30:53,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:30:55,729 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:30:57,730 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:30:59,731 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:31:01,732 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:31:03,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:31:03,174 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:31:03,733 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:31:05,734 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:31:07,734 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:31:09,318 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:31:09,735 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:31:11,736 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:31:13,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:31:15,738 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:31:17,739 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:31:18,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:31:18,430 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:31:19,740 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:31:21,741 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:31:23,742 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:31:25,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:31:27,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:31:29,744 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:31:31,745 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:31:33,746 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:31:33,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:31:33,829 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:31:35,747 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:31:37,748 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:31:39,394 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:31:39,749 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:31:41,750 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:31:43,751 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:31:45,752 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:31:47,753 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:31:49,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:31:49,131 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:31:49,754 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:31:51,755 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:31:53,756 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:31:55,756 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:31:57,757 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:31:59,758 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:32:02,759 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:32:04,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:32:04,380 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:32:04,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:32:06,761 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:32:08,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:32:09,469 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:32:10,763 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:32:12,764 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:32:14,765 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:32:16,766 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:32:18,767 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:32:19,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:32:19,646 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:32:20,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:32:22,769 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:32:24,770 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:32:26,771 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:32:28,772 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:32:30,772 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:32:32,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:32:34,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:32:34,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:32:34,919 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:32:36,775 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:32:38,776 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:32:39,542 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:32:40,777 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:32:42,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:32:44,779 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:32:46,780 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:32:48,781 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:32:50,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:32:50,142 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:32:50,782 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:32:52,782 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:32:54,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:32:56,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:32:58,785 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:33:00,786 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:33:02,787 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:33:04,788 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:33:05,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:33:05,503 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:33:06,789 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:33:08,790 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:33:09,621 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:33:10,791 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:33:12,792 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:33:14,792 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:33:16,793 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:33:18,794 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:33:20,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:33:20,779 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:33:20,795 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:33:23,796 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:33:25,797 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:33:27,798 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:33:29,799 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:33:31,800 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:33:33,801 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:33:35,802 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:33:36,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:33:36,075 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:33:37,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:33:39,697 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:33:39,804 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:33:41,805 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:33:43,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:33:45,807 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:33:47,808 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:33:49,809 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:33:51,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:33:51,355 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:33:51,810 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:33:53,811 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:33:55,811 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:33:57,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:33:59,813 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:34:01,814 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:34:03,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:34:05,816 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:34:06,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:34:06,576 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:34:07,817 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:34:09,770 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:34:09,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:34:11,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:34:13,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:34:15,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:34:17,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:34:19,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:34:21,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:34:21,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:34:21,926 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:34:23,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:34:25,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:34:27,826 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:34:29,826 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:34:31,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:34:33,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:34:35,829 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:34:37,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:34:37,162 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:34:37,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:34:39,831 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:34:39,845 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:34:41,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:34:43,833 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:34:45,834 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:34:47,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:34:49,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:34:51,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:34:52,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:34:52,433 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:34:54,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:34:56,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:34:58,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:35:00,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:35:02,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:35:04,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:35:06,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:35:07,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:35:07,648 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:35:08,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:35:09,921 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:35:10,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:35:12,846 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:35:14,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:35:16,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:35:18,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:35:20,849 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:35:22,850 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:35:23,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:35:23,000 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:35:24,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:35:26,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:35:28,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:35:30,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:35:32,854 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:35:34,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:35:36,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:35:38,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:35:38,315 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:35:38,856 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:35:39,998 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:35:40,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:35:42,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:35:44,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:35:46,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:35:48,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:35:50,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:35:52,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:35:53,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:35:53,640 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:35:54,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:35:56,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:35:58,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:36:00,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:36:02,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:36:04,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:36:06,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:36:08,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:36:08,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:36:08,874 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:36:10,074 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:36:10,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:36:12,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:36:14,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:36:16,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:36:18,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:36:20,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:36:22,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:36:24,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:36:24,124 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:36:24,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:36:26,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:36:28,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:36:30,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:36:32,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:36:34,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:36:36,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:36:38,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:36:39,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:36:39,420 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:36:40,150 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:36:40,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:36:42,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:36:44,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:36:46,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:36:48,882 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:36:51,883 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:36:53,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:36:54,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:36:54,659 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:36:55,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:36:57,885 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:36:59,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:37:01,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:37:03,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:37:05,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:37:07,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:37:09,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:37:09,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:37:09,890 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:37:10,221 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:37:11,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:37:13,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:37:15,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:37:17,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:37:19,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:37:21,894 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:37:23,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:37:25,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:37:25,146 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:37:25,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:37:27,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:37:29,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:37:31,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:37:33,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:37:35,900 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:37:37,901 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:37:39,901 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:37:40,294 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:37:40,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:37:40,418 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:37:41,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:37:43,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:37:45,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:37:47,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:37:49,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:37:51,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:37:53,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:37:55,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:37:55,647 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:37:55,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:37:57,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:37:59,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:38:01,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:38:03,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:38:05,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:38:07,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:38:09,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:38:10,369 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:38:11,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:38:11,096 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:38:11,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:38:14,916 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:38:16,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:38:18,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:38:20,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:38:22,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:38:24,921 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:38:26,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:38:26,321 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:38:26,922 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:38:28,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:38:30,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:38:32,925 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:38:34,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:38:36,927 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:38:38,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:38:40,441 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:38:40,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:38:41,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:38:41,538 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:38:42,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:38:44,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:38:46,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:38:48,932 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:38:50,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:38:52,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:38:54,935 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:38:56,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:38:56,771 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:38:56,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:38:58,937 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:39:00,938 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:39:02,938 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:39:04,939 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:39:06,940 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:39:08,941 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:39:10,513 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:39:10,942 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:39:12,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:39:12,117 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:39:12,943 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:39:14,944 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:39:16,945 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:39:19,946 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:39:21,947 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:39:23,948 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:39:25,948 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:39:27,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:39:27,365 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:39:27,949 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:39:29,950 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:39:31,950 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:39:33,951 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:39:35,952 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:39:37,953 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:39:39,953 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:39:40,581 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:39:41,954 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:39:42,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:39:42,661 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:39:43,955 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:39:45,955 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:39:47,956 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:39:49,957 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:39:51,958 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:39:53,959 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:39:55,960 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:39:57,961 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:39:58,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:39:58,026 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:39:59,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:40:01,963 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:40:03,964 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:40:05,964 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:40:07,965 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:40:09,966 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:40:10,650 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:40:11,967 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:40:13,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:40:13,394 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:40:13,968 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:40:15,969 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:40:17,970 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:40:19,971 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:40:21,972 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:40:23,972 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:40:25,973 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:40:27,974 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:40:28,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:40:28,743 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:40:29,974 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:40:31,975 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:40:33,976 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:40:35,976 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:40:37,977 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:40:39,978 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:40:40,725 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:40:41,979 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:40:43,980 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:40:43,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:40:43,987 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:40:45,981 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:40:47,982 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:40:49,983 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:40:51,984 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:40:53,984 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:40:55,985 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:40:57,986 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:40:59,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:40:59,391 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:40:59,987 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:41:01,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:41:03,989 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:41:05,990 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:41:07,990 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:41:09,991 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:41:10,796 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:41:11,992 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:41:13,993 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:41:14,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:41:14,650 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:41:15,994 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:41:17,995 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:41:19,995 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:41:21,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:41:24,997 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:41:26,998 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:41:28,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:41:29,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:41:29,950 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:41:31,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:41:33,001 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:41:35,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:41:37,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:41:39,003 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:41:40,868 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:41:41,004 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:41:43,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:41:45,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:41:45,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:41:45,390 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:41:47,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:41:49,007 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:41:51,008 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:41:53,008 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:41:55,009 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:41:57,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:41:59,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:42:00,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:42:00,654 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:42:01,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:42:03,012 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:42:05,013 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:42:07,014 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:42:09,014 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:42:10,923 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:42:11,015 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:42:13,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:42:15,017 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:42:15,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:42:15,880 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:42:17,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:42:19,019 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:42:21,019 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:42:23,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:42:25,021 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:42:27,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:42:29,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:42:31,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:42:31,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:42:31,334 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:42:33,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:42:35,025 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:42:38,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:42:40,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:42:40,993 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:42:42,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:42:44,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:42:46,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:42:46,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:42:46,558 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:42:48,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:42:50,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:42:52,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:42:54,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:42:56,031 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:42:58,031 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:43:00,032 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:43:01,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:43:01,913 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:43:02,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:43:04,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:43:06,034 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:43:08,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:43:10,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:43:11,060 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:43:12,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:43:14,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:43:16,038 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:43:17,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:43:17,137 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:43:18,039 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:43:20,039 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:43:22,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:43:24,041 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:43:26,042 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:43:28,042 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:43:30,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:43:32,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:43:32,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:43:32,427 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:43:34,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:43:36,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:43:38,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:43:40,047 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:43:41,136 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:43:42,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:43:44,049 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:43:46,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:43:47,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:43:47,756 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:43:48,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:43:50,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:43:52,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:43:54,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:43:56,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:43:58,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:44:00,056 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:44:02,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:44:02,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:44:02,978 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:44:04,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:44:06,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:44:08,059 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:44:10,060 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:44:11,210 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:44:12,061 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:44:14,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:44:16,063 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:44:18,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:44:18,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:44:18,369 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:44:20,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:44:23,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:44:25,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:44:27,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:44:29,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:44:31,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:44:33,071 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:44:33,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:44:33,599 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:44:35,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:44:37,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:44:39,074 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:44:41,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:44:41,285 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:44:43,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:44:45,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:44:47,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:44:48,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:44:48,846 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:44:49,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:44:51,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:44:53,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:44:55,081 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:44:57,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:44:59,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:45:01,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:45:03,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:45:04,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:45:04,095 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:45:05,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:45:07,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:45:09,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:45:11,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:45:11,359 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:45:13,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:45:15,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:45:17,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:45:19,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:45:19,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:45:19,323 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:45:21,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:45:23,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:45:25,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:45:27,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:45:29,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:45:31,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:45:33,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:45:34,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:45:34,657 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:45:35,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:45:37,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:45:39,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:45:41,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:45:41,435 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:45:43,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:45:45,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:45:47,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:45:49,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:45:49,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:45:49,900 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:45:51,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:45:53,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:45:55,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:45:57,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:45:59,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:46:01,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:46:03,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:46:05,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:46:05,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:46:05,121 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:46:07,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:46:09,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:46:11,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:46:11,509 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:46:13,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:46:15,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:46:17,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:46:20,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:46:20,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:46:20,402 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:46:22,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:46:24,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:46:26,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:46:28,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:46:30,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:46:32,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:46:34,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:46:35,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:46:35,624 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:46:36,121 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:46:38,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:46:40,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:46:41,585 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:46:42,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:46:44,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:46:46,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:46:48,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:46:50,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:46:50,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:46:50,998 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:46:52,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:46:54,128 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:46:56,128 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:46:58,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:47:00,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:47:02,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:47:04,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:47:06,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:47:06,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:47:06,321 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:47:08,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:47:10,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:47:11,661 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:47:12,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:47:14,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:47:16,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:47:18,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:47:20,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:47:21,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:47:21,545 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:47:22,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:47:24,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:47:26,140 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:47:28,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:47:30,142 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:47:32,142 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:47:34,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:47:36,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:47:36,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:47:36,808 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:47:39,145 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:47:41,146 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:47:41,736 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:47:43,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:47:45,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:47:47,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:47:49,150 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:47:51,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:47:52,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:47:52,030 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:47:53,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:47:55,152 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:47:57,153 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:47:59,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:48:01,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:48:03,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:48:05,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:48:07,157 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:48:07,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:48:07,331 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:48:09,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:48:11,159 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:48:11,809 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:48:13,159 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:48:15,160 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:48:17,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:48:19,162 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:48:21,163 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:48:22,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:48:22,649 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:48:23,164 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:48:25,165 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:48:27,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:48:29,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:48:31,168 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:48:33,168 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:48:35,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:48:37,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:48:37,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:48:37,906 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:48:39,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:48:41,172 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:48:41,884 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:48:43,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:48:45,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:48:47,175 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:48:49,176 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:48:51,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:48:53,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:48:53,174 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:48:53,179 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:48:55,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:48:58,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:49:00,182 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:49:02,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:49:04,184 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:49:06,185 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:49:08,186 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:49:08,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:49:08,474 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:49:10,187 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:49:11,960 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:49:12,188 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:49:14,189 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:49:16,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:49:18,191 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:49:20,192 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:49:22,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:49:23,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:49:23,699 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:49:24,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:49:26,194 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:49:28,195 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:49:30,196 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:49:32,197 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:49:34,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:49:36,199 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:49:38,200 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:49:39,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:49:39,091 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:49:40,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:49:42,037 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:49:42,202 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:49:44,203 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:49:46,204 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:49:48,204 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:49:50,205 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:49:52,206 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:49:54,206 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:49:54,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:49:54,410 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:49:56,207 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:49:58,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:50:00,209 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:50:02,210 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:50:04,210 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:50:06,211 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:50:08,212 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:50:09,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:50:09,713 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:50:11,213 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:50:12,108 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:50:13,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:50:15,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:50:17,215 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:50:19,216 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:50:21,217 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:50:23,218 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:50:25,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:50:25,033 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:50:25,219 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:50:27,220 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:50:29,221 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:50:31,222 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:50:33,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:50:35,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:50:37,224 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:50:39,225 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:50:40,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:50:40,315 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:50:41,226 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:50:42,162 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:50:43,227 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:50:45,228 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:50:47,229 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:50:49,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:50:51,231 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:50:53,231 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:50:55,232 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:50:55,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:50:55,624 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:50:57,233 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:50:59,234 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:51:01,235 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:51:03,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:51:05,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:51:07,237 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:51:09,238 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:51:10,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:51:10,953 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:51:11,239 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:51:12,223 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:51:13,240 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:51:15,241 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:51:17,242 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:51:19,242 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:51:21,243 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:51:23,244 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:51:25,245 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:51:26,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:51:26,179 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:51:27,246 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:51:29,246 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:51:31,247 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:51:33,248 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:51:35,249 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:51:38,251 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:51:40,252 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:51:41,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:51:41,473 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:51:42,253 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:51:42,298 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:51:44,254 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:51:46,254 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:51:48,255 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:51:50,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:51:52,257 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:51:54,258 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:51:56,259 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:51:56,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:51:56,805 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:51:58,260 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:52:00,261 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:52:02,262 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:52:04,263 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:52:06,264 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:52:08,265 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:52:10,266 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:52:12,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:52:12,099 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:52:12,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:52:12,373 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:52:14,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:52:16,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:52:18,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:52:20,270 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:52:22,271 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:52:24,272 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:52:26,273 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:52:27,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:52:27,324 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:52:28,273 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:52:30,274 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:52:32,275 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:52:34,276 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:52:36,277 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:52:38,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:52:40,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:52:42,279 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:52:42,447 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:52:42,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:52:42,639 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:52:44,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:52:46,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:52:48,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:52:50,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:52:52,283 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:52:54,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:52:56,285 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:52:57,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:52:57,990 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:52:58,286 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:53:00,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:53:02,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:53:04,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:53:06,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:53:08,290 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:53:11,292 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:53:12,520 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:53:13,293 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:53:13,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:53:13,341 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:53:15,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:53:17,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:53:19,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:53:21,296 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:53:23,297 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:53:25,298 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:53:27,299 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:53:28,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:53:28,613 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:53:29,300 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:53:31,301 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:53:33,301 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:53:35,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:53:37,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:53:39,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:53:41,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:53:42,595 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:53:43,306 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:53:43,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:53:43,867 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:53:45,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:53:47,308 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:53:49,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:53:51,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:53:53,310 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:53:55,311 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:53:57,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:53:59,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:53:59,204 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:53:59,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:54:01,313 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:54:03,314 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:54:05,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:54:07,316 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:54:09,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:54:11,318 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:54:12,666 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:54:13,319 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:54:14,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:54:14,473 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:54:15,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:54:17,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:54:19,322 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:54:21,322 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:54:23,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:54:25,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:54:27,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:54:29,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:54:29,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:54:29,773 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:54:31,326 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:54:33,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:54:35,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:54:37,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:54:39,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:54:41,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:54:42,740 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:54:43,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:54:44,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:54:44,998 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:54:45,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:54:47,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:54:49,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:54:51,335 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:54:53,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:54:55,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:54:58,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:55:00,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:55:00,219 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:55:00,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:55:02,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:55:04,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:55:06,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:55:08,342 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:55:10,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:55:12,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:55:12,815 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:55:14,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:55:15,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:55:15,445 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:55:16,346 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:55:18,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:55:20,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:55:22,348 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:55:24,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:55:26,350 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:55:28,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:55:30,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:55:30,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:55:30,815 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:55:32,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:55:34,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:55:36,354 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:55:38,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:55:40,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:55:42,356 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:55:42,887 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:55:44,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:55:46,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:55:46,133 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:55:46,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:55:48,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:55:50,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:55:52,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:55:54,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:55:56,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:55:58,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:56:00,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:56:01,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:56:01,356 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:56:02,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:56:04,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:56:06,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:56:08,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:56:10,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:56:12,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:56:12,962 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:56:14,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:56:16,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:56:16,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:56:16,727 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:56:18,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:56:20,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:56:22,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:56:24,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:56:26,371 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:56:28,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:56:31,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:56:32,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:56:32,078 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:56:33,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:56:35,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:56:37,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:56:39,376 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:56:43,038 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:56:47,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:56:47,305 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:57:02,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:57:02,547 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:57:13,113 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:57:17,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:57:17,811 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:57:33,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:57:33,070 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:57:38,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 03:57:38,631 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 03:57:38,683 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 03:57:38,760 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 03:57:39,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 03:57:40,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:57:41,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:57:43,194 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:57:47,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:57:48,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:57:48,349 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:58:03,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:58:03,634 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:58:09,411 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 03:58:13,276 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:58:18,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:58:18,948 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:58:34,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:58:34,173 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:58:43,352 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:58:49,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:58:49,401 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:59:04,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:59:04,627 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:59:13,430 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:59:19,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:59:19,862 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:59:35,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:59:35,087 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 03:59:43,505 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 03:59:50,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 03:59:50,313 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:00:05,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:00:05,528 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:00:13,582 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:00:20,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:00:20,942 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:00:36,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:00:36,167 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:00:43,662 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:00:51,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:00:51,468 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:01:06,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:01:06,692 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:01:13,740 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:01:21,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:01:21,922 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:01:37,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:01:37,149 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:01:43,818 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:01:52,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:01:52,372 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:02:01,514 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:02:03,514 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:02:05,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:02:06,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:06,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:06,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:06,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:06,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:06,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:06,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:06,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:06,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:06,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:06,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:06,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:06,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:06,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:06,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:06,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:07,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:07,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:07,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:07,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:07,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:07,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:07,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:07,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:07,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:07,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:07,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:07,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:07,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:07,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:07,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:07,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:07,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:02:07,633 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:02:13,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:13,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:13,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:13,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:13,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:13,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:13,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:13,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:13,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:13,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:13,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:13,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:13,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:13,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:13,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:13,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:13,518 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:02:13,891 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:02:15,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:15,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:15,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:15,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:15,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:15,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:15,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:15,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:15,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:15,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:15,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:15,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:15,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:15,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:15,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:15,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:17,519 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:02:21,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:02:22,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:22,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:22,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:22,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:22,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:22,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:22,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:22,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:22,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:22,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:22,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:22,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:22,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:22,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:22,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:22,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:22,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:02:22,861 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:02:22,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:22,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:22,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:22,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:22,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:22,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:22,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:22,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:22,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:22,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:22,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:22,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:22,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:22,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:22,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:22,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:26,522 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:02:26,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:26,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:26,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:26,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:26,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:26,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:26,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:26,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:26,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:26,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:26,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:26,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:26,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:26,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:26,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:26,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:28,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:28,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:28,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:28,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:28,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:28,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:28,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:28,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:28,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:28,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:28,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:28,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:28,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:28,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:28,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:28,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:30,523 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:02:34,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:02:37,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:37,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:37,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:37,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:37,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:37,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:37,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:37,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:37,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:37,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:37,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:37,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:37,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:37,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:37,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:37,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:37,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:37,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:37,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:37,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:37,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:37,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:37,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:37,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:37,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:37,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:37,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:37,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:37,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:37,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:37,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:37,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:38,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:02:38,373 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:02:38,526 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:02:40,527 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:02:43,965 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:02:44,528 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:02:45,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:45,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:45,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:45,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:45,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:45,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:45,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:45,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:45,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:45,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:45,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:45,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:45,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:45,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:45,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:45,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:48,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:02:50,530 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:02:52,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:02:53,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:02:53,643 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:02:55,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:55,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:55,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:55,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:55,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:55,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:55,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:55,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:55,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:55,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:55,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:55,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:55,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:55,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:55,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:55,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:02:56,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:02:58,534 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:03:00,535 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:03:04,537 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:03:06,537 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:03:08,538 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:03:08,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:03:08,937 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:03:10,539 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:03:10,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:10,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:10,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:10,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:10,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:10,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:10,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:10,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:10,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:10,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:10,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:10,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:10,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:10,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:10,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:10,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:14,041 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:03:14,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:14,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:14,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:14,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:14,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:14,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:14,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:14,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:14,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:14,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:14,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:14,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:14,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:14,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:14,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:14,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:14,541 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:03:16,541 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:03:18,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:03:18,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:18,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:18,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:18,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:18,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:18,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:18,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:18,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:18,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:18,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:18,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:18,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:18,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:18,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:18,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:18,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:18,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:18,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:18,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:18,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:18,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:18,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:18,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:18,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:18,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:18,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:18,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:18,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:18,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:18,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:18,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:18,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:20,543 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:03:20,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:20,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:20,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:20,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:20,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:20,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:20,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:20,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:20,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:20,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:20,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:20,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:20,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:20,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:20,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:20,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:22,544 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:03:24,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:24,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:24,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:24,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:24,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:24,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:24,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:24,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:24,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:24,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:24,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:24,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:24,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:24,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:24,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:24,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:24,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:03:24,161 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:03:24,545 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:03:26,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:03:28,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:03:30,547 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:03:30,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:30,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:30,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:30,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:30,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:30,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:30,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:30,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:30,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:30,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:30,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:30,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:30,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:30,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:30,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:30,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:31,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:31,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:31,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:31,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:31,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:31,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:31,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:31,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:31,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:31,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:31,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:31,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:31,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:31,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:31,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:31,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:32,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:03:32,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:32,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:32,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:32,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:32,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:32,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:32,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:32,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:32,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:32,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:32,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:32,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:32,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:32,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:32,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:32,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:33,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:33,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:33,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:33,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:33,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:33,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:33,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:33,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:33,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:33,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:33,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:33,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:33,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:33,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:33,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:33,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:34,549 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:03:35,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:35,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:35,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:35,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:35,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:35,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:35,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:35,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:35,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:35,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:35,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:35,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:35,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:35,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:35,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:35,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:35,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:35,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:35,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:35,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:35,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:35,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:35,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:35,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:35,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:35,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:35,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:35,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:35,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:35,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:35,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:35,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:36,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:36,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:36,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:36,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:36,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:36,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:36,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:36,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:36,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:36,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:36,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:36,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:36,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:36,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:36,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:36,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:36,550 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:03:38,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:38,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:38,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:38,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:38,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:38,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:38,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:38,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:38,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:38,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:38,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:38,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:38,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:38,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:38,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:38,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:38,552 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:03:38,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:38,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:38,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:38,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:38,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:38,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:38,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:38,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:38,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:38,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:38,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:38,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:38,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:38,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:38,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:38,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:39,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:03:39,383 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:03:39,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:39,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:39,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:39,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:39,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:39,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:39,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:39,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:39,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:39,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:39,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:39,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:39,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:39,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:39,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:39,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:40,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:03:41,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:41,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:41,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:41,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:41,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:41,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:41,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:41,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:41,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:41,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:41,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:41,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:41,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:41,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:41,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:41,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:41,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:41,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:41,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:41,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:41,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:41,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:41,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:41,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:41,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:41,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:41,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:41,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:41,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:41,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:41,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:41,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:42,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:03:42,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:42,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:42,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:42,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:42,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:42,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:42,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:42,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:42,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:42,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:42,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:42,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:42,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:42,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:42,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:42,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:43,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:43,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:43,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:43,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:43,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:43,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:43,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:43,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:43,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:43,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:43,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:43,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:43,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:43,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:43,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:43,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:44,110 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:03:44,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:44,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:44,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:44,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:44,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:44,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:44,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:44,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:44,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:44,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:44,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:44,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:44,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:44,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:44,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:44,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:44,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:44,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:44,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:44,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:44,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:44,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:44,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:44,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:44,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:44,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:44,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:44,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:44,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:44,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:44,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:44,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:44,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:03:45,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:45,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:45,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:45,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:45,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:45,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:45,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:45,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:45,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:45,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:45,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:45,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:45,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:45,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:45,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:45,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:46,555 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:03:48,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:48,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:48,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:48,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:48,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:48,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:48,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:48,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:48,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:48,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:48,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:48,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:48,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:48,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:48,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:48,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:48,556 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:03:49,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:49,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:49,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:49,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:49,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:49,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:49,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:49,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:49,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:49,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:49,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:49,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:49,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:49,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:49,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:49,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,558 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:03:50,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:50,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:52,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:52,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:52,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:52,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:52,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:52,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:52,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:52,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:52,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:52,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:52,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:52,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:52,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:52,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:52,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:52,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:52,558 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:03:52,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:52,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:52,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:52,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:52,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:52,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:52,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:52,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:52,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:52,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:52,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:52,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:52,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:52,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:52,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:52,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:53,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:53,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:53,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:53,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:53,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:53,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:53,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:53,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:53,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:53,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:53,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:53,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:53,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:53,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:53,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:53,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:54,559 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:03:54,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:03:54,611 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:03:56,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:56,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:56,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:56,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:56,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:56,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:56,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:56,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:56,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:56,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:56,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:56,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:56,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:56,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:56,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:56,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:56,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:03:58,561 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:03:58,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:58,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:58,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:58,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:58,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:58,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:58,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:58,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:58,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:58,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:58,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:58,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:58,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:58,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:58,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:58,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:59,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:59,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:59,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:59,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:59,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:59,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:59,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:59,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:59,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:59,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:59,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:59,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:59,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:59,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:59,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:59,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:59,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:59,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:59,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:59,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:59,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:59,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:59,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:59,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:59,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:59,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:59,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:03:59,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:00,562 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:04:09,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:04:09,867 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:04:09,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:09,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:09,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:09,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:09,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:09,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:09,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:09,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:09,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:09,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:09,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:09,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:09,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:09,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:09,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:09,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:10,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:10,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:10,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:10,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:10,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:10,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:10,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:10,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:10,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:10,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:10,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:10,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:10,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:10,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:10,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:10,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:10,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:04:14,178 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:04:14,567 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:04:15,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:15,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:15,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:15,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:15,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:15,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:15,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:15,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:15,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:15,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:15,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:15,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:15,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:15,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:15,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:15,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:19,569 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:04:23,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:04:25,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:04:25,093 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:04:27,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:27,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:27,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:27,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:27,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:27,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:27,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:27,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:27,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:27,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:27,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:27,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:27,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:27,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:27,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:27,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:27,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:04:27,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:27,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:27,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:27,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:27,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:27,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:27,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:27,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:27,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:27,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:27,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:27,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:27,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:27,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:27,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:27,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:29,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:29,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:29,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:29,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:29,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:29,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:29,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:29,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:29,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:29,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:29,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:29,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:29,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:29,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:29,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:29,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:29,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:29,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:29,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:29,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:29,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:29,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:29,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:29,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:29,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:29,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:29,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:29,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:29,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:29,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:29,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:29,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:31,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:31,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:31,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:31,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:31,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:31,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:31,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:31,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:31,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:31,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:31,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:31,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:31,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:31,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:31,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:31,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:31,574 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:04:34,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:34,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:34,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:34,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:34,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:34,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:34,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:34,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:34,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:34,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:34,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:34,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:34,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:34,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:34,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:34,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:35,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:04:38,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:38,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:38,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:38,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:38,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:38,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:38,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:38,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:38,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:38,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:38,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:38,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:38,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:38,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:38,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:38,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:39,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:04:40,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:04:40,357 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:04:41,578 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:04:42,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:42,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:42,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:42,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:42,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:42,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:42,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:42,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:42,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:42,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:42,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:42,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:42,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:42,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:42,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:42,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:44,250 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:04:45,580 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:04:47,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:04:47,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:47,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:47,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:47,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:47,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:47,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:47,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:47,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:47,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:47,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:47,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:47,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:47,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:47,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:47,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:47,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:51,583 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:04:53,583 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:04:55,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:04:55,656 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:04:57,585 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:04:58,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:58,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:58,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:58,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:58,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:58,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:58,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:58,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:58,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:58,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:58,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:58,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:58,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:58,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:58,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:58,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:04:59,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:05:01,587 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:05:05,588 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:05:07,589 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:05:09,590 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:05:10,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:05:10,880 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:05:11,591 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:05:13,591 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:05:14,323 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:05:16,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:16,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:16,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:16,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:16,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:16,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:16,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:16,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:16,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:16,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:16,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:16,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:16,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:16,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:16,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:16,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:17,593 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:05:18,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:18,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:18,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:18,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:18,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:18,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:18,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:18,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:18,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:18,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:18,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:18,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:18,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:18,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:18,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:18,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:19,594 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:05:21,594 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:05:23,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:23,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:23,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:23,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:23,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:23,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:23,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:23,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:23,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:23,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:23,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:23,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:23,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:23,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:23,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:23,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:23,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:23,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:23,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:23,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:23,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:23,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:23,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:23,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:23,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:23,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:23,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:23,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:23,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:23,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:23,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:23,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:23,595 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:05:24,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:24,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:24,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:24,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:24,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:24,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:24,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:24,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:24,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:24,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:24,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:24,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:24,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:24,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:24,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:24,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:24,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:24,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:24,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:24,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:24,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:24,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:24,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:24,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:24,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:24,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:24,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:24,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:24,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:24,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:24,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:24,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:25,595 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:05:26,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:05:26,102 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:05:27,596 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:05:29,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:05:31,598 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:05:32,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:32,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:32,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:32,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:32,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:32,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:32,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:32,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:32,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:32,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:32,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:32,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:32,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:32,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:32,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:32,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:33,599 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:05:34,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:34,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:34,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:34,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:34,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:34,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:34,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:34,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:34,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:34,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:34,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:34,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:34,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:34,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:34,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:34,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:35,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:35,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:35,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:35,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:35,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:35,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:35,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:35,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:35,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:35,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:35,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:35,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:35,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:35,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:35,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:35,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:35,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:05:37,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:37,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:37,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:37,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:37,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:37,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:37,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:37,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:37,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:37,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:37,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:37,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:37,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:37,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:37,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:37,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:37,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:37,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:37,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:37,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:37,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:37,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:37,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:37,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:37,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:37,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:37,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:37,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:37,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:37,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:37,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:37,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:37,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:05:37,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:37,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:37,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:37,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:37,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:37,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:38,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:38,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:38,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:38,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:38,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:38,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:38,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:38,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:38,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:38,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,601 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:05:39,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:39,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:41,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:05:41,398 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:05:41,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:05:43,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:43,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:43,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:43,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:43,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:43,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:43,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:43,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:43,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:43,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:43,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:43,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:43,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:43,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:43,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:43,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:43,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:05:43,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:43,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:43,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:43,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:43,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:43,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:43,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:43,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:43,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:43,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:43,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:43,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:43,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:43,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:43,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:43,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:44,391 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:05:45,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:05:45,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:45,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:47,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:47,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:47,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:47,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:47,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:47,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:47,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:47,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:47,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:47,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:47,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:47,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:47,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:47,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:47,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:47,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:47,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:05:49,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:49,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:49,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:49,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:49,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:49,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:49,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:49,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:49,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:49,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:49,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:49,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:49,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:49,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:49,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:49,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:49,605 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:05:50,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:50,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:51,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:51,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:51,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:51,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:51,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:51,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:51,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:51,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:51,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:51,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:51,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:51,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:51,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:51,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:51,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:51,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:51,606 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:05:51,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:51,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:51,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:51,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:51,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:51,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:51,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:51,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:51,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:51,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:51,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:51,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:51,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:51,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:51,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:51,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:52,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:52,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:52,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:52,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:52,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:52,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:52,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:52,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:52,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:52,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:52,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:52,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:52,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:52,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:52,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:52,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:53,607 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:05:53,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:53,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:53,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:53,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:53,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:53,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:53,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:53,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:53,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:53,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:53,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:53,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:53,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:53,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:53,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:53,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:54,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:54,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:54,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:54,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:54,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:54,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:54,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:54,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:54,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:54,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:54,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:54,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:54,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:54,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:54,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:54,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:55,607 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:05:56,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:05:56,659 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:05:56,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:56,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:56,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:56,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:56,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:56,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:56,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:56,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:56,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:56,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:56,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:56,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:56,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:56,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:56,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:56,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:56,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:56,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:56,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:56,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:57,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:57,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:57,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:57,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:57,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:57,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:57,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:57,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:57,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:05:57,328 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 04:05:57,558 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 04:05:57,624 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:05:57,625 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 04:05:58,624 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 04:05:59,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:06:08,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:06:11,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:11,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:11,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:11,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:11,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:11,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:11,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:11,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:11,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:11,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:11,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:11,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:11,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:11,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:11,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:11,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:11,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:06:11,884 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:06:13,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:13,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:13,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:13,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:13,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:13,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:13,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:13,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:13,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:13,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:13,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:13,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:13,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:13,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:13,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:13,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:14,475 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:06:14,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:06:15,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:15,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:15,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:15,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:15,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:15,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:15,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:15,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:15,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:15,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:15,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:15,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:15,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:15,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:15,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:15,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:18,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:18,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:18,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:18,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:18,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:18,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:18,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:18,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:18,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:18,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:18,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:18,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:18,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:18,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:18,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:18,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:18,632 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:06:22,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:22,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:22,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:22,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:22,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:22,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:22,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:22,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:22,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:22,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:22,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:22,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:22,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:22,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:22,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:22,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:22,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:06:26,634 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:06:27,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:06:27,237 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:06:30,635 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:06:31,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:31,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:31,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:31,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:31,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:31,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:31,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:31,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:31,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:31,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:31,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:31,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:31,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:31,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:31,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:31,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:33,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:33,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:33,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:33,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:33,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:33,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:33,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:33,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:33,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:33,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:33,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:33,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:33,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:33,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:33,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:33,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:34,637 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:06:37,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:37,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:37,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:37,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:37,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:37,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:37,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:37,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:37,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:37,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:37,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:37,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:37,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:37,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:37,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:37,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:38,639 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:06:40,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,640 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:06:40,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:40,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:42,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:06:42,461 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:06:44,551 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:06:44,641 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:06:45,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:45,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:45,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:45,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:45,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:45,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:45,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:45,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:45,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:45,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:45,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:45,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:45,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:45,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:45,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:45,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:46,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:06:49,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:49,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:49,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:49,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:49,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:49,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:49,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:49,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:49,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:49,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:49,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:49,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:49,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:49,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:49,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:49,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:06:50,644 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:06:52,645 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:06:56,646 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:06:57,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:06:57,900 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:06:58,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:07:00,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:00,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:00,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:00,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:00,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:00,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:00,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:00,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:00,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:00,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:00,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:00,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:00,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:00,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:00,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:00,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:01,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:01,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:01,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:01,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:01,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:01,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:01,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:01,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:01,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:01,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:01,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:01,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:01,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:01,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:01,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:01,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:02,649 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:07:04,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:07:06,651 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:07:10,652 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:07:12,653 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:07:13,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:07:13,227 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:07:14,626 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:07:14,654 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:07:16,654 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:07:20,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:07:21,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:21,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:21,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:21,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:21,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:21,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:21,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:21,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:21,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:21,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:21,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:21,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:21,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:21,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:21,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:21,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:22,657 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:07:24,658 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:07:25,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:25,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:25,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:25,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:25,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:25,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:25,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:25,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:25,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:25,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:25,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:25,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:25,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:25,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:25,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:25,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:26,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:26,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:26,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:26,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:26,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:26,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:26,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:26,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:26,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:26,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:26,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:26,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:26,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:26,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:26,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:26,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:26,658 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:07:27,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:27,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:27,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:27,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:27,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:27,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:27,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:27,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:27,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:27,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:27,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:27,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:27,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:27,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:27,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:27,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:28,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:28,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:28,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:28,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:28,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:28,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:28,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:28,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:28,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:28,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:28,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:28,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:28,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:28,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:28,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:28,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:28,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:07:28,512 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:07:28,659 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:07:30,660 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:07:32,660 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:07:33,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:33,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:33,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:33,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:33,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:33,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:33,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:33,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:33,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:33,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:33,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:33,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:33,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:33,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:33,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:33,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:34,661 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:07:36,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:07:37,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:37,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:37,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:37,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:37,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:37,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:37,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:37,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:37,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:37,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:37,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:37,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:37,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:37,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:37,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:37,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:37,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:37,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:37,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:37,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:37,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:37,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:37,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:37,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:37,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:37,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:37,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:37,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:37,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:37,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:37,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:37,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:38,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:07:40,663 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:07:41,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:41,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:41,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:41,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:41,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:41,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:41,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:41,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:41,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:41,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:41,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:41,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:41,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:41,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:41,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:41,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,664 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:07:42,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:42,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:43,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:07:43,741 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:07:43,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:43,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:43,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:43,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:43,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:43,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:43,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:43,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:43,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:43,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:43,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:43,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:43,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:43,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:43,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:43,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:43,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:43,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:43,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:43,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:43,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:43,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:43,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:43,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:43,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:43,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:43,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:43,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:43,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:43,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:43,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:43,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:44,665 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:07:44,702 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:07:45,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:45,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:45,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:45,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:45,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:45,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:45,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:45,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:45,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:45,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:45,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:45,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:45,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:45,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:45,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:45,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:46,666 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:07:47,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:47,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:47,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:47,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:47,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:47,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:47,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:47,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:47,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:47,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:47,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:47,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:47,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:47,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:47,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:47,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:48,667 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:07:49,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:49,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:50,668 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:07:51,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:51,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:51,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:51,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:51,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:51,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:51,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:51,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:51,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:51,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:51,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:51,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:51,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:51,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:51,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:51,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:51,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:51,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:51,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:51,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:51,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:51,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:51,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:51,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:51,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:51,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:51,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:51,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:51,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:51,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:51,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:51,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:52,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:52,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:52,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:52,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:52,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:52,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:52,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:52,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:52,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:52,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:52,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:52,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:52,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:52,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:52,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:52,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:52,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:07:54,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:54,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:54,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:54,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:54,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:54,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:54,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:54,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:54,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:54,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:54,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:54,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:54,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:54,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:54,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:54,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:54,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:54,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:54,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:54,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:54,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:54,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:54,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:54,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:54,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:54,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:54,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:54,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:54,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:54,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:54,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:54,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:54,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:07:55,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:55,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:55,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:55,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:55,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:55,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:55,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:55,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:55,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:55,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:55,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:55,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:55,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:55,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:55,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:55,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:56,670 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:07:58,671 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:07:58,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:58,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:58,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:58,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:58,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:58,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:58,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:58,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:58,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:58,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:58,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:58,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:58,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:58,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:58,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:58,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:59,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:07:59,065 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:07:59,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:59,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:59,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:59,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:59,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:59,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:59,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:59,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:59,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:59,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:59,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:07:59,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:00,672 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:08:04,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:04,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:04,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:04,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:04,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:04,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:04,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:04,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:04,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:04,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:04,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:04,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:04,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:04,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:04,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:04,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:06,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:06,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:06,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:06,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:06,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:06,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:06,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:06,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:06,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:06,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:06,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:06,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:06,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:06,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:06,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:06,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:09,676 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:08:14,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:08:14,289 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:08:14,781 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:08:15,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:08:19,680 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:08:23,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:23,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:23,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:23,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:23,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:23,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:23,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:23,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:23,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:23,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:23,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:23,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:23,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:23,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:23,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:23,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:23,682 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:08:23,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:23,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:23,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:23,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:23,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:23,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:23,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:23,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:23,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:23,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:23,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:23,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:23,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:23,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:23,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:23,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:25,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:25,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:25,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:25,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:25,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:25,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:25,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:25,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:25,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:25,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:25,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:25,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:25,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:25,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:25,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:25,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:27,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:27,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:27,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:27,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:27,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:27,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:27,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:27,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:27,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:27,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:27,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:27,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:27,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:27,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:27,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:27,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:27,683 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:08:29,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:29,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:29,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:29,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:29,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:29,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:29,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:29,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:29,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:29,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:29,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:29,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:29,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:29,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:29,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:29,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:29,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:08:29,519 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:08:31,685 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:08:35,687 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:08:37,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:08:37,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:37,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:37,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:37,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:37,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:37,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:37,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:37,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:38,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:38,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:38,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:38,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:38,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:38,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:38,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:38,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:39,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:39,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:39,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:39,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:39,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:39,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:39,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:39,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:39,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:39,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:39,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:39,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:39,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:39,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:39,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:39,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:41,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:41,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:41,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:41,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:41,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:41,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:41,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:41,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:41,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:41,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:41,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:41,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:41,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:41,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:41,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:41,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:41,689 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:08:44,856 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:08:44,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:08:44,910 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:08:45,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:08:45,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:45,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:47,692 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:08:50,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:50,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:50,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:50,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:50,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:50,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:50,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:50,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:50,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:50,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:50,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:50,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:50,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:50,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:50,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:50,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:51,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:08:53,695 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:08:57,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:57,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:57,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:57,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:57,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:57,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:57,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:57,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:57,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:57,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:57,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:57,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:57,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:57,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:57,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:57,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:08:57,696 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:08:59,698 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:09:00,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:09:00,135 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:09:01,698 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:09:02,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:02,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:02,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:02,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:02,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:02,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:02,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:02,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:02,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:02,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:02,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:02,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:02,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:02,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:02,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:02,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:05,700 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:09:07,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:07,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:07,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:07,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:07,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:07,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:07,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:07,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:07,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:07,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:07,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:07,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:07,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:07,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:07,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:07,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:07,701 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:09:09,702 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:09:11,703 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:09:13,704 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:09:14,931 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:09:15,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:09:15,438 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:09:17,706 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:09:19,707 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:09:21,708 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:09:23,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:09:25,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,710 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:09:25,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:25,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:27,711 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:09:29,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:09:30,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:09:30,663 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:09:31,713 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:09:32,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:32,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:32,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:32,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:32,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:32,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:32,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:32,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:32,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:32,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:32,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:32,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:32,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:32,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:32,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:32,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:32,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:32,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:32,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:32,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:32,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:32,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:32,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:32,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:32,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:32,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:32,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:32,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:32,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:32,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:32,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:32,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:33,714 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:09:35,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:35,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:35,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:35,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:35,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:35,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:35,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:35,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:35,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:35,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:35,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:35,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:35,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:35,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:35,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:35,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:35,715 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:09:37,716 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:09:39,717 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:09:41,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,717 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:09:41,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:41,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:42,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:42,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:42,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:42,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:42,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:42,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:42,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:42,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:42,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:42,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:42,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:42,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:42,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:42,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:42,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:42,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:42,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:42,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:42,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:42,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:42,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:42,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:42,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:42,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:43,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:43,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:43,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:43,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:43,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:43,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:43,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:43,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:43,718 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:09:44,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:44,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:44,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:44,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:44,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:44,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:44,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:44,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:44,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:44,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:44,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:44,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:44,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:44,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:44,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:44,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:44,998 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:09:45,720 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:09:45,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:09:45,890 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:09:46,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:46,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:47,720 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:09:48,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:48,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:48,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:48,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:48,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:48,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:48,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:48,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:48,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:48,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:48,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:48,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:48,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:48,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:48,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:48,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:49,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:09:50,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:50,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:50,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:50,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:50,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:50,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:50,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:50,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:50,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:50,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:50,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:50,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:50,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:50,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:50,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:50,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:51,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:51,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:51,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:51,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:51,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:51,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:51,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:51,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:51,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:51,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:51,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:51,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:51,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:51,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:51,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:51,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:51,722 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:09:53,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:53,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:53,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:53,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:53,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:53,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:53,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:53,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:53,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:53,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:53,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:53,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:53,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:53,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:53,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:53,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:53,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:53,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:53,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:53,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:53,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:53,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:53,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:53,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:53,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:53,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:53,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:53,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:53,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:53,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:53,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:53,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:53,723 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:09:54,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:54,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:54,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:54,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:54,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:54,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:54,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:54,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:54,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:54,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:54,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:54,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:54,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:54,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:54,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:54,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:55,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:55,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:55,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:55,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:55,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:55,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:55,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:55,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:55,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:55,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:55,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:55,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:55,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:55,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:55,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:55,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:55,724 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:09:55,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:55,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:55,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:55,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:55,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:55,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:55,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:55,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:55,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:55,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:55,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:55,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:55,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:55,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:55,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:55,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:56,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:56,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:56,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:56,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:56,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:56,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:56,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:56,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:56,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:56,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:56,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:56,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:56,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:56,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:56,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:56,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,725 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:09:57,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:57,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:58,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:58,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:58,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:58,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:58,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:58,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:58,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:58,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:58,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:58,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:58,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:58,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:58,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:58,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:58,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:58,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:58,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:58,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:58,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:58,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:58,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:58,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:58,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:58,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:58,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:58,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:58,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:58,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:58,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:58,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:58,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:58,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:59,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:59,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:59,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:59,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:59,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:59,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:59,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:59,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:59,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:59,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:59,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:59,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:59,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:09:59,452 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 04:09:59,664 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 04:09:59,736 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 04:09:59,737 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 04:10:00,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 04:10:00,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:10:01,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:10:01,216 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:10:02,738 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:10:10,741 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:10:13,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:13,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:13,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:13,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:13,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:13,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:13,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:13,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:13,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:13,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:13,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:13,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:13,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:13,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:13,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:13,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:15,071 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:10:16,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:10:16,445 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:10:16,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:10:18,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:18,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:18,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:18,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:18,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:18,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:18,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:18,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:18,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:18,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:18,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:18,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:18,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:18,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:18,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:18,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:20,745 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:10:24,746 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:10:28,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:28,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:28,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:28,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:28,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:28,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:28,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:28,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:28,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:28,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:28,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:28,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:28,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:28,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:28,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:28,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:28,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:28,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:28,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:28,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:28,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:28,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:28,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:28,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:28,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:28,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:28,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:28,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:28,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:28,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:28,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:28,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:28,748 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:10:31,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:10:31,691 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:10:32,749 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:10:33,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:33,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:33,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:33,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:33,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:33,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:33,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:33,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:33,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:33,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:33,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:33,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:33,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:33,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:33,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:33,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:34,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:34,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:34,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:34,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:34,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:34,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:34,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:34,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:34,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:34,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:34,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:34,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:34,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:34,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:34,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:34,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:35,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:35,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:35,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:35,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:35,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:35,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:35,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:35,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:35,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:35,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:35,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:35,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:35,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:35,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:35,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:35,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:36,751 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:10:38,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:38,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:38,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:38,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:38,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:38,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:38,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:38,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:38,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:38,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:38,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:38,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:38,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:38,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:38,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:38,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:38,752 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:10:42,754 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:10:44,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:44,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:44,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:44,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:44,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:44,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:44,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:44,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:44,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:44,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:44,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:44,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:44,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:44,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:44,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:44,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:44,755 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:10:45,141 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:10:45,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:45,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:45,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:45,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:45,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:45,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:45,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:45,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:45,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:45,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:45,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:45,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:45,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:45,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:45,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:45,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:46,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:10:46,931 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:10:48,757 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:10:48,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:48,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:48,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:48,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:48,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:48,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:48,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:48,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:48,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:48,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:48,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:48,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:48,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:48,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:48,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:48,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:49,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:49,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:49,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:49,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:49,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:49,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:49,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:49,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:49,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:49,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:49,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:49,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:49,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:49,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:49,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:49,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:50,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:50,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:50,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:50,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:50,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:50,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:50,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:50,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:50,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:50,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:50,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:50,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:50,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:50,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:50,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:50,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:50,757 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:10:52,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:52,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:52,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:52,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:52,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:52,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:52,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:52,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:52,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:52,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:52,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:52,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:52,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:52,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:52,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:52,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:54,759 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:10:56,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:10:57,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:57,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:57,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:57,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:57,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:57,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:57,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:57,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:57,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:57,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:57,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:57,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:57,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:57,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:57,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:57,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:58,761 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:10:59,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:59,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:59,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:59,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:59,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:59,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:59,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:59,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:59,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:59,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:59,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:59,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:59,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:59,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:59,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:10:59,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:02,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:11:02,189 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:11:02,763 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:11:04,764 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:11:05,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:05,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:05,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:05,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:05,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:05,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:05,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:05,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:05,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:05,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:05,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:05,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:05,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:05,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:05,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:05,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:06,765 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:11:08,765 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:11:11,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:11,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:11,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:11,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:11,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:11,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:11,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:11,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:11,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:11,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:11,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:11,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:11,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:11,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:11,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:11,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:12,767 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:11:14,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:11:15,220 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:11:16,769 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:11:17,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:11:17,505 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:11:18,770 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:11:20,770 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:11:22,771 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:11:24,772 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:11:26,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:11:28,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:28,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:28,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:28,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:28,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:28,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:28,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:28,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:28,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:28,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:28,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:28,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:28,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:28,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:28,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:28,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:28,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:28,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:28,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:28,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:28,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:28,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:28,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:28,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:28,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:28,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:28,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:28,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:28,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:28,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:28,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:28,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:28,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:11:29,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:29,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:29,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:29,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:29,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:29,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:29,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:29,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:29,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:29,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:29,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:29,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:29,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:29,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:29,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:29,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:30,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:11:32,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:11:32,741 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:11:33,775 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:11:34,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:34,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:34,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:34,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:34,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:34,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:34,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:34,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:34,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:34,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:34,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:34,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:34,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:34,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:34,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:34,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:35,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:35,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:35,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:35,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:35,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:35,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:35,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:35,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:35,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:35,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:35,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:35,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:35,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:35,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:35,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:35,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:35,776 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:11:37,777 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:11:39,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:11:40,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:40,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:40,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:40,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:40,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:40,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:40,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:40,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:40,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:40,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:40,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:40,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:40,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:40,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:40,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:40,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:41,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:41,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:41,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:41,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:41,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:41,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:41,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:41,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:41,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:41,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:41,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:41,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:41,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:41,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:41,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:41,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:41,779 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:11:41,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:41,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:41,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:41,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:41,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:41,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:41,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:41,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:41,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:41,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:41,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:41,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:41,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:41,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:41,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:41,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:42,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:42,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:42,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:42,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:42,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:42,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:42,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:42,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:42,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:42,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:42,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:42,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:42,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:42,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:42,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:42,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:43,779 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:11:44,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:44,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:44,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:44,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:44,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:44,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:44,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:44,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:44,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:44,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:44,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:44,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:44,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:44,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:44,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:44,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:44,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:44,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:44,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:44,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:44,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:44,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:44,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:44,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:44,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:44,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:44,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:44,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:44,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:44,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:44,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:44,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:45,295 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:11:45,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:45,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:45,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:45,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:45,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:45,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:45,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:45,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:45,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:45,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:45,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:45,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:45,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:45,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:45,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:45,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:45,780 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:11:46,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:46,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:46,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:46,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:46,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:46,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:46,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:46,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:46,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:46,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:46,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:46,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:46,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:46,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:46,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:46,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:46,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:46,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:46,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:46,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:46,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:46,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:46,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:46,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:46,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:46,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:46,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:46,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:46,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:46,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:46,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:46,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:47,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:47,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:47,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:47,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:47,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:47,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:47,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:47,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:47,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:47,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:47,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:47,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:47,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:47,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:47,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:47,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:47,781 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:11:47,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:11:47,967 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:11:48,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:48,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:48,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:48,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:48,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:48,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:48,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:48,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:48,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:48,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:48,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:48,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:48,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:48,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:48,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:48,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:49,782 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:11:50,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:50,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:50,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:50,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:50,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:50,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:50,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:50,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:50,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:50,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:50,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:50,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:50,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:50,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:50,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:50,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:50,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:50,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:50,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:50,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:50,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:50,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:50,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:50,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:50,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:50,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:50,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:50,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:50,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:50,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:50,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:50,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:51,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:51,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:51,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:51,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:51,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:51,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:51,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:51,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:51,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:51,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:51,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:51,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:51,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:51,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:51,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:51,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:51,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:11:53,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:53,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:53,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:53,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:53,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:53,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:53,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:53,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:53,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:53,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:53,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:53,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:53,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:53,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:53,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:53,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:53,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:53,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:53,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:53,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:53,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:53,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:53,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:53,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:53,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:53,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:53,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:53,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:53,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:53,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:53,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:53,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:53,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:11:54,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:54,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:54,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:54,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:54,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:54,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:54,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:54,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:54,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:54,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:54,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:54,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:54,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:54,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:54,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:54,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:55,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:55,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:55,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:55,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:55,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:55,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:55,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:55,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:55,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:55,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:55,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:55,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:55,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:55,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:55,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:55,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:55,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:55,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:55,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:55,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:55,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:55,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:55,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:55,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:55,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:55,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:55,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:55,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:55,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:55,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:55,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:55,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:55,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:11:56,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:56,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:11:57,785 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:11:59,787 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:12:03,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:12:03,236 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:12:09,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:09,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:09,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:09,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:09,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:09,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:09,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:09,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:09,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:09,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:09,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:09,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:09,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:09,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:09,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:09,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:09,791 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:12:11,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:11,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:11,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:11,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:11,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:11,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:11,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:11,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:11,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:11,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:11,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:11,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:11,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:11,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:11,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:11,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:13,792 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:12:14,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:14,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:14,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:14,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:14,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:14,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:14,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:14,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:14,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:14,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:14,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:14,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:14,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:14,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:14,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:14,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:15,365 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:12:16,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:16,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:16,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:16,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:16,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:16,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:16,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:16,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:16,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:16,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:16,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:16,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:16,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:16,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:16,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:16,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:18,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:12:18,460 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:12:19,795 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:12:20,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:20,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:20,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:20,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:20,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:20,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:20,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:20,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:20,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:20,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:20,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:20,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:20,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:20,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:20,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:20,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:23,797 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:12:26,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:26,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:26,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:26,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:26,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:26,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:26,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:26,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:26,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:26,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:26,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:26,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:26,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:26,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:26,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:26,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:27,799 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:12:30,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:30,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:30,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:30,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:30,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:30,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:30,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:30,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:30,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:30,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:30,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:30,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:30,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:30,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:30,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:30,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:31,800 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:12:33,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:12:33,685 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:12:33,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:33,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:33,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:33,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:33,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:33,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:33,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:33,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:33,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:33,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:33,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:33,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:33,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:33,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:33,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:33,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:35,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:35,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:35,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:35,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:35,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:35,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:35,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:35,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:35,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:35,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:35,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:35,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:35,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:35,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:35,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:35,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:35,802 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:12:35,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:35,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:35,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:35,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:35,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:35,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:35,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:35,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:35,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:35,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:35,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:35,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:35,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:35,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:35,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:35,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:37,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:12:40,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:40,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:40,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:40,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:40,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:40,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:40,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:40,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:40,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:40,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:40,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:40,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:40,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:40,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:40,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:40,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:41,805 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:12:42,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:42,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:42,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:42,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:42,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:42,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:42,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:42,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:42,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:42,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:42,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:42,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:42,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:42,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:42,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:42,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:43,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:12:45,439 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:12:47,808 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:12:48,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:12:48,970 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:12:49,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:49,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:49,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:49,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:49,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:49,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:49,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:49,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:49,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:49,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:49,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:49,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:49,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:49,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:49,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:49,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:49,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:49,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:49,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:49,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:49,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:49,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:49,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:49,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:49,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:49,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:49,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:49,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:49,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:49,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:49,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:49,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:49,809 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:12:50,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:50,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:50,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:50,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:50,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:50,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:50,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:50,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:50,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:50,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:50,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:50,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:50,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:50,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:50,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:50,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:52,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:52,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:52,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:52,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:52,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:52,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:52,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:52,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:52,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:52,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:52,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:52,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:52,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:52,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:52,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:52,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:53,811 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:12:55,811 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:12:56,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:56,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:56,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:56,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:56,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:56,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:56,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:56,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:56,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:56,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:56,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:56,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:56,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:56,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:56,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:56,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:56,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:56,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:56,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:56,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:56,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:56,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:56,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:56,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:56,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:56,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:56,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:56,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:56,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:56,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:56,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:56,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:12:57,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:13:01,814 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:13:03,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:13:04,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:13:04,223 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:13:05,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:05,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:05,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:05,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:05,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:05,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:05,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:05,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:05,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:05,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:05,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:05,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:05,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:05,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:05,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:05,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:05,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:05,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:05,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:05,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:05,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:05,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:05,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:05,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:05,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:05,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:05,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:05,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:05,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:05,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:05,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:05,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:05,816 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:13:07,817 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:13:10,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:10,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:10,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:10,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:10,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:10,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:10,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:10,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:10,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:10,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:10,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:10,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:10,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:10,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:10,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:10,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:11,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:13:12,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:12,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:12,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:12,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:12,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:12,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:12,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:12,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:12,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:12,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:12,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:12,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:12,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:12,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:12,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:12,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:13,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:13:15,513 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:13:15,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:13:17,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:13:19,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:13:19,443 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:13:19,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:13:21,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:13:23,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:13:25,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:13:27,826 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:13:29,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:13:31,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:13:32,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:32,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:32,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:32,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:32,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:32,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:32,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:32,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:32,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:32,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:32,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:32,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:32,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:32,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:32,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:32,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:33,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:33,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:33,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:33,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:33,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:33,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:33,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:33,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:33,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:33,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:33,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:33,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:33,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:33,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:33,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:33,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:33,829 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:13:34,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:34,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:34,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:34,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:34,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:34,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:34,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:34,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:34,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:34,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:34,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:34,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:34,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:34,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:34,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:34,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:34,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:13:34,664 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:13:35,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:13:36,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:36,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:36,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:36,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:36,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:36,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:36,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:36,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:36,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:36,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:36,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:36,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:36,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:36,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:36,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:36,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:37,831 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:13:39,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:13:39,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:39,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:39,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:39,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:39,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:39,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:39,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:39,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:39,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:39,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:39,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:39,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:39,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:39,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:39,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:39,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:41,833 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:13:42,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:42,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:42,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:42,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:42,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:42,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:42,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:42,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:42,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:42,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:42,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:42,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:42,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:42,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:42,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:42,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:43,834 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:13:44,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:44,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:44,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:44,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:44,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:44,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:44,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:44,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:44,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:44,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:44,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:44,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:44,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:44,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:44,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:44,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:45,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:45,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:45,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:45,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:45,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:45,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:45,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:45,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:45,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:45,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:45,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:45,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:45,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:45,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:45,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:45,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:45,586 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:13:45,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:45,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:45,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:45,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:45,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:45,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:45,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:45,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:45,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:45,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:45,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:45,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:45,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:45,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:45,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:45,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:46,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:46,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:46,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:46,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:46,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:46,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:46,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:46,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:46,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:46,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:46,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:46,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:46,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:46,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:46,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:46,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:46,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:46,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:46,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:46,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:46,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:46,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:46,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:46,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:46,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:46,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:46,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:46,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:46,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:46,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:46,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:46,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:46,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:13:47,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:47,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:47,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:47,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:47,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:47,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:47,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:47,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:47,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:47,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:47,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:47,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:47,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:47,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:47,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:47,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:48,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:48,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:48,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:48,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:48,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:48,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:48,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:48,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:48,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:48,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:48,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:48,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:48,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:48,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:48,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:48,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:48,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:13:49,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:49,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:49,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:49,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:49,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:49,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:49,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:49,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:49,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:49,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:49,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:49,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:49,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:49,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:49,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:49,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:49,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:49,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:49,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:49,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:49,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:49,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:49,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:49,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:49,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:49,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:49,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:49,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:49,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:49,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:49,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:49,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:49,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:13:49,975 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:13:50,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:13:52,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:13:53,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:53,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:54,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:13:54,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:54,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:54,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:54,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:54,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:54,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:54,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:54,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:54,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:54,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:54,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:54,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:54,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:54,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:54,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:54,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:55,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:55,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:55,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:55,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:55,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:55,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:55,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:55,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:55,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:55,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:55,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:55,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:55,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:55,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:55,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:55,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:56,855 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 04:13:56,984 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:13:57,082 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 04:13:57,149 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 04:13:57,978 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 04:13:57,979 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:13:59,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:59,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:59,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:59,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:59,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:59,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:59,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:59,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:59,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:59,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:59,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:59,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:59,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:59,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:59,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:13:59,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:04,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:04,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:04,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:04,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:04,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:04,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:04,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:04,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:04,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:04,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:04,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:04,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:04,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:04,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:04,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:04,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:05,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:14:05,199 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:14:07,980 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:14:08,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:08,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:08,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:08,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:08,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:08,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:08,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:08,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:08,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:08,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:08,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:08,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:08,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:08,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:08,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:08,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:08,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:08,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:08,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:08,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:08,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:08,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:08,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:08,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:08,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:08,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:08,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:08,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:08,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:08,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:08,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:08,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:12,982 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:14:15,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:15,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:15,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:15,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:15,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:15,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:15,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:15,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:15,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:15,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:15,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:15,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:15,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:15,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:15,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:15,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:15,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:15,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:15,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:15,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:15,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:15,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:15,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:15,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:15,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:15,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:15,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:15,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:15,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:15,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:15,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:15,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:15,693 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:14:18,985 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:14:19,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:19,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:19,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:19,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:19,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:19,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:19,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:19,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:19,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:19,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:19,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:19,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:19,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:19,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:19,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:19,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:20,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:14:20,422 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:14:22,986 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:14:23,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:23,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:23,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:23,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:23,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:23,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:23,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:23,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:23,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:23,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:23,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:23,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:23,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:23,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:23,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:23,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:25,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:25,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:25,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:25,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:25,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:25,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:25,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:25,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:25,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:25,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:25,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:25,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:25,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:25,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:25,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:25,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:26,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:14:30,990 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:14:32,991 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:14:34,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:34,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:34,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:34,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:34,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:34,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:34,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:34,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:34,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:34,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:34,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:34,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:34,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:34,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:34,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:34,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:35,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:35,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:35,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:35,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:35,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:35,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:35,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:35,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:35,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:35,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:35,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:35,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:35,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:35,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:35,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:35,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:35,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:14:35,880 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:14:36,993 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:14:40,994 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:14:41,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:41,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:41,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:41,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:41,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:41,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:41,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:41,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:41,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:41,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:41,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:41,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:41,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:41,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:41,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:41,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:41,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:41,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:41,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:41,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:41,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:41,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:41,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:41,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:41,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:41,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:41,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:41,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:41,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:41,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:41,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:41,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:42,995 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:14:45,768 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:14:46,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:46,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:46,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:46,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:46,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:46,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:46,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:46,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:46,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:46,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:46,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:46,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:46,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:46,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:46,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:46,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:46,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:46,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:46,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:46,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:46,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:46,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:46,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:46,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:46,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:46,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:46,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:46,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:46,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:46,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:46,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:46,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:46,997 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:14:48,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:48,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:48,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:48,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:48,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:48,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:48,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:48,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:48,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:48,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:48,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:48,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:48,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:48,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:48,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:48,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:50,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:14:51,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:14:51,108 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:14:53,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:14:53,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:53,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:53,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:53,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:53,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:53,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:53,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:53,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:53,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:53,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:53,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:53,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:53,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:53,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:53,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:53,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:55,001 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:14:55,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:55,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:55,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:55,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:55,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:55,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:55,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:55,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:55,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:55,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:55,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:55,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:55,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:55,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:55,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:55,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:14:59,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:15:00,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:00,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:00,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:00,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:00,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:00,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:00,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:00,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:00,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:00,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:00,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:00,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:00,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:00,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:00,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:00,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:01,003 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:15:01,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:01,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:01,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:01,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:01,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:01,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:01,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:01,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:01,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:01,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:01,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:01,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:01,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:01,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:01,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:01,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:03,004 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:15:03,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:03,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:03,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:03,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:03,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:03,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:03,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:03,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:03,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:03,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:03,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:03,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:03,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:03,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:03,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:03,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:03,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:03,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:03,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:03,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:03,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:03,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:03,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:03,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:03,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:03,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:03,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:03,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:03,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:03,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:03,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:03,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:06,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:15:06,561 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:15:07,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:15:09,007 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:15:11,008 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:15:12,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:12,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:12,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:12,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:12,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:12,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:12,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:12,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:12,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:12,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:12,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:12,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:12,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:12,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:12,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:12,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:12,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:12,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:12,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:12,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:12,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:12,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:12,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:12,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:12,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:12,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:12,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:12,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:12,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:12,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:12,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:12,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:13,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:15:13,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:13,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:13,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:13,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:13,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:13,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:13,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:13,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:13,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:13,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:13,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:13,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:13,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:13,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:13,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:13,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:15,842 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:15:16,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:16,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:16,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:16,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:16,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:16,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:16,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:16,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:16,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:16,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:16,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:16,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:16,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:16,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:16,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:16,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:17,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:15:19,012 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:15:21,013 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:15:21,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:15:21,840 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:15:23,013 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:15:26,014 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:15:28,015 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:15:30,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:15:32,017 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:15:34,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:15:36,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:15:37,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:15:37,062 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:15:38,019 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:15:39,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:39,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:39,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:39,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:39,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:39,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:39,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:39,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:39,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:39,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:39,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:39,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:39,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:39,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:39,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:39,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:39,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:39,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:39,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:39,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:39,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:39,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:39,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:39,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:39,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:39,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:39,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:39,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:39,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:39,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:39,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:39,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:40,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:15:40,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:40,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:40,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:40,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:40,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:40,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:40,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:40,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:40,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:40,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:40,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:40,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:40,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:40,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:40,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:40,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:42,021 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:15:42,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:42,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:42,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:42,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:42,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:42,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:42,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:42,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:42,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:42,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:42,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:42,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:42,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:42,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:42,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:42,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:42,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:42,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:42,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:42,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:42,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:42,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:42,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:42,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:42,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:42,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:42,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:42,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:42,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:42,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:42,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:42,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:44,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:15:45,915 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:15:46,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:15:46,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:46,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:46,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:46,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:46,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:46,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:46,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:46,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:46,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:46,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:46,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:46,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:46,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:46,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:46,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:46,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:48,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:15:49,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:49,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:15:50,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:50,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:52,025 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:15:52,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:15:52,318 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:15:52,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:52,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:52,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:52,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:52,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:52,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:52,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:52,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:52,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:52,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:52,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:52,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:52,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:52,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:52,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:52,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:54,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:15:56,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:15:56,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:56,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:56,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:56,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:56,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:56,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:56,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:56,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:56,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:56,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:56,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:56,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:56,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:56,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:56,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:56,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:57,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:57,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:57,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:57,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:57,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:57,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:57,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:57,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:57,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:57,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:57,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:57,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:57,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:57,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:57,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:57,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:57,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:57,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:57,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:57,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:57,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:57,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:57,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:57,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:57,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:57,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:57,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:57,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:57,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:57,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:57,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:57,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:58,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:58,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:58,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:58,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:58,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:15:58,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:58,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:58,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:58,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:58,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:58,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:58,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:58,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:58,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:58,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:58,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:58,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:58,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:58,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:58,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:58,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:58,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:58,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:58,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:58,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:58,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:58,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:58,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:15:58,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:00,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:16:03,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:03,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:03,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:03,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:03,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:03,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:03,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:03,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:03,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:03,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:03,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:03,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:03,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:03,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:03,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:03,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:07,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:07,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:07,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:07,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:07,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:07,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:07,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:07,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:07,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:07,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:07,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:07,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:07,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:07,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:07,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:07,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:07,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:16:07,569 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:16:10,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:16:15,983 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:16:16,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:16:17,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:17,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:17,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:17,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:17,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:17,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:17,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:17,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:17,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:17,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:17,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:17,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:17,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:17,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:17,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:17,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:17,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:17,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:17,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:17,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:17,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:17,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:17,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:17,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:17,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:17,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:17,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:17,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:17,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:17,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:17,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:17,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:20,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:16:21,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:21,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:21,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:21,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:21,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:21,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:21,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:21,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:21,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:21,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:21,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:21,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:21,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:21,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:21,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:21,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:22,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:22,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:22,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:22,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:22,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:22,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:22,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:22,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:22,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:22,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:22,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:22,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:22,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:22,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:22,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:22,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:22,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:16:22,902 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:16:24,039 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:16:24,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:24,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:24,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:24,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:24,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:24,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:24,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:24,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:24,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:24,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:24,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:24,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:24,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:24,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:24,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:24,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:28,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:16:29,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:29,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:29,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:29,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:29,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:29,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:29,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:29,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:29,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:29,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:29,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:29,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:29,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:29,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:29,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:29,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:31,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:31,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:31,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:31,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:31,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:31,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:31,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:31,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:31,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:31,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:31,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:31,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:31,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:31,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:31,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:31,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:32,041 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:16:33,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:33,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:33,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:33,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:33,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:33,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:33,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:33,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:33,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:33,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:33,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:33,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:33,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:33,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:33,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:33,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:33,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:33,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:33,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:33,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:33,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:33,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:33,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:33,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:33,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:33,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:33,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:33,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:33,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:33,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:33,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:33,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:36,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:16:37,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:37,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:37,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:37,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:37,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:37,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:37,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:37,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:37,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:37,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:37,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:37,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:37,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:37,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:37,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:37,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:38,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:16:38,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:16:38,126 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:16:38,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:38,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:38,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:38,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:38,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:38,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:38,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:38,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:38,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:38,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:38,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:38,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:38,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:38,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:38,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:38,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:42,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:16:43,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:43,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:43,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:43,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:43,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:43,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:43,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:43,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:43,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:43,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:43,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:43,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:43,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:43,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:43,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:43,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:45,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:45,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:45,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:45,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:45,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:45,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:45,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:45,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:45,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:45,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:45,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:45,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:45,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:45,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:45,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:45,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:46,047 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:16:46,058 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:16:46,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:46,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:46,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:46,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:46,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:46,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:46,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:46,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:46,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:46,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:46,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:46,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:46,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:46,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:46,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:46,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:48,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:16:52,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:16:53,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:16:53,455 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:16:54,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:16:54,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:54,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:54,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:54,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:54,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:54,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:54,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:54,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:54,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:54,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:54,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:54,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:54,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:54,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:54,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:54,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:56,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:56,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:56,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:56,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:56,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:56,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:56,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:56,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:56,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:56,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:56,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:56,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:56,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:56,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:56,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:56,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:16:58,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:17:00,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:00,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:00,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:00,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:00,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:00,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:00,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:00,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:00,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:00,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:00,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:00,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:00,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:00,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:00,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:00,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:00,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:17:01,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:01,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:01,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:01,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:01,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:01,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:01,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:01,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:01,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:01,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:01,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:01,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:01,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:01,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:01,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:01,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:02,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:17:02,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:02,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:02,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:02,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:02,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:02,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:02,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:02,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:02,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:02,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:02,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:02,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:02,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:02,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:02,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:02,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:05,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:05,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:05,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:05,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:05,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:05,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:05,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:05,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:05,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:05,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:05,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:05,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:05,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:05,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:05,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:05,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:06,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:17:08,056 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:17:08,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:17:08,684 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:17:10,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:17:10,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:10,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:10,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:10,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:10,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:10,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:10,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:10,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:10,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:10,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:10,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:10,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:10,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:10,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:10,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:10,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:10,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:10,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:10,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:10,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:10,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:10,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:10,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:10,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:10,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:10,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:10,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:10,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:10,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:10,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:10,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:10,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:11,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:11,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:11,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:11,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:11,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:11,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:11,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:11,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:11,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:11,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:11,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:11,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:11,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:11,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:11,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:11,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:12,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:17:16,132 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:17:16,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:16,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:16,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:16,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:16,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:16,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:16,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:16,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:16,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:16,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:16,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:16,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:16,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:16,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:16,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:16,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:17,060 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:17:18,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:18,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:18,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:18,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:18,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:18,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:18,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:18,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:18,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:18,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:18,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:18,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:18,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:18,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:18,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:18,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:19,061 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:17:21,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:17:21,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:21,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:21,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:21,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:21,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:21,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:21,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:21,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:21,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:21,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:21,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:21,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:21,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:21,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:21,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:21,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:23,063 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:17:23,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:17:23,934 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:17:25,063 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:17:25,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:25,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:25,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:25,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:25,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:25,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:25,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:25,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:25,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:25,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:25,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:25,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:25,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:25,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:25,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:25,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:27,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:17:29,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:17:31,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:17:33,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:17:35,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:17:37,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:17:39,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:17:39,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:17:39,156 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:17:41,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:17:42,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:42,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:42,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:42,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:42,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:42,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:42,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:42,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:42,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:42,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:42,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:42,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:42,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:42,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:42,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:42,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:42,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:42,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:42,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:42,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:42,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:42,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:42,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:42,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:42,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:42,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:42,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:42,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:42,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:42,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:42,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:42,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:43,071 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:17:45,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:17:45,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:45,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:45,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:45,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:45,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:45,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:45,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:45,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:45,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:45,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:45,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:45,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:45,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:45,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:45,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:45,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:46,211 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:17:47,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:17:47,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:47,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:47,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:47,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:47,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:47,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:47,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:47,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:47,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:47,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:47,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:47,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:47,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:47,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:47,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:47,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:48,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:48,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:48,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:48,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:48,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:48,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:48,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:48,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:48,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:48,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:48,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:48,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:48,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:48,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:48,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:48,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:48,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:48,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:48,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:48,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:48,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:48,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:48,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:48,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:48,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:48,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:48,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:48,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:48,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:48,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:48,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:48,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:49,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:17:51,074 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:17:52,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:52,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:53,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:17:53,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:53,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:53,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:53,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:53,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:53,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:53,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:53,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:53,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:53,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:53,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:53,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:53,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:53,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:53,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:53,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:54,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:17:54,435 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:17:54,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:54,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:54,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:54,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:54,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:54,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:54,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:54,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:54,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:54,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:54,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:54,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:54,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:54,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:54,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:54,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:17:55,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:55,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:57,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:17:59,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:17:59,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:59,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:59,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:59,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:59,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:59,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:59,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:59,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:59,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:59,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:59,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:59,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:59,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:17:59,670 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 04:17:59,887 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 04:17:59,952 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 04:18:00,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 04:18:01,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:18:03,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:03,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:03,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:03,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:03,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:03,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:03,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:03,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:03,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:03,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:03,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:03,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:03,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:03,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:03,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:03,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:04,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:04,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:04,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:04,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:04,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:04,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:04,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:04,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:04,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:04,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:04,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:04,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:04,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:04,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:04,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:04,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:04,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:04,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:04,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:04,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:04,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:04,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:04,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:04,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:04,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:04,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:04,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:04,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:04,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:04,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:04,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:04,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:09,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:18:09,694 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:18:11,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:18:11,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:11,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:11,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:11,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:11,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:11,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:11,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:11,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:11,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:11,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:11,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:11,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:11,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:11,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:11,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:11,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:16,304 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:18:17,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:18:21,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:18:24,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:18:24,976 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:18:25,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:18:26,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:26,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:26,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:26,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:26,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:26,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:26,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:26,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:26,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:26,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:26,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:26,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:26,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:26,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:26,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:26,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:28,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:28,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:28,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:28,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:28,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:28,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:28,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:28,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:28,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:28,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:28,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:28,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:28,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:28,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:28,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:28,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:29,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:18:30,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:30,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:30,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:30,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:30,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:30,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:30,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:30,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:30,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:30,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:30,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:30,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:30,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:30,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:30,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:30,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:31,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:31,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:31,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:31,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:31,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:31,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:31,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:31,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:31,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:31,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:31,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:31,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:31,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:31,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:31,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:31,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:33,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:18:33,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:33,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:33,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:33,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:33,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:33,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:33,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:33,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:33,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:33,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:33,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:33,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:33,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:33,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:33,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:33,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:33,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:33,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:33,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:33,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:33,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:33,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:33,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:33,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:33,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:33,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:33,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:33,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:33,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:33,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:33,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:33,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:34,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:34,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:34,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:34,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:34,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:34,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:34,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:34,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:34,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:34,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:34,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:34,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:34,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:34,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:34,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:34,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:35,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:35,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:35,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:35,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:35,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:35,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:35,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:35,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:35,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:35,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:35,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:35,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:35,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:35,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:35,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:35,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:37,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:18:40,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:18:40,219 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:18:41,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:41,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:41,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:41,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:41,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:41,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:41,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:41,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:41,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:41,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:42,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:42,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:42,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:42,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:42,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:42,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:42,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:18:42,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:42,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:42,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:42,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:42,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:42,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:42,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:42,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:42,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:42,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:42,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:42,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:42,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:42,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:42,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:42,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:43,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:43,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:43,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:43,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:43,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:43,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:43,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:43,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:43,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:43,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:43,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:43,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:43,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:43,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:43,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:43,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:43,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:43,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:43,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:43,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:43,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:43,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:43,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:43,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:43,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:43,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:43,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:43,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:43,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:43,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:43,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:43,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:46,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:18:46,378 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:18:48,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:18:48,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:48,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:48,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:48,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:48,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:48,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:48,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:48,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:48,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:48,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:48,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:48,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:48,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:48,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:48,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:48,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:51,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:51,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:51,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:51,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:51,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:51,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:51,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:51,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:51,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:51,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:51,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:51,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:51,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:51,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:51,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:51,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:51,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:51,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:51,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:51,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:51,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:51,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:51,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:51,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:51,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:51,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:51,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:51,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:51,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:51,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:51,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:51,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:52,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:18:54,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:18:54,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:54,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:54,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:54,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:54,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:54,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:54,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:54,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:54,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:54,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:54,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:54,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:54,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:54,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:54,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:54,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:18:55,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:18:55,453 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:18:58,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:19:00,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:19:01,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:01,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:01,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:01,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:01,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:01,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:01,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:01,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:01,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:01,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:01,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:01,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:01,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:01,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:01,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:01,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:02,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:19:04,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:04,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:04,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:04,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:04,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:04,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:04,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:04,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:04,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:04,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:04,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:04,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:04,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:04,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:04,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:04,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:06,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:19:06,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:06,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:06,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:06,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:06,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:06,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:06,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:06,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:06,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:06,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:06,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:06,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:06,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:06,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:06,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:06,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:07,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:07,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:07,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:07,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:07,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:07,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:07,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:07,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:07,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:07,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:07,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:07,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:07,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:07,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:07,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:07,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:08,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:19:09,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:09,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:09,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:09,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:09,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:09,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:09,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:09,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:09,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:09,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:09,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:09,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:09,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:09,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:09,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:09,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:09,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:09,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:09,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:09,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:09,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:09,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:09,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:09,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:09,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:09,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:09,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:09,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:09,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:09,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:09,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:09,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:10,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:19:10,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:19:10,741 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:19:12,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:19:14,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:19:15,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:15,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:15,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:15,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:15,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:15,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:15,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:15,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:15,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:15,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:15,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:15,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:15,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:15,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:15,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:15,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:16,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:16,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:16,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:16,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:16,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:16,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:16,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:16,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:16,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:16,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:16,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:16,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:16,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:16,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:16,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:16,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:16,455 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:19:18,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:19:19,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:19,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:19,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:19,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:19,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:19,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:19,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:19,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:19,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:19,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:19,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:19,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:19,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:19,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:19,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:19,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:20,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:19:22,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:19:24,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:19:25,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:19:25,964 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:19:26,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:19:26,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:26,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:28,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:19:29,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:29,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:29,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:29,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:29,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:29,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:29,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:29,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:29,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:29,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:29,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:29,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:29,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:29,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:29,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:29,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:30,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:19:32,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:19:34,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:19:36,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:19:38,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:19:40,121 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:19:41,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:19:41,187 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:19:42,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:19:44,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:19:46,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:46,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:46,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:46,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:46,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:46,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:46,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:46,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:46,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:46,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:46,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:46,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:46,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:46,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:46,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:46,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:46,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:19:46,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:46,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:46,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:46,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:46,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:46,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:46,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:46,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:46,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:46,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:46,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:46,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:46,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:46,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:46,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:46,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:46,524 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:19:48,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:19:49,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:49,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:49,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:49,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:49,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:49,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:49,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:49,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:49,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:49,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:49,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:49,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:49,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:49,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:49,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:49,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:49,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:49,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:49,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:49,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:49,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:49,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:49,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:49,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:49,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:49,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:49,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:49,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:49,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:49,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:49,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:49,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:50,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:19:50,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:50,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:50,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:50,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:50,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:50,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:50,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:50,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:50,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:50,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:50,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:50,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:50,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:50,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:50,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:50,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:51,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:51,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:51,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:51,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:51,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:51,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:51,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:51,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:51,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:51,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:51,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:51,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:51,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:51,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:51,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:51,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:52,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:19:54,128 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:19:54,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:54,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:54,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:54,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:54,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:54,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:54,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:54,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:54,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:54,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:54,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:54,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:54,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:54,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:54,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:54,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:54,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:54,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:54,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:54,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:54,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:54,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:54,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:54,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:54,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:54,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:54,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:54,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:54,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:54,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:54,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:54,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:55,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:55,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:55,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:55,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:55,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:55,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:55,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:55,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:55,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:55,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:55,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:55,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:55,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:55,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:55,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:55,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:19:56,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:19:56,433 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:19:56,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:56,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:58,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:19:58,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:58,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:58,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:58,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:58,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:58,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:58,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:58,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:58,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:58,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:58,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:58,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:58,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:58,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:58,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:58,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:58,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:58,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:58,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:58,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:58,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:58,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:58,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:58,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:58,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:58,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:58,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:58,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:58,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:58,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:58,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:58,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:59,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:59,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:59,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:59,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:59,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:59,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:59,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:59,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:59,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:59,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:59,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:19:59,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:00,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:20:02,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:20:10,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:20:11,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:11,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:11,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:11,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:11,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:11,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:11,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:11,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:11,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:11,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:11,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:11,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:11,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:11,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:11,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:11,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:11,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:20:11,664 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:20:16,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:16,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:16,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:16,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:16,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:16,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:16,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:16,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:16,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:16,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:16,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:16,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:16,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:16,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:16,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:16,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:16,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:20:16,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:16,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:16,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:16,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:16,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:16,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:16,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:16,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:16,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:16,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:16,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:16,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:16,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:16,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:16,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:16,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:16,600 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:20:20,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:20:22,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:22,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:22,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:22,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:22,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:22,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:22,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:22,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:22,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:22,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:22,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:22,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:22,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:22,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:22,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:22,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:25,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:20:26,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:20:26,887 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:20:29,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:20:32,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:32,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:32,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:32,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:32,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:32,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:32,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:32,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:32,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:32,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:32,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:32,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:32,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:32,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:32,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:32,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:33,145 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:20:34,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:34,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:34,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:34,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:34,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:34,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:34,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:34,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:34,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:34,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:34,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:34,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:34,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:34,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:34,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:34,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:35,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:35,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:35,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:35,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:35,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:35,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:35,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:35,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:35,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:35,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:35,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:35,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:35,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:35,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:35,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:35,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:35,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:35,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:35,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:35,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:35,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:35,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:35,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:35,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:35,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:35,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:35,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:35,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:35,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:35,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:35,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:35,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:37,146 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:20:37,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:37,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:37,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:37,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:37,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:37,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:37,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:37,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:37,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:37,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:37,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:37,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:37,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:37,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:37,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:37,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:39,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:39,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:39,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:39,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:39,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:39,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:39,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:39,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:39,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:39,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:39,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:39,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:39,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:39,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:39,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:39,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:41,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:20:42,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:20:42,408 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:20:43,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:20:43,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:43,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:43,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:43,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:43,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:43,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:43,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:43,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:43,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:43,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:43,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:43,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:43,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:43,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:43,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:43,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:43,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:43,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:43,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:43,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:43,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:43,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:43,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:43,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:43,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:43,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:43,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:43,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:43,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:43,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:43,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:43,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:46,675 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:20:46,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:46,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:46,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:46,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:46,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:46,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:46,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:46,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:46,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:46,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:46,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:46,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:46,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:46,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:46,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:46,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:47,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:20:49,152 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:20:50,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:50,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:50,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:50,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:50,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:50,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:50,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:50,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:50,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:50,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:50,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:50,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:50,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:50,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:50,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:50,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,153 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:20:53,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:53,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:55,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:20:57,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:20:57,631 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:20:58,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:58,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:58,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:58,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:58,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:58,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:58,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:58,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:58,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:58,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:58,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:58,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:58,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:58,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:58,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:58,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:58,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:58,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:58,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:58,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:58,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:58,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:58,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:58,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:58,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:58,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:58,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:58,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:58,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:58,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:58,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:58,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:20:59,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:21:01,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:21:03,157 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:21:03,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:03,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:03,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:03,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:03,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:03,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:03,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:03,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:03,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:03,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:03,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:03,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:03,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:03,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:03,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:03,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:05,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:05,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:05,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:05,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:05,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:05,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:05,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:05,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:05,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:05,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:05,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:05,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:05,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:05,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:05,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:05,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:07,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:21:08,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:08,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:08,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:08,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:08,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:08,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:08,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:08,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:08,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:08,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:08,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:08,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:08,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:08,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:08,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:08,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:08,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:08,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:08,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:08,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:08,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:08,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:08,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:08,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:08,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:08,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:08,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:08,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:08,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:08,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:08,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:08,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:09,159 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:21:10,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:10,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:10,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:10,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:10,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:10,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:10,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:10,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:10,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:10,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:10,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:10,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:10,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:10,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:10,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:10,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:11,160 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:21:11,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:11,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:11,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:11,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:11,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:11,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:11,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:11,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:11,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:11,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:11,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:11,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:11,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:11,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:11,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:11,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:12,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:21:12,978 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:21:12,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:13,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:13,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:13,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:13,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:13,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:13,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:13,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:13,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:13,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:13,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:13,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:13,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:13,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:13,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:13,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:13,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:21:16,750 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:21:17,162 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:21:19,163 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:21:20,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:20,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:20,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:20,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:20,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:20,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:20,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:20,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:20,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:20,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:20,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:20,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:20,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:20,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:20,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:20,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:21,164 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:21:23,165 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:21:23,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:23,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:23,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:23,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:23,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:23,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:23,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:23,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:23,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:23,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:23,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:23,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:23,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:23,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:23,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:23,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:24,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:24,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:24,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:24,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:24,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:24,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:24,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:24,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:24,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:24,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:24,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:24,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:24,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:24,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:24,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:24,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:25,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:21:27,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:21:28,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:21:28,321 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:21:28,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:28,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:28,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:28,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:28,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:28,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:28,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:28,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:28,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:28,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:28,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:28,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:28,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:28,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:28,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:28,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:28,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:28,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:28,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:28,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:28,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:28,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:28,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:28,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:28,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:28,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:28,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:28,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:28,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:28,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:28,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:28,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:29,168 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:21:31,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:31,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:31,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:31,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:31,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:31,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:31,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:31,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:31,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:31,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:31,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:31,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:31,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:31,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:31,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:31,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:31,168 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:21:33,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:21:34,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:34,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:34,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:34,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:34,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:34,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:34,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:34,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:34,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:34,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:34,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:34,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:34,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:34,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:34,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:34,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:35,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:21:37,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:21:39,172 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:21:41,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:21:43,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:21:43,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:21:43,608 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:21:45,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:21:46,826 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:21:47,175 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:21:48,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:48,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:48,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:48,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:48,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:48,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:48,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:48,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:48,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:48,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:48,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:48,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:48,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:48,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:48,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:48,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:48,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:48,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:48,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:48,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:48,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:48,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:48,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:48,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:48,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:48,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:48,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:48,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:48,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:48,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:48,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:48,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:49,176 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:21:50,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:50,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:50,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:50,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:50,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:50,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:50,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:50,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:50,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:50,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:50,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:50,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:50,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:50,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:50,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:50,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:51,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:21:51,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:51,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:51,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:51,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:51,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:51,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:51,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:51,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:51,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:51,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:51,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:51,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:51,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:51,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:51,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:51,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:53,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:21:53,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:53,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:53,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:53,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:53,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:53,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:53,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:53,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:53,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:53,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:53,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:53,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:53,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:53,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:53,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:53,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:53,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:53,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:53,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:53,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:53,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:53,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:53,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:53,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:53,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:53,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:53,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:53,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:53,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:53,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:53,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:53,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:55,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:21:56,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:56,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:56,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:56,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:56,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:56,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:56,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:56,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:56,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:56,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:56,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:56,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:56,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:56,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:56,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:56,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:56,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:56,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:56,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:56,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:56,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:56,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:56,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:56,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:56,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:56,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:56,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:56,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:56,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:56,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:56,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:56,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:57,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:57,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:57,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:57,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:57,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:57,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:57,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:57,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:57,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:57,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:57,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:57,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:57,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:57,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:57,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:57,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:57,179 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:21:57,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:57,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:57,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:57,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:57,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:57,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:57,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:57,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:57,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:57,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:57,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:57,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:57,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:57,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:57,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:57,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:58,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:21:58,974 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:21:58,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 04:21:59,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:21:59,256 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 04:21:59,321 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 04:21:59,376 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 04:22:00,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 04:22:00,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:22:01,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:22:03,182 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:22:05,182 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:22:07,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:22:09,184 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:22:11,185 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:22:13,185 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:22:14,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:22:14,277 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:22:15,186 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:22:16,920 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:22:17,187 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:22:19,188 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:22:21,188 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:22:23,189 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:22:25,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:22:27,191 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:22:29,192 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:22:29,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:22:29,691 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:22:31,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:22:34,194 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:22:36,195 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:22:38,196 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:22:40,197 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:22:42,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:22:44,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:22:44,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:22:44,921 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:22:46,199 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:22:46,983 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:22:48,200 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:22:50,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:22:52,202 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:22:54,203 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:22:56,204 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:22:58,204 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:23:00,205 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:23:00,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:23:00,359 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:23:02,207 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:23:04,207 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:23:06,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:23:08,209 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:23:10,210 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:23:12,210 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:23:14,211 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:23:15,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:23:15,644 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:23:16,212 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:23:17,041 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:23:18,212 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:23:20,213 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:23:22,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:23:24,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:23:26,215 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:23:28,216 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:23:30,216 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:23:31,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:23:31,034 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:23:32,217 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:23:34,218 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:23:36,219 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:23:38,220 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:23:40,221 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:23:42,222 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:23:44,222 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:23:46,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:23:46,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:23:46,335 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:23:47,100 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:23:48,224 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:23:50,224 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:23:52,225 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:23:54,226 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:23:56,226 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:23:58,227 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:24:00,228 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:24:01,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:24:01,562 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:24:02,229 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:24:04,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:24:06,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:24:08,231 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:24:10,232 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:24:12,232 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:24:14,233 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:24:16,234 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:24:16,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:24:16,848 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:24:17,177 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:24:18,235 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:24:20,235 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:24:23,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:24:25,237 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:24:27,239 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:24:29,239 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:24:31,240 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:24:32,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:24:32,075 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:24:33,241 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:24:35,242 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:24:37,243 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:24:39,244 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:24:41,245 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:24:43,246 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:24:45,247 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:24:47,248 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:24:47,252 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:24:47,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:24:47,392 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:24:49,249 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:24:51,250 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:24:53,251 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:24:55,252 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:24:57,253 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:24:59,254 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:25:01,254 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:25:02,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:25:02,628 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:25:03,255 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:25:05,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:25:07,257 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:25:09,258 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:25:11,259 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:25:13,260 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:25:15,261 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:25:17,262 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:25:17,327 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:25:17,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:25:17,863 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:25:19,263 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:25:21,264 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:25:23,265 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:25:25,266 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:25:27,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:25:29,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:25:31,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:25:33,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:25:33,176 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:25:33,270 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:25:35,271 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:25:37,272 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:25:39,273 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:25:41,274 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:25:43,275 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:25:45,276 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:25:47,276 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:25:47,398 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:25:48,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:25:48,409 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:25:49,277 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:25:51,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:25:53,279 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:25:55,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:25:58,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:26:00,283 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:26:02,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:26:03,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:26:03,740 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:26:04,285 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:26:06,286 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:26:08,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:26:10,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:26:12,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:26:14,290 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:26:16,290 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:26:17,464 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:26:18,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:26:18,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:26:18,996 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:26:20,292 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:26:22,293 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:26:24,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:26:26,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:26:28,296 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:26:30,297 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:26:32,298 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:26:34,299 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:26:34,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:26:34,431 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:26:36,300 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:26:38,301 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:26:40,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:26:42,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:26:44,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:26:46,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:26:47,540 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:26:48,306 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:26:49,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:26:49,692 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:26:50,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:26:52,308 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:26:54,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:26:56,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:26:59,311 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:27:01,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:27:03,313 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:27:04,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:27:04,922 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:27:05,314 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:27:07,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:27:09,316 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:27:11,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:27:13,318 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:27:15,319 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:27:17,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:27:17,615 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:27:19,321 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:27:20,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:27:20,378 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:27:21,322 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:27:23,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:27:25,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:27:27,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:27:29,326 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:27:31,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:27:33,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:27:35,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:27:35,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:27:35,648 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:27:37,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:27:39,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:27:41,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:27:43,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:27:45,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:27:47,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:27:47,693 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:27:49,335 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:27:50,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:27:50,863 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:27:51,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:27:53,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:27:55,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:27:57,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:27:59,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:28:01,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:28:03,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:28:05,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:28:06,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:28:06,166 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:28:07,342 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:28:09,342 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:28:11,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:28:13,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:28:15,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:28:17,346 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:28:17,769 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:28:19,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:28:21,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:28:21,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:28:21,423 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:28:23,348 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:28:25,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:28:27,350 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:28:29,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:28:32,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:28:34,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:28:36,354 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:28:36,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:28:36,730 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:28:38,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:28:40,356 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:28:42,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:28:44,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:28:46,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:28:47,845 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:28:48,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:28:50,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:28:51,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:28:51,951 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:28:52,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:28:54,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:28:56,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:28:58,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:29:00,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:29:02,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:29:04,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:29:06,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:29:07,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:29:07,174 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:29:08,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:29:10,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:29:12,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:29:14,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:29:16,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:29:17,948 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:29:18,371 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:29:20,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:29:22,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:29:22,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:29:22,395 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:29:24,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:29:26,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:29:28,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:29:30,376 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:29:32,377 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:29:34,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:29:36,379 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:29:37,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:29:37,754 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:29:38,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:29:40,381 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:29:42,382 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:29:44,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:29:46,384 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:29:47,996 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:29:49,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:29:51,386 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:29:52,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:29:52,996 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:29:53,387 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:29:55,388 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:29:57,389 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:29:59,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:30:01,391 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:30:03,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:30:05,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:30:07,393 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:30:08,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:30:08,297 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:30:09,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:30:11,395 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:30:13,396 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:30:15,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:30:17,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:30:18,071 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:30:19,399 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:30:21,399 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:30:23,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:30:23,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:30:23,609 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:30:25,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:30:27,402 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:30:29,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:30:31,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:30:33,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:30:35,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:30:37,406 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:30:38,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:30:38,850 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:30:39,407 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:30:41,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:30:43,409 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:30:45,409 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:30:47,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:30:48,141 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:30:49,411 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:30:51,412 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:30:53,413 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:30:54,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:30:54,074 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:30:55,414 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:30:57,414 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:30:59,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:31:01,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:31:03,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:31:05,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:31:07,419 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:31:09,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:31:09,375 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:31:09,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:31:11,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:31:13,421 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:31:15,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:31:17,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:31:18,208 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:31:20,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:31:22,425 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:31:24,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:31:24,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:31:24,658 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:31:26,427 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:31:28,428 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:31:30,429 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:31:32,429 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:31:34,430 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:31:36,431 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:31:38,432 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:31:39,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:31:39,893 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:31:40,433 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:31:42,434 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:31:44,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:31:46,436 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:31:48,275 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:31:48,437 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:31:50,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:31:52,439 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:31:54,440 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:31:55,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:31:55,303 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:31:56,441 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:31:58,441 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:32:00,442 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:32:02,443 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:32:04,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:32:06,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:32:08,445 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:32:10,446 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:32:10,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:32:10,622 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:32:12,447 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:32:14,448 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:32:16,449 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:32:18,348 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:32:18,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:32:20,451 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:32:22,452 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:32:24,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:32:25,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:32:25,851 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:32:26,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:32:28,455 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:32:30,456 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:32:32,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:32:34,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:32:36,458 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:32:38,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:32:40,460 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:32:41,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:32:41,239 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:32:42,460 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:32:44,461 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:32:46,462 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:32:48,417 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:32:48,462 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:32:50,463 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:32:53,465 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:32:55,466 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:32:56,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:32:56,533 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:32:57,466 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:32:59,467 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:33:01,468 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:33:03,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:33:05,470 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:33:07,471 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:33:09,472 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:33:11,473 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:33:11,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:33:11,890 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:33:13,474 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:33:15,475 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:33:17,476 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:33:18,492 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:33:19,477 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:33:21,478 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:33:23,478 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:33:25,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:33:27,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:33:27,285 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:33:27,480 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:33:29,481 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:33:31,482 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:33:33,483 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:33:35,484 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:33:37,485 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:33:39,486 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:33:41,487 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:33:42,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:33:42,510 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:33:43,487 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:33:45,488 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:33:47,489 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:33:48,556 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:33:49,489 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:33:51,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:33:53,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:33:55,491 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:33:57,492 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:33:57,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:33:57,890 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:33:59,492 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:34:01,493 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:34:03,494 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:34:05,494 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:34:07,495 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:34:09,496 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:34:11,497 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:34:13,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:34:13,115 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:34:13,498 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:34:15,499 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:34:17,500 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:34:18,622 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:34:19,501 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:34:21,502 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:34:24,503 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:34:26,504 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:34:28,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:34:28,503 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:34:28,507 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:34:30,508 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:34:32,509 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:34:34,510 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:34:36,511 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:34:38,512 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:34:40,513 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:34:42,513 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:34:43,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:34:43,762 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:34:44,514 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:34:46,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:34:48,516 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:34:48,690 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:34:50,517 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:34:52,518 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:34:54,519 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:34:56,519 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:34:58,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:34:59,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:34:59,151 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:35:00,521 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:35:02,522 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:35:04,523 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:35:06,524 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:35:08,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:35:10,526 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:35:12,527 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:35:14,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:35:14,386 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:35:14,528 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:35:16,528 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:35:18,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:35:18,766 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:35:20,530 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:35:22,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:35:24,532 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:35:26,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:35:28,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:35:29,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:35:29,840 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:35:30,534 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:35:32,535 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:35:34,536 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:35:36,537 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:35:38,538 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:35:40,539 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:35:42,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:35:44,541 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:35:45,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:35:45,063 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:35:46,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:35:48,543 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:35:48,842 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:35:50,544 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:35:52,544 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:35:54,545 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:35:56,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:35:58,547 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:36:00,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:36:00,532 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:36:00,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:36:02,549 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:36:04,550 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:36:07,551 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:36:09,552 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:36:11,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:36:13,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:36:15,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:36:15,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:36:15,862 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:36:17,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:36:18,918 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:36:19,555 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:36:21,556 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:36:23,557 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:36:25,557 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:36:27,558 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:36:29,559 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:36:31,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:36:31,161 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:36:31,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:36:33,561 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:36:35,562 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:36:37,562 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:36:39,563 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:36:41,564 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:36:43,565 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:36:45,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:36:46,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:36:46,652 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:36:47,567 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:36:48,993 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:36:49,568 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:36:51,569 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:36:53,569 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:36:55,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:36:57,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:36:59,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:37:01,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:37:01,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:37:01,958 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:37:03,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:37:05,574 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:37:07,574 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:37:09,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:37:11,576 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:37:13,576 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:37:15,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:37:17,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:37:17,184 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:37:17,578 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:37:19,069 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:37:19,578 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:37:21,579 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:37:23,580 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:37:25,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:37:27,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:37:29,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:37:31,583 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:37:32,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:37:32,407 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:37:33,583 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:37:35,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:37:37,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:37:39,585 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:37:41,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:37:43,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:37:46,587 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:37:47,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:37:47,759 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:37:48,588 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:37:49,141 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:37:50,589 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:37:52,590 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:37:54,591 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:37:56,591 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:37:58,592 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:38:00,593 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:38:02,593 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:38:02,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:38:02,981 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:38:04,594 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:38:06,595 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:38:08,596 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:38:10,596 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:38:12,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:38:14,598 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:38:16,599 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:38:18,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:38:18,236 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:38:18,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:38:19,212 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:38:20,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:38:22,601 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:38:24,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:38:26,603 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:38:28,603 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:38:30,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:38:32,605 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:38:33,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:38:33,510 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:38:34,605 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:38:36,606 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:38:38,607 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:38:40,607 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:38:42,608 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:38:44,609 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:38:46,610 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:38:48,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:38:48,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:38:48,738 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:38:49,288 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:38:50,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:38:52,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:38:54,613 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:38:56,614 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:38:58,615 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:39:00,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:39:02,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:39:03,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:39:03,984 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:39:04,617 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:39:06,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:39:09,619 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:39:11,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:39:13,621 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:39:15,622 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:39:17,622 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:39:19,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:39:19,356 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:39:19,580 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:39:19,623 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:39:21,624 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:39:23,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:39:25,626 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:39:27,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:39:29,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:39:31,629 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:39:33,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:39:34,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:39:34,611 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:39:35,631 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:39:37,632 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:39:39,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:39:41,634 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:39:43,635 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:39:45,636 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:39:47,637 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:39:49,438 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:39:49,638 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:39:49,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:39:49,832 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:39:51,639 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:39:53,640 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:39:55,641 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:39:57,641 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:39:59,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:40:01,643 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:40:03,644 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:40:05,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:40:05,047 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:40:05,645 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:40:07,646 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:40:09,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:40:11,648 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:40:14,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:40:16,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:40:18,651 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:40:19,514 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:40:20,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:40:20,406 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:40:20,652 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:40:22,653 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:40:24,654 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:40:26,655 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:40:28,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:40:30,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:40:32,657 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:40:34,658 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:40:35,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:40:35,628 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:40:36,659 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:40:38,660 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:40:40,661 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:40:42,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:40:44,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:40:46,663 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:40:48,664 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:40:49,589 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:40:50,665 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:40:50,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:40:50,852 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:40:52,666 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:40:54,667 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:40:56,668 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:40:58,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:41:00,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:41:02,670 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:41:04,671 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:41:06,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:41:06,074 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:41:06,672 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:41:08,672 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:41:10,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:41:12,674 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:41:14,675 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:41:16,676 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:41:18,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:41:19,660 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:41:20,678 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:41:21,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:41:21,575 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:41:22,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:41:24,680 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:41:26,680 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:41:28,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:41:30,682 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:41:32,682 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:41:34,683 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:41:36,683 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:41:36,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:41:36,832 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:41:38,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:41:40,685 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:41:43,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:41:45,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:41:47,687 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:41:49,687 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:41:49,736 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:41:51,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:41:52,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:41:52,126 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:41:53,689 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:41:55,689 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:41:57,690 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:41:59,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:42:01,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:42:03,692 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:42:05,693 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:42:07,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:42:07,358 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:42:07,693 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:42:09,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:42:11,695 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:42:13,695 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:42:15,696 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:42:17,697 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:42:19,697 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:42:19,811 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:42:21,698 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:42:22,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:42:22,611 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:42:23,699 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:42:25,699 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:42:27,700 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:42:29,700 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:42:31,701 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:42:33,702 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:42:35,703 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:42:37,704 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:42:37,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:42:37,942 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:42:39,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:42:41,706 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:42:43,706 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:42:45,707 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:42:47,708 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:42:49,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:42:49,879 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:42:51,710 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:42:53,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:42:53,281 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:42:53,711 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:42:55,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:42:57,713 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:42:59,714 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:43:01,715 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:43:03,716 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:43:05,717 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:43:07,718 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:43:08,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:43:08,587 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:43:09,719 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:43:11,719 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:43:13,720 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:43:16,722 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:43:18,723 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:43:19,955 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:43:20,724 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:43:22,725 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:43:23,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:43:23,811 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:43:24,726 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:43:26,727 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:43:28,727 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:43:30,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:43:32,729 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:43:34,730 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:43:36,731 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:43:38,732 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:43:39,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:43:39,146 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:43:40,733 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:43:42,734 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:43:44,735 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:43:46,735 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:43:48,736 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:43:50,022 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:43:50,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:43:52,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:43:54,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:43:54,537 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:43:54,738 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:43:56,739 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:43:58,740 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:44:00,741 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:44:02,741 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:44:04,742 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:44:06,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:44:08,744 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:44:09,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:44:09,886 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:44:10,745 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:44:12,746 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:44:14,746 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:44:16,748 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:44:18,748 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:44:20,095 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:44:20,749 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:44:22,750 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:44:24,751 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:44:25,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:44:25,110 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:44:26,752 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:44:28,753 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:44:30,754 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:44:32,755 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:44:34,756 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:44:36,757 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:44:39,759 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:44:40,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:44:40,480 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:44:41,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:44:43,761 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:44:45,761 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:44:47,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:44:49,763 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:44:50,168 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:44:51,764 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:44:53,765 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:44:55,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:44:55,702 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:44:55,765 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:44:57,766 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:44:59,767 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:45:01,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:45:03,769 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:45:05,770 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:45:07,771 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:45:09,772 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:45:10,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:45:10,995 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:45:11,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:45:13,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:45:15,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:45:17,775 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:45:19,776 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:45:20,240 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:45:21,777 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:45:23,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:45:25,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:45:26,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:45:26,229 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:45:27,779 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:45:29,780 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:45:31,781 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:45:33,782 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:45:35,782 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:45:37,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:45:39,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:45:41,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:45:41,535 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:45:41,785 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:45:43,785 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:45:45,786 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:45:47,787 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:45:49,788 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:45:50,318 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:45:52,789 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:45:54,790 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:45:56,791 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:45:56,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:45:56,858 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:45:58,792 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:46:00,792 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:46:02,793 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:46:04,794 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:46:06,795 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:46:08,795 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:46:10,796 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:46:12,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:46:12,225 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:46:12,797 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:46:14,798 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:46:16,799 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:46:18,800 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:46:20,389 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:46:20,801 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:46:22,802 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:46:24,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:46:26,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:46:27,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:46:27,530 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:46:28,804 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:46:30,805 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:46:32,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:46:34,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:46:36,807 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:46:38,808 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:46:40,809 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:46:42,810 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:46:42,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:46:42,867 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:46:44,811 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:46:46,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:46:48,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:46:50,464 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:46:50,813 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:46:52,814 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:46:54,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:46:56,816 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:46:58,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:46:58,130 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:46:58,817 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:47:00,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:47:02,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:47:04,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:47:06,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:47:09,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:47:11,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:47:13,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:47:13,422 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:47:13,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:47:15,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:47:17,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:47:19,826 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:47:20,539 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:47:21,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:47:23,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:47:25,829 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:47:27,829 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:47:28,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:47:28,708 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:47:29,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:47:31,831 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:47:33,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:47:35,833 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:47:37,834 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:47:39,834 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:47:41,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:47:43,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:47:44,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:47:44,125 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:47:45,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:47:47,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:47:49,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:47:50,615 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:47:51,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:47:53,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:47:55,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:47:57,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:47:59,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:47:59,355 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:47:59,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:48:01,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:48:03,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:48:05,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:48:07,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:48:09,846 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:48:11,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:48:13,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:48:14,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:48:14,647 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:48:15,849 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:48:17,850 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:48:19,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:48:20,690 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:48:21,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:48:23,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:48:25,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:48:27,854 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:48:29,854 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:48:29,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:48:29,876 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:48:31,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:48:33,856 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:48:35,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:48:37,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:48:39,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:48:42,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:48:44,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:48:45,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:48:45,281 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:48:46,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:48:48,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:48:50,766 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:48:50,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:48:52,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:48:54,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:48:56,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:48:58,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:49:00,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:49:00,630 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:49:00,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:49:02,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:49:04,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:49:06,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:49:08,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:49:10,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:49:12,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:49:14,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:49:15,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:49:15,880 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:49:16,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:49:18,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:49:20,840 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:49:20,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:49:22,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:49:24,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:49:26,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:49:28,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:49:30,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:49:31,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:49:31,269 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:49:32,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:49:34,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:49:36,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:49:38,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:49:40,883 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:49:42,883 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:49:44,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:49:46,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:49:46,564 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:49:46,885 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:49:48,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:49:50,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:49:50,915 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:49:52,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:49:54,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:49:56,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:49:58,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:50:00,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:50:01,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:50:01,788 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:50:02,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:50:04,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:50:06,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:50:08,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:50:10,894 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:50:12,894 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:50:14,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:50:16,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:50:17,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:50:17,037 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:50:18,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:50:20,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:50:20,990 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:50:22,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:50:24,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:50:26,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:50:28,900 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:50:30,901 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:50:32,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:50:32,368 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:50:33,902 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:50:35,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:50:37,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:50:39,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:50:41,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:50:43,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:50:45,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:50:47,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:50:47,661 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:50:47,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:50:49,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:50:51,064 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:50:51,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:50:53,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:50:55,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:50:57,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:50:59,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:51:01,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:51:03,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:51:03,079 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:51:03,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:51:05,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:51:07,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:51:09,916 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:51:11,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:51:13,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:51:15,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:51:17,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:51:18,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:51:18,329 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:51:19,922 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:51:21,135 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:51:21,922 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:51:23,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:51:25,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:51:27,925 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:51:29,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:51:31,927 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:51:33,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:51:33,653 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:51:33,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:51:35,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:51:37,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:51:39,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:51:41,932 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:51:43,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:51:45,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:51:47,935 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:51:49,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:51:49,024 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:51:49,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:51:51,211 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:51:51,937 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:51:53,938 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:51:56,939 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:51:58,940 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:52:00,941 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:52:02,942 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:52:04,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:52:04,256 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:52:04,943 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:52:06,944 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:52:08,945 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:52:10,946 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:52:12,947 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:52:14,948 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:52:16,949 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:52:18,950 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:52:19,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:52:19,482 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:52:20,951 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:52:21,288 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:52:22,952 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:52:24,953 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:52:26,954 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:52:28,955 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:52:30,956 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:52:32,957 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:52:34,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:52:34,706 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:52:34,957 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:52:36,958 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:52:38,959 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:52:40,960 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:52:42,961 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:52:44,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:52:46,963 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:52:48,964 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:52:49,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:52:49,927 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:52:50,965 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:52:51,366 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:52:52,966 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:52:54,966 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:52:56,967 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:52:58,968 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:53:00,969 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:53:02,969 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:53:04,970 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:53:05,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:53:05,245 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:53:06,971 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:53:08,972 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:53:10,973 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:53:12,973 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:53:14,974 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:53:16,975 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:53:18,976 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:53:20,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:53:20,471 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:53:20,977 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:53:21,439 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:53:22,978 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:53:24,979 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:53:26,979 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:53:28,980 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:53:30,981 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:53:32,982 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:53:35,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:53:35,687 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:53:35,983 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:53:37,984 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:53:39,985 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:53:41,986 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:53:43,987 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:53:45,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:53:47,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:53:49,989 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:53:50,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:53:50,952 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:53:51,513 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:53:51,990 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:53:53,991 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:53:55,992 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:53:57,993 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:53:59,993 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:54:01,994 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:54:03,995 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:54:05,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:54:06,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:54:06,177 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:54:07,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:54:09,997 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:54:11,998 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:54:13,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:54:15,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:54:18,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:54:20,001 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:54:21,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:54:21,429 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:54:21,651 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:54:22,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:54:24,003 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:54:26,004 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:54:28,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:54:30,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:54:32,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:54:34,007 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:54:36,008 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:54:36,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:54:36,784 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:54:38,009 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:54:40,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:54:42,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:54:44,012 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:54:46,012 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:54:48,013 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:54:50,014 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:54:51,660 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:54:52,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:54:52,006 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:54:52,015 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:54:54,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:54:56,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:54:59,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:55:01,019 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:55:03,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:55:05,021 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:55:07,021 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:55:07,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:55:07,512 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:55:09,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:55:11,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:55:13,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:55:15,025 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:55:17,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:55:19,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:55:21,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:55:21,737 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:55:22,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:55:22,846 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:55:23,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:55:25,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:55:27,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:55:29,031 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:55:31,032 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:55:33,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:55:35,034 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:55:37,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:55:38,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:55:38,111 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:55:39,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:55:41,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:55:43,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:55:45,038 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:55:47,039 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:55:49,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:55:51,041 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:55:51,814 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:55:53,041 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:55:53,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:55:53,332 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:55:55,042 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:55:57,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:55:59,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:56:01,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:56:03,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:56:05,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:56:07,047 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:56:08,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:56:08,660 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:56:09,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:56:11,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:56:13,049 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:56:15,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:56:17,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:56:19,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:56:21,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:56:21,888 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:56:23,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:56:23,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:56:23,964 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:56:25,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:56:27,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:56:29,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:56:31,056 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:56:33,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:56:35,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:56:37,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:56:39,059 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:56:39,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:56:39,252 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:56:42,060 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:56:44,061 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:56:46,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:56:48,063 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:56:50,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:56:51,961 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:56:52,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:56:54,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:56:54,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:56:54,668 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:56:56,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:56:58,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:57:00,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:57:02,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:57:04,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:57:06,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:57:08,071 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:57:09,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:57:09,953 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:57:10,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:57:12,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:57:14,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:57:16,074 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:57:18,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:57:20,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:57:22,056 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:57:22,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:57:24,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:57:25,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:57:25,178 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:57:26,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:57:28,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:57:30,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:57:32,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:57:34,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:57:36,081 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:57:38,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:57:40,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:57:40,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:57:40,396 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:57:42,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:57:44,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:57:46,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:57:48,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:57:50,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:57:52,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:57:52,110 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:57:54,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:57:55,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:57:55,820 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:57:56,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:57:58,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:58:00,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:58:02,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:58:04,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:58:06,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:58:08,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:58:10,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:58:11,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:58:11,044 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:58:12,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:58:14,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:58:16,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:58:18,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:58:20,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:58:22,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:58:22,184 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:58:24,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:58:26,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:58:26,313 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:58:27,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:58:29,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:58:31,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:58:33,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:58:35,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:58:37,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:58:39,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:58:41,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:58:41,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:58:41,539 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:58:43,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:58:45,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:58:47,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:58:49,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:58:51,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:58:52,258 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:58:53,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:58:55,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:58:56,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:58:56,870 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:58:57,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:58:59,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:59:01,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:59:03,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:59:05,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:59:07,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:59:09,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:59:11,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:59:12,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:59:12,173 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:59:13,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:59:15,121 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:59:17,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:59:19,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:59:21,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:59:22,334 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:59:23,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:59:25,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:59:27,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:59:27,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:59:27,398 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:59:29,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:59:31,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:59:33,128 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:59:35,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:59:37,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:59:39,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:59:41,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:59:42,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:59:42,734 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:59:43,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:59:45,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:59:47,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:59:49,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:59:51,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:59:52,409 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 04:59:53,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:59:55,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 04:59:57,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 04:59:57,957 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 04:59:58,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:00:00,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:00:02,140 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:00:04,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:00:06,142 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:00:08,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:00:10,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:00:12,145 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:00:13,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:00:13,275 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:00:14,146 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:00:16,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:00:18,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:00:20,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:00:22,150 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:00:22,484 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:00:24,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:00:26,152 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:00:28,153 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:00:28,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:00:28,562 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:00:30,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:00:32,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:00:34,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:00:36,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:00:38,157 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:00:40,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:00:42,159 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:00:43,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:00:43,959 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:00:44,160 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:00:46,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:00:48,162 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:00:50,163 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:00:52,164 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:00:52,559 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:00:54,165 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:00:56,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:00:58,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:00:59,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:00:59,204 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:01:00,168 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:01:02,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:01:04,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:01:06,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:01:08,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:01:10,172 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:01:12,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:01:14,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:01:14,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:01:14,652 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:01:16,175 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:01:18,176 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:01:20,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:01:22,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:01:22,633 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:01:25,179 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:01:27,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:01:29,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:01:29,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:01:29,976 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:01:31,182 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:01:33,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:01:35,184 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:01:37,185 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:01:39,186 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:01:41,187 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:01:43,188 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:01:45,189 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:01:45,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:01:45,203 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:01:47,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:01:49,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:01:51,191 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:01:52,705 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:01:53,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:01:55,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:01:57,194 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:01:59,195 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:02:00,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:02:00,508 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:02:01,195 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:02:03,196 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:02:05,197 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:02:07,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:02:09,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:02:11,199 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:02:13,200 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:02:15,200 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:02:15,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:02:15,761 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:02:17,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:02:19,202 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:02:21,202 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:02:22,777 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:02:23,203 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:02:25,204 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:02:27,205 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:02:29,206 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:02:31,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:02:31,054 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:02:31,206 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:02:33,207 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:02:35,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:02:37,209 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:02:39,210 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:02:41,210 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:02:43,211 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:02:45,212 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:02:46,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:02:46,279 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:02:47,212 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:02:49,213 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:02:51,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:02:52,856 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:02:53,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:02:55,215 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:02:57,216 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:03:00,217 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:03:01,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:03:01,612 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:03:02,217 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:03:04,218 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:03:06,219 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:03:08,219 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:03:10,220 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:03:12,221 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:03:14,221 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:03:16,222 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:03:16,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:03:16,835 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:03:18,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:03:20,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:03:22,224 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:03:22,931 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:03:24,225 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:03:26,225 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:03:28,226 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:03:30,227 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:03:32,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:03:32,097 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:03:32,227 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:03:34,228 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:03:36,229 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:03:38,229 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:03:40,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:03:42,231 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:03:44,231 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:03:46,232 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:03:47,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:03:47,433 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:03:48,233 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:03:50,234 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:03:52,235 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:03:53,004 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:03:54,235 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:03:56,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:03:58,237 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:04:00,238 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:04:02,238 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:04:02,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:04:02,692 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:04:04,239 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:04:06,240 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:04:08,241 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:04:10,241 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:04:12,242 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:04:15,244 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:04:17,245 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:04:17,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:04:17,916 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:04:19,246 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:04:21,247 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:04:23,080 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:04:23,248 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:04:25,248 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:04:27,249 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:04:29,250 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:04:31,251 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:04:33,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:04:33,140 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:04:33,252 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:04:35,253 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:04:37,254 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:04:39,255 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:04:41,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:04:43,257 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:04:45,258 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:04:47,259 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:04:48,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:04:48,525 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:04:49,260 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:04:51,260 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:04:53,158 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:04:53,261 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:04:55,262 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:04:57,263 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:04:59,264 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:05:01,265 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:05:03,266 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:05:03,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:05:03,877 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:05:05,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:05:07,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:05:09,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:05:11,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:05:13,270 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:05:15,271 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:05:17,272 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:05:19,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:05:19,102 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:05:19,273 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:05:21,274 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:05:23,232 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:05:23,275 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:05:25,276 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:05:27,277 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:05:30,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:05:32,279 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:05:34,279 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:05:34,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:05:34,424 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:05:36,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:05:38,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:05:40,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:05:42,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:05:44,283 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:05:46,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:05:48,285 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:05:49,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:05:49,733 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:05:50,286 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:05:52,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:05:53,306 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:05:54,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:05:56,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:05:58,290 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:06:00,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:06:02,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:06:05,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:06:05,071 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:06:20,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:06:20,322 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:06:23,383 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:06:35,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:06:35,587 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:06:50,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:06:50,857 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:06:53,456 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:07:00,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:07:00,682 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 05:07:00,736 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 05:07:00,817 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 05:07:01,313 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 05:07:02,314 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:07:06,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:07:06,154 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:07:10,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:07:21,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:07:21,410 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:07:23,542 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:07:30,326 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:07:36,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:07:36,698 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:07:51,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:07:51,920 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:07:53,620 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:08:07,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:08:07,143 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:08:22,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:08:22,367 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:08:23,696 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:08:37,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:08:37,608 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:08:52,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:08:52,823 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:08:53,774 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:09:08,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:09:08,051 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:09:23,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:09:23,278 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:09:23,850 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:09:38,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:09:38,504 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:09:53,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:09:53,727 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:09:53,989 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:10:08,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:10:08,992 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:10:24,003 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:10:24,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:10:24,218 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:10:39,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:10:39,445 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:10:54,081 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:10:54,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:10:54,669 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:11:09,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:11:09,895 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:11:24,161 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:11:25,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:11:25,142 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:11:26,429 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:11:27,429 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:11:29,430 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:11:33,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:33,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:33,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:33,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:33,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:33,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:33,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:33,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:33,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:33,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:33,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:33,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:33,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:33,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:33,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:33,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:36,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:36,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:36,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:36,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:36,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:36,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:36,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:36,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:36,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:36,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:36,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:36,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:36,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:36,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:36,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:36,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:39,434 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:11:40,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:11:40,505 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:11:41,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:41,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:41,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:41,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:41,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:41,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:41,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:41,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:41,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:41,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:41,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:41,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:41,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:41,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:41,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:41,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:44,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:44,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:44,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:44,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:44,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:44,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:44,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:44,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:44,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:44,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:44,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:44,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:44,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:44,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:44,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:44,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:45,436 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:11:46,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:46,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:46,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:46,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:46,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:46,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:46,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:46,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:46,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:46,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:46,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:46,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:46,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:46,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:46,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:46,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:49,437 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:11:53,439 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:11:53,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:53,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:53,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:53,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:53,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:53,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:53,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:53,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:53,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:53,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:53,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:53,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:53,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:53,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:53,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:53,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:54,238 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:11:55,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:55,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:55,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:55,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:55,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:55,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:55,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:55,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:55,440 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:11:55,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:55,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:55,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:55,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:55,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:55,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:55,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:55,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:11:55,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:11:55,725 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:11:59,442 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:12:03,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:12:04,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:04,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:04,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:04,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:04,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:04,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:04,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:04,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:04,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:04,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:04,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:04,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:04,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:04,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:04,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:04,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:04,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:04,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:04,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:04,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:04,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:04,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:04,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:04,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:04,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:04,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:04,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:04,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:04,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:04,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:04,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:04,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:06,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:06,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:06,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:06,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:06,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:06,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:06,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:06,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:06,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:06,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:06,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:06,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:06,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:06,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:06,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:06,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:07,445 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:12:09,446 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:12:09,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:09,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:09,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:09,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:09,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:09,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:09,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:09,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:09,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:09,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:09,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:09,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:09,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:09,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:09,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:09,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:10,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:12:10,947 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:12:12,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:12,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:12,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:12,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:12,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:12,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:12,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:12,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:12,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:12,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:12,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:12,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:12,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:12,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:12,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:12,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:13,448 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:12:15,449 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:12:15,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:15,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:15,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:15,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:15,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:15,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:15,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:15,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:15,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:15,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:15,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:15,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:15,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:15,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:15,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:15,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:18,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:18,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:18,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:18,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:18,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:18,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:18,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:18,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:18,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:18,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:18,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:18,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:18,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:18,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:18,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:18,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:19,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:12:20,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:20,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:20,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:20,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:20,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:20,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:20,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:20,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:20,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:20,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:20,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:20,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:20,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:20,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:20,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:20,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:20,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:20,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:20,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:20,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:20,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:20,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:20,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:20,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:20,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:20,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:20,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:20,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:20,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:20,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:20,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:20,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:21,451 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:12:23,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:23,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:23,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:23,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:23,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:23,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:23,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:23,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:23,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:23,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:23,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:23,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:23,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:23,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:23,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:23,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:24,308 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:12:25,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:12:26,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:12:26,174 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:12:26,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:26,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:26,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:26,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:26,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:26,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:26,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:26,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:26,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:26,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:26,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:26,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:26,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:26,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:26,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:26,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:27,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:12:27,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:27,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:27,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:27,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:27,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:27,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:27,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:27,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:27,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:27,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:27,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:27,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:27,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:27,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:27,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:27,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:27,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:27,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:27,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:27,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:27,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:27,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:27,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:27,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:27,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:27,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:27,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:27,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:27,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:27,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:27,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:27,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:30,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:30,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:30,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:30,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:30,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:30,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:30,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:30,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:30,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:30,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:30,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:30,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:30,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:30,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:30,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:30,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:30,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:30,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:30,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:30,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:30,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:30,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:30,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:30,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:30,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:30,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:30,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:30,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:30,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:30,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:30,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:30,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:31,455 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:12:33,456 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:12:35,456 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:12:37,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:12:38,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:38,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:38,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:38,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:38,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:38,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:38,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:38,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:38,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:38,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:38,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:38,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:38,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:38,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:38,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:38,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:40,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:40,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:40,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:40,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:40,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:40,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:40,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:40,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:40,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:40,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:40,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:40,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:40,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:40,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:40,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:40,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:41,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:12:41,431 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:12:41,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:12:41,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:41,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:41,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:41,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:41,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:41,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:41,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:41,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:41,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:41,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:41,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:41,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:41,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:41,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:41,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:41,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:42,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:42,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:42,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:42,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:42,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:42,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:42,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:42,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:42,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:42,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:42,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:42,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:42,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:42,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:42,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:42,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:43,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:12:44,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:44,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:44,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:44,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:44,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:44,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:44,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:44,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:44,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:44,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:44,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:44,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:44,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:44,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:44,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:44,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:44,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:44,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:44,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:44,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:44,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:44,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:44,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:44,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:44,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:44,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:44,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:44,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:44,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:44,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:44,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:44,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:45,460 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:12:49,462 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:12:51,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:51,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:51,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:51,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:51,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:51,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:51,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:51,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:51,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:51,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:51,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:51,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:51,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:51,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:51,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:51,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:51,463 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:12:52,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:52,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:52,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:52,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:52,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:52,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:52,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:52,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:52,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:52,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:52,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:52,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:52,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:52,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:52,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:52,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:53,465 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:12:54,383 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:12:55,465 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:12:56,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:56,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:56,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:56,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:56,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:56,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:56,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:56,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:56,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:56,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:56,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:56,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:56,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:56,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:56,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:56,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:56,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:12:56,655 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:12:57,466 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:12:57,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:57,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:57,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:57,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:57,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:57,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:57,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:57,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:57,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:57,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:57,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:57,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:57,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:57,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:57,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:57,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:12:59,467 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:13:00,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:00,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:00,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:00,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:00,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:00,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:00,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:00,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:00,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:00,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:00,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:00,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:00,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:00,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:00,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:00,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:01,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:01,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:01,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:01,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:01,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:01,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:01,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:01,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:01,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:01,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:01,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:01,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:01,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:01,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:01,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:01,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:01,468 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:13:03,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:03,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:03,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:03,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:03,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:03,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:03,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:03,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:03,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:03,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:03,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:03,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:03,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:03,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:03,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:03,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:03,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:13:05,470 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:13:05,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:05,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:05,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:05,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:05,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:05,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:05,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:05,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:05,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:05,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:05,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:05,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:05,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:05,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:05,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:05,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:07,471 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:13:09,471 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:13:11,472 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:13:11,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:13:11,950 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:13:13,473 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:13:15,474 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:13:17,475 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:13:18,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:18,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:18,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:18,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:18,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:18,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:18,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:18,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:18,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:18,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:18,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:18,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:18,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:18,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:18,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:18,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:18,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:18,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:18,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:18,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:18,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:18,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:18,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:18,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:18,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:18,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:18,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:18,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:18,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:18,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:18,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:18,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:20,476 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:13:20,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:20,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:20,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:20,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:20,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:20,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:20,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:20,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:20,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:20,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:20,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:20,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:20,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:20,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:20,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:20,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:20,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:20,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:20,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:20,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:20,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:20,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:20,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:20,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:20,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:20,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:20,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:20,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:20,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:20,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:20,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:20,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:22,477 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:13:23,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:23,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:23,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:23,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:23,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:23,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:23,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:23,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:23,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:23,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:23,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:23,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:23,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:23,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:23,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:23,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:24,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:24,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:24,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:24,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:24,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:24,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:24,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:24,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:24,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:24,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:24,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:24,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:24,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:24,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:24,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:24,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:24,459 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:13:24,477 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:13:26,478 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:13:27,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:13:27,230 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:13:27,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:27,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:28,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:13:30,480 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:13:32,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:32,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:32,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:32,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:32,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:32,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:32,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:32,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:32,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:32,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:32,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:32,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:32,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:32,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:32,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:32,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:35,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:35,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:35,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:35,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:35,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:35,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:35,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:35,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:35,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:35,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:35,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:35,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:35,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:35,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:35,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:35,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:35,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:35,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:36,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:36,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:36,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:36,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:36,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:36,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:36,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:36,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:36,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:36,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:36,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:36,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:36,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:36,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:36,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:36,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:36,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:36,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:36,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:36,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:36,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:36,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:36,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:36,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:36,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:36,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:36,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:36,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:36,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:36,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:38,483 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:13:41,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:41,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:41,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:41,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:41,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:41,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:41,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:41,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:41,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:41,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:41,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:41,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:41,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:41,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:41,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:41,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:42,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:13:42,562 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:13:43,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:43,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:43,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:43,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:43,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:43,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:43,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:43,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:43,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:43,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:43,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:43,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:43,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:43,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:43,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:43,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:44,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:44,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:44,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:44,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:44,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:44,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:44,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:44,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:44,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:44,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:44,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:44,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:44,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:44,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:44,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:44,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:44,485 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:13:48,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:48,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:48,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:48,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:48,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:48,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:48,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:48,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:48,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:48,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:48,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:48,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:48,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:48,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:48,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:48,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:48,487 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:13:52,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:52,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:52,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:52,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:52,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:52,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:52,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:52,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:52,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:52,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:52,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:52,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:52,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:52,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:52,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:52,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:13:52,488 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:13:54,533 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:13:56,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:13:57,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:13:57,922 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:14:00,492 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:14:01,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:01,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:01,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:01,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:01,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:01,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:01,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:01,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:01,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:01,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:01,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:01,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:01,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:01,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:01,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:01,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:04,494 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:14:04,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:04,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:04,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:04,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:04,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:04,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:04,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:04,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:04,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:04,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:04,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:04,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:04,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:04,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:04,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:04,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:04,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:04,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:04,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:04,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:04,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:04,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:04,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:04,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:04,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:04,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:04,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:04,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:04,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:04,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:04,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:04,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:08,495 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:14:10,496 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:14:13,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:14:13,174 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:14:13,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:13,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:14,498 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:14:16,499 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:14:17,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:17,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:17,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:17,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:17,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:17,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:17,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:17,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:17,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:17,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:17,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:17,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:17,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:17,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:17,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:17,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:20,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:20,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:20,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:20,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:20,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:20,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:20,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:20,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:20,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:20,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:20,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:20,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:20,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:20,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:20,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:20,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:20,501 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:14:20,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:20,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:20,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:20,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:20,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:20,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:20,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:20,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:20,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:20,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:20,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:20,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:20,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:20,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:20,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:20,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:22,502 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:14:24,608 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:14:26,504 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:14:27,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:27,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:27,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:27,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:27,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:27,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:27,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:27,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:27,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:27,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:27,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:27,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:27,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:27,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:27,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:27,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:28,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:14:28,404 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:14:28,504 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:14:30,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:30,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:30,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:30,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:30,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:30,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:30,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:30,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:30,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:30,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:30,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:30,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:30,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:30,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:30,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:30,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:30,506 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:14:31,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:31,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:31,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:31,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:31,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:31,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:31,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:31,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:31,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:31,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:31,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:31,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:31,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:31,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:31,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:31,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:32,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:32,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:32,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:32,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:32,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:32,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:32,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:32,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:32,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:32,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:32,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:32,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:32,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:32,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:32,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:32,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:34,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:34,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:34,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:34,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:34,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:34,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:34,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:34,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:34,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:34,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:34,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:34,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:34,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:34,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:34,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:34,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:34,508 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:14:35,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:35,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:35,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:35,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:35,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:35,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:35,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:35,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:35,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:35,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:35,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:35,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:35,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:35,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:35,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:35,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:36,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:36,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:36,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:36,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:36,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:36,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:36,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:36,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:36,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:36,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:36,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:36,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:36,508 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:14:36,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:36,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:36,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:36,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:38,509 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:14:38,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:38,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:38,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:38,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:38,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:38,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:38,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:38,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:38,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:38,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:38,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:38,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:38,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:38,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:38,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:38,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:40,510 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:14:42,511 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:14:42,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:42,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:42,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:42,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:42,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:42,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:42,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:42,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:42,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:42,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:42,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:42,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:42,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:42,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:42,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:42,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:43,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:43,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:43,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:43,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:43,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:43,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:43,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:43,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:43,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:43,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:43,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:43,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:43,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:43,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:43,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:43,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:43,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:14:43,630 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:14:44,512 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:14:45,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:45,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:45,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:45,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:45,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:45,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:45,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:45,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:45,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:45,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:45,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:45,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:45,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:45,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:45,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:45,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:48,514 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:14:49,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:49,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:49,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:49,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:49,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:49,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:49,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:49,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:49,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:49,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:49,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:49,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:49,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:49,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:49,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:49,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:49,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:49,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:49,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:49,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:49,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:49,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:49,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:49,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:49,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:49,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:49,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:49,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:49,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:49,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:49,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:49,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:50,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:14:51,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:51,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:51,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:51,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:51,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:51,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:51,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:51,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:51,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:51,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:51,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:51,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:51,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:51,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:51,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:51,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:51,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:51,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:51,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:51,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:51,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:51,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:51,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:51,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:51,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:51,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:51,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:51,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:51,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:51,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:51,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:51,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:52,516 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:14:54,517 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:14:54,682 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:14:56,517 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:14:56,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:56,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:56,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:56,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:56,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:56,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:56,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:56,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:56,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:56,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:56,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:56,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:56,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:56,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:56,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:56,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:57,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:57,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:57,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:57,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:57,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:57,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:57,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:57,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:57,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:57,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:57,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:57,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:57,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:57,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:57,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:57,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:14:58,518 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:14:58,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:14:58,852 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:15:00,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:15:02,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:02,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:02,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:02,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:02,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:02,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:02,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:02,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:02,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:02,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:02,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:02,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:02,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:02,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:02,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:02,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:02,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:15:03,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:03,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:03,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:03,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:03,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:03,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:03,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:03,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:03,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:03,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:03,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:03,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:03,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:03,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:03,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:03,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,521 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:15:04,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:04,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:05,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:05,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:05,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:05,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:05,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:05,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:05,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:05,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:06,522 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:15:08,524 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:15:11,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:15:13,526 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:15:14,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:15:14,107 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:15:15,527 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:15:17,528 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:15:19,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:19,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:19,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:15:19,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:19,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:19,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:19,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:19,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:19,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:19,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:19,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:19,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:19,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:19,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:19,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:19,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:19,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:21,530 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:15:21,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:21,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:21,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:21,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:21,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:21,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:21,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:21,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:21,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:21,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:21,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:21,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:21,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:21,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:21,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:21,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:21,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:21,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:21,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:21,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:21,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:21,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:21,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:21,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:21,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:21,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:21,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:21,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:21,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:21,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:21,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:21,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:23,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:15:23,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:23,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:23,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:23,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:23,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:23,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:23,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:23,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:23,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:23,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:23,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:23,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:23,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:23,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:23,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:23,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:24,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:24,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:24,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:24,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:24,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:24,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:24,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:24,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:24,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:24,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:24,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:24,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:24,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:24,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:24,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:24,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:24,758 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:15:25,532 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:15:25,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:25,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:25,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:25,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:25,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:25,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:25,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:25,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:25,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:25,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:25,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:25,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:25,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:25,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:25,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:25,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:26,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:26,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:26,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:26,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:26,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:26,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:26,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:26,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:26,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:26,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:26,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:26,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:26,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:26,839 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 05:15:27,057 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 05:15:27,126 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 05:15:27,532 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 05:15:27,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:15:29,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:15:29,334 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:15:29,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:15:36,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:36,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:36,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:36,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:36,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:36,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:36,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:36,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:36,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:36,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:36,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:36,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:36,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:36,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:36,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:36,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:37,537 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:15:38,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:38,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:38,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:38,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:38,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:38,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:38,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:38,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:38,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:38,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:38,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:38,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:38,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:38,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:38,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:38,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:39,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:39,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:39,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:39,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:39,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:39,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:39,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:39,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:39,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:39,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:39,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:39,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:39,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:39,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:39,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:39,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:41,538 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:15:41,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:41,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:41,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:41,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:41,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:41,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:41,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:41,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:41,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:41,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:41,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:41,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:41,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:41,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:41,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:41,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:41,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:41,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:41,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:41,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:41,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:41,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:41,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:41,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:41,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:41,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:41,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:41,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:41,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:41,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:41,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:41,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:43,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:43,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:43,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:43,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:43,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:43,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:43,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:43,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:43,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:43,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:43,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:43,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:43,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:43,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:43,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:43,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:44,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:15:44,693 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:15:47,541 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:15:47,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:47,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:47,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:47,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:47,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:47,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:47,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:47,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:47,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:47,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:47,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:47,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:47,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:47,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:47,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:47,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:49,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:15:49,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:49,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:49,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:49,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:49,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:49,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:49,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:49,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:49,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:49,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:49,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:49,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:49,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:49,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:49,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:49,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:50,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:50,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:50,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:50,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:50,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:50,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:50,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:50,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:50,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:50,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:50,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:50,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:50,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:50,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:50,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:50,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:51,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:51,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:51,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:51,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:51,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:51,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:51,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:51,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:51,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:51,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:51,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:51,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:51,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:51,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:51,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:51,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:53,544 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:15:55,151 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:15:57,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:57,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:57,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:57,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:57,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:57,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:57,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:57,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:57,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:57,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:57,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:57,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:57,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:57,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:57,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:57,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:15:57,545 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:15:59,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:15:59,966 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:16:01,547 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:16:02,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:02,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:02,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:02,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:02,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:02,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:02,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:02,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:02,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:02,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:02,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:02,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:02,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:02,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:02,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:02,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:05,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:16:07,549 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:16:09,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:09,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:09,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:09,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:09,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:09,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:09,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:09,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:09,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:09,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:09,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:09,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:09,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:09,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:09,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:09,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:11,550 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:16:13,551 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:16:15,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:16:15,307 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:16:16,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:16,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:17,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:16:19,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:16:20,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:20,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:20,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:20,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:20,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:20,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:20,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:20,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:20,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:20,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:20,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:20,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:20,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:20,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:20,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:20,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:21,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:16:21,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:21,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:21,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:21,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:21,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:21,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:21,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:21,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:21,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:21,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:21,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:21,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:21,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:21,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:21,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:21,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:24,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:24,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:24,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:24,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:24,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:24,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:24,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:24,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:24,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:24,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:24,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:24,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:24,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:24,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:24,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:24,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:25,226 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:16:25,556 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:16:27,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:27,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:27,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:27,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:27,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:27,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:27,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:27,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:27,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:27,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:27,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:27,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:27,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:27,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:27,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:27,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:27,557 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:16:29,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:29,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:29,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:29,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:29,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:29,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:29,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:29,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:29,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:29,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:29,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:29,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:29,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:29,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:29,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:29,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:29,558 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:16:30,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:30,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:30,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:30,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:30,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:30,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:30,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:30,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:30,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:30,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:30,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:30,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:30,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:30,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:30,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:30,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:31,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:16:31,841 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:16:33,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:33,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:33,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:33,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:33,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:33,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:33,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:33,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:33,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:33,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:33,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:33,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:33,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:33,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:33,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:33,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:33,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:16:34,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:34,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:34,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:34,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:34,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:34,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:34,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:34,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:34,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:34,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:34,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:34,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:34,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:34,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:34,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:34,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:35,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:35,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:35,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:35,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:35,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:35,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:35,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:35,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:35,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:35,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:35,561 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:16:35,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:35,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:35,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:35,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:35,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:35,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:37,562 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:16:38,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:38,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:38,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:38,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:38,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:38,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:38,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:38,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:38,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:38,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:38,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:38,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:38,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:38,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:38,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:38,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:39,563 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:16:42,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:42,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:42,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:42,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:42,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:42,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:42,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:42,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:42,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:42,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:42,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:42,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:42,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:42,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:42,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:42,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:43,564 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:16:44,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:44,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:44,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:44,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:44,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:44,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:44,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:44,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:44,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:44,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:44,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:44,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:44,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:44,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:44,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:44,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:45,565 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:16:45,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:45,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:45,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:45,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:45,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:45,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:45,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:45,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:45,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:45,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:45,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:45,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:45,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:45,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:45,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:45,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:46,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:46,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:46,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:46,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:46,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:46,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:46,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:46,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:46,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:46,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:46,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:46,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:46,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:46,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:46,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:46,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:47,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:16:47,068 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:16:47,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:16:48,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:48,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:48,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:48,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:48,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:48,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:48,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:48,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:48,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:48,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:48,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:48,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:48,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:48,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:48,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:48,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:48,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:48,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:48,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:48,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:48,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:48,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:48,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:48,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:48,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:48,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:48,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:48,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:48,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:48,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:48,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:48,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:49,567 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:16:51,568 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:16:52,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:52,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:52,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:52,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:52,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:52,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:52,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:52,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:52,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:52,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:52,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:52,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:52,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:52,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:52,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:52,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:53,569 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:16:55,304 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:16:55,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:16:56,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:56,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:56,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:56,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:56,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:56,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:56,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:56,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:56,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:56,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:56,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:56,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:56,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:56,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:56,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:56,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:57,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:16:57,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:57,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:57,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:57,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:57,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:57,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:57,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:57,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:57,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:57,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:57,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:57,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:57,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:57,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:57,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:57,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:16:59,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:17:00,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:00,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:00,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:00,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:00,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:00,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:00,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:00,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:00,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:00,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:00,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:00,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:00,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:00,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:00,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:00,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:01,574 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:17:02,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:17:02,381 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:17:02,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:02,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:02,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:02,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:02,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:02,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:02,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:02,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:02,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:02,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:02,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:02,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:02,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:02,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:02,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:02,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:03,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:17:04,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:04,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:04,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:04,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:04,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:04,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:04,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:04,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:04,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:04,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:04,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:04,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:04,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:04,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:04,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:04,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:05,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:05,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:05,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:05,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:05,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:05,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:05,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:05,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:05,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:05,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:05,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:05,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:05,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:05,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:05,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:05,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:05,576 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:17:05,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:05,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:05,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:05,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:05,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:05,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:05,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:05,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:05,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:05,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:05,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:05,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:05,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:05,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:05,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:05,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:06,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:06,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:06,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:06,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:06,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:06,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:06,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:06,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:06,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:06,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:06,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:06,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:06,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:06,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:06,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:06,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:07,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:17:09,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:17:11,578 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:17:14,579 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:17:16,580 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:17:17,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:17,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:17,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:17,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:17,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:17,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:17,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:17,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:17,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:17,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:17,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:17,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:17,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:17,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:17,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:17,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:17,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:17:17,604 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:17:18,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:17:20,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:17:20,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:20,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:21,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:21,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:21,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:21,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:21,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:21,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:21,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:21,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:21,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:21,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:21,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:21,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:21,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:21,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:21,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:21,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:22,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:22,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:22,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:22,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:22,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:22,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:22,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:22,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:22,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:22,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:22,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:22,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:22,583 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:17:24,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:17:25,379 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:17:32,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:17:32,945 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:17:33,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:33,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:33,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:33,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:33,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:33,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:33,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:33,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:33,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:33,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:33,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:33,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:33,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:33,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:33,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:33,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:34,588 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:17:39,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:39,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:39,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:39,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:39,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:39,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:39,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:39,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:39,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:39,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:39,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:39,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:39,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:39,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:39,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:39,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:40,590 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:17:44,592 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:17:46,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:46,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:46,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:46,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:46,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:46,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:46,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:46,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:46,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:46,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:46,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:46,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:46,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:46,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:46,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:46,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:46,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:46,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:46,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:46,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:46,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:46,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:46,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:46,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:46,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:46,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:46,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:46,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:46,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:46,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:46,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:46,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:48,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:17:48,168 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:17:48,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:48,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:48,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:48,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:48,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:48,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:48,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:48,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:48,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:48,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:48,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:48,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:48,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:48,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:48,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:48,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:48,594 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:17:50,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:50,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:50,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:50,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:50,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:50,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:50,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:50,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:50,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:50,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:50,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:50,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:50,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:50,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:50,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:50,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:52,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:52,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:52,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:52,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:52,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:52,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:52,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:52,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:52,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:52,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:52,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:52,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:52,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:52,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:52,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:52,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:52,595 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:17:55,454 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:17:56,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:56,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:56,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:56,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:56,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:56,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:56,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:56,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:56,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:56,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:56,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:56,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:56,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:56,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:56,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:56,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:56,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:56,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:56,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:56,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:56,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:56,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:56,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:56,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:56,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:56,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:56,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:56,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:56,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:56,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:56,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:56,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:56,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:17:58,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:58,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:58,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:58,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:58,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:58,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:58,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:58,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:58,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:58,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:58,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:58,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:58,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:58,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:58,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:58,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:58,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:58,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:58,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:58,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:58,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:58,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:58,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:58,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:58,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:58,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:58,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:58,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:58,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:58,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:58,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:17:58,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:00,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:00,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:00,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:00,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:00,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:00,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:00,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:00,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:00,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:00,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:00,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:00,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:00,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:00,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:00,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:00,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:00,598 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:18:03,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:18:03,391 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:18:04,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:18:06,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:18:09,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:09,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:09,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:09,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:09,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:09,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:09,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:09,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:09,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:09,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:09,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:09,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:09,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:09,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:09,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:09,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:10,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:18:14,603 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:18:16,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:18:18,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:18:18,670 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:18:18,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:18,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:18,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:18,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:18,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:18,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:18,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:18,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:18,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:18,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:18,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:18,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:18,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:18,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:18,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:18,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:19,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:19,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:19,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:19,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:19,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:19,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:19,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:19,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:19,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:19,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:19,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:19,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:19,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:19,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:19,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:19,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:20,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:20,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:20,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:20,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:20,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:20,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:20,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:20,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:20,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:20,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:20,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:20,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:20,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:20,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:20,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:20,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:20,605 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:18:22,606 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:18:25,527 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:18:26,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:26,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:26,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:26,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:26,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:26,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:26,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:26,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:26,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:26,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:26,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:26,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:26,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:26,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:26,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:26,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:26,607 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:18:27,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:27,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:27,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:27,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:27,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:27,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:27,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:27,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:27,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:27,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:27,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:27,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:27,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:27,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:27,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:27,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:27,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:27,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:27,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:27,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:27,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:27,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:27,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:27,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:27,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:27,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:27,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:27,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:27,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:27,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:27,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:27,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:28,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:28,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:28,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:28,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:28,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:28,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:28,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:28,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:28,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:28,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:28,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:28,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:28,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:28,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:28,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:28,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:28,608 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:18:29,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:29,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:29,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:29,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:29,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:29,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:29,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:29,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:29,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:29,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:29,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:29,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:29,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:29,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:29,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:29,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:32,609 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:18:33,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:18:33,926 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:18:34,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:34,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:34,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:34,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:34,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:34,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:34,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:34,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:34,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:34,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:34,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:34,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:34,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:34,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:34,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:34,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:34,610 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:18:36,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:18:37,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:37,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:37,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:37,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:37,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:37,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:37,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:37,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:37,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:37,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:37,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:37,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:37,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:37,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:37,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:37,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:38,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:38,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:38,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:38,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:38,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:38,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:38,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:38,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:38,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:38,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:38,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:38,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:38,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:38,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:38,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:38,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:38,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:38,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:38,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:38,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:38,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:38,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:38,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:38,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:38,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:38,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:38,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:38,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:38,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:38,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:38,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:38,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:38,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:18:41,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:41,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:41,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:41,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:41,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:41,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:41,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:41,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:41,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:41,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:41,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:41,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:41,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:41,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:41,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:41,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:42,613 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:18:44,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:44,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:44,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:44,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:44,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:44,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:44,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:44,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:44,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:44,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:44,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:44,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:44,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:44,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:44,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:44,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:44,614 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:18:46,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:46,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:46,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:46,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:46,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:46,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:46,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:46,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:46,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:46,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:46,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:46,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:46,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:46,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:46,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:46,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:46,615 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:18:47,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:47,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:47,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:47,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:47,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:47,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:47,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:47,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:47,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:47,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:47,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:47,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:47,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:47,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:47,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:47,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:48,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:18:49,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:18:49,241 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:18:50,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:50,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:50,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:50,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:50,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:50,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:50,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:50,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:50,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:50,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:50,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:50,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:50,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:50,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:50,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:50,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:50,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:50,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:50,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:50,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:50,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:50,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:50,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:50,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:50,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:50,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:50,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:50,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:50,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:50,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:50,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:50,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:50,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:18:51,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:51,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:51,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:51,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:51,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:51,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:51,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:51,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:51,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:51,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:51,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:51,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:51,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:51,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:51,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:51,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:52,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:52,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:52,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:52,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:52,617 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:18:52,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:52,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:52,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:52,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:52,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:52,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:52,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:52,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:52,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:52,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:52,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:52,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:54,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:18:55,592 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:18:56,619 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:18:56,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:56,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:56,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:56,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:56,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:56,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:56,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:56,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:56,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:56,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:56,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:56,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:56,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:56,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:56,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:56,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:58,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:58,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:58,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:58,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:58,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:58,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:58,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:58,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:58,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:58,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:58,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:58,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:58,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:58,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:58,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:58,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:18:58,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:19:00,621 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:19:01,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:01,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:01,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:01,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:01,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:01,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:01,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:01,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:01,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:01,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:01,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:01,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:01,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:01,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:01,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:01,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:02,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:02,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:02,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:02,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:02,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:02,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:02,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:02,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:02,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:02,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:02,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:02,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:02,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:02,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:02,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:02,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:02,622 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:19:04,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:19:04,456 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:19:04,623 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:19:05,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:05,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:05,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:05,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:05,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:05,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:05,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:05,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:05,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:05,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:05,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:05,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:05,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:05,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:05,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:05,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:06,624 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:19:08,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:08,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:08,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:08,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:08,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:08,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:08,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:08,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:08,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:08,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:08,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:08,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:08,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:08,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:08,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:08,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:08,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:19:10,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:10,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:10,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:10,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:10,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:10,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:10,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:10,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:10,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:10,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:10,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:10,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:10,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:10,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:10,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:10,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:10,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:19:11,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:11,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:11,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:11,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:11,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:11,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:11,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:11,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:11,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:11,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:11,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:11,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:11,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:11,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:11,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:11,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:11,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:11,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:11,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:11,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:11,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:11,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:11,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:11,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:11,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:11,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:11,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:11,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:11,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:11,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:11,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:11,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:12,626 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:19:12,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:12,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:12,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:12,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:12,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:12,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:12,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:12,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:12,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:12,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:12,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:12,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:12,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:12,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:12,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:12,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:14,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:19:16,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:19:18,629 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:19:19,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:19:19,783 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:19:20,629 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:19:22,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:22,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:22,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:22,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:22,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:22,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:22,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:22,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:22,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:22,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:22,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:22,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:22,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:22,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:22,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:22,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:22,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:19:23,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:23,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:23,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:23,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:23,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:23,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:23,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:23,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:23,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:23,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:23,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:23,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:23,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:23,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:23,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:23,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:24,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:24,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:24,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:24,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:24,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:24,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:24,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:24,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:24,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:24,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:24,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:24,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:24,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:24,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:24,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:24,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:24,631 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:19:25,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:25,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:25,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:25,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:25,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:25,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:25,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:25,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:25,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:25,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:25,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:25,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:25,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:25,587 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 05:19:25,815 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 05:19:25,928 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 05:19:25,931 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:19:26,739 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 05:19:26,740 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:19:34,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:34,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:34,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:34,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:34,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:34,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:34,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:34,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:34,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:34,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:34,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:34,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:34,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:34,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:34,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:34,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:35,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:19:35,037 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:19:36,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:19:37,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:37,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:37,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:37,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:37,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:37,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:37,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:37,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:37,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:37,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:37,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:37,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:37,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:37,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:37,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:37,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:39,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:39,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:39,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:39,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:39,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:39,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:39,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:39,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:39,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:39,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:39,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:39,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:39,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:39,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:39,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:39,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:42,745 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:19:46,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:46,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:46,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:46,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:46,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:46,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:46,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:46,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:46,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:46,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:46,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:46,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:46,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:46,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:46,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:46,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:46,747 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:19:50,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:19:50,259 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:19:50,748 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:19:51,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:51,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:51,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:51,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:51,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:51,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:51,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:51,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:51,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:51,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:51,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:51,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:51,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:51,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:51,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:51,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:54,749 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:19:55,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:55,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:55,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:55,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:55,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:55,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:55,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:55,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:55,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:55,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:55,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:55,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:55,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:55,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:55,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:55,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:56,004 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:19:57,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:57,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:57,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:57,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:57,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:57,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:57,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:57,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:57,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:57,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:57,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:57,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:57,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:57,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:57,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:57,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:57,751 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:19:59,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:59,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:59,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:59,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:59,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:59,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:59,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:59,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:59,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:59,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:59,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:59,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:59,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:59,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:59,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:19:59,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:00,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:00,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:00,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:00,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:00,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:00,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:00,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:00,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:00,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:00,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:00,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:00,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:00,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:00,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:00,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:00,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:00,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:00,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:00,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:00,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:00,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:00,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:00,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:00,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:00,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:00,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:00,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:00,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:00,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:00,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:00,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:00,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:01,752 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:20:02,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:02,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:02,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:02,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:02,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:02,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:02,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:02,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:02,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:02,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:02,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:02,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:02,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:02,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:02,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:02,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:04,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:04,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:04,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:04,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:04,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:04,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:04,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:04,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:04,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:04,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:04,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:04,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:04,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:04,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:04,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:04,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:05,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:20:05,482 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:20:05,755 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:20:07,756 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:20:08,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:08,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:08,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:08,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:08,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:08,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:08,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:08,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:08,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:08,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:08,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:08,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:08,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:08,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:08,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:08,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:10,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:10,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:10,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:10,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:10,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:10,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:10,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:10,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:10,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:10,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:10,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:10,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:10,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:10,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:10,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:10,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:11,757 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:20:13,758 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:20:17,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:20:17,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:17,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:17,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:17,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:17,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:17,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:17,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:17,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:17,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:17,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:17,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:17,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:17,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:17,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:17,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:17,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:19,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:20:20,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:20:20,740 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:20:23,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:20:24,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:24,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:24,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:24,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:24,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:24,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:24,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:24,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:24,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:24,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:24,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:24,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:24,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:24,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:24,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:24,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:25,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:25,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:25,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:25,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:25,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:25,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:25,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:25,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:25,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:25,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:25,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:25,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:25,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:25,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:25,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:25,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:25,763 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:20:26,078 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:20:27,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:27,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:27,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:27,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:27,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:27,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:27,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:27,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:27,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:27,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:27,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:27,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:27,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:27,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:27,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:27,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:27,764 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:20:28,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:28,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:28,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:28,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:28,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:28,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:28,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:28,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:28,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:28,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:28,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:28,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:28,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:28,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:28,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:28,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:31,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:31,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:31,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:31,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:31,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:31,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:31,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:31,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:31,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:31,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:31,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:31,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:31,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:31,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:31,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:31,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:31,765 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:20:33,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:33,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:33,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:33,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:33,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:33,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:33,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:33,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:33,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:33,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:33,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:33,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:33,766 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:20:33,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:33,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:33,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:33,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:35,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:35,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:35,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:35,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:35,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:35,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:35,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:35,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:35,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:35,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:35,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:35,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:35,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:35,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:35,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:35,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:35,767 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:20:35,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:20:35,963 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:20:37,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:20:39,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:20:40,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:40,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:40,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:40,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:40,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:40,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:40,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:40,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:40,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:40,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:40,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:40,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:40,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:40,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:40,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:40,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:41,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:41,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:41,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:41,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:41,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:41,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:41,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:41,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:41,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:41,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:41,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:41,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:41,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:41,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:41,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:41,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:42,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:42,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:42,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:42,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:42,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:42,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:42,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:42,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:42,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:42,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:42,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:42,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:42,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:42,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:42,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:42,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:43,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:43,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:43,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:43,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:43,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:43,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:43,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:43,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:43,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:43,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:43,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:43,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:43,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:43,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:43,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:43,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:43,770 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:20:44,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:44,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:44,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:44,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:44,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:44,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:44,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:44,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:44,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:44,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:44,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:44,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:44,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:44,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:44,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:44,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:45,771 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:20:47,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:47,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:47,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:47,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:47,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:47,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:47,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:47,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:47,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:47,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:47,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:47,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:47,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:47,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:47,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:47,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:47,772 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:20:47,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:47,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:47,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:47,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:47,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:47,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:47,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:47,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:47,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:47,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:47,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:47,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:47,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:47,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:47,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:47,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:49,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:49,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:49,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:49,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:49,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:49,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:49,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:49,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:49,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:49,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:49,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:49,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:49,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:49,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:49,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:49,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:49,772 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:20:51,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:51,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:51,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:51,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:51,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:51,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:51,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:51,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:51,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:51,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:51,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:51,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:51,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:51,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:51,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:51,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:51,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:20:51,191 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:20:51,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:20:52,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:52,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:52,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:52,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:52,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:52,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:52,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:52,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:52,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:52,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:52,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:52,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:52,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:52,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:52,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:52,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:52,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:52,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:52,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:52,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:52,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:52,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:52,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:52,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:52,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:52,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:52,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:52,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:52,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:52,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:52,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:52,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:53,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:20:54,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:54,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:54,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:54,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:54,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:54,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:54,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:54,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:54,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:54,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:54,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:54,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:54,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:54,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:54,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:54,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:55,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:55,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:55,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:55,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:55,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:55,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:55,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:55,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:55,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:55,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:55,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:55,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:55,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:55,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:55,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:55,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:20:55,775 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:20:56,154 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:20:57,776 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:20:59,777 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:21:00,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:00,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:00,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:00,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:00,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:00,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:00,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:00,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:00,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:00,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:00,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:00,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:00,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:00,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:00,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:00,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:01,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:21:01,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:01,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:02,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:02,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:02,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:02,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:02,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:02,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:02,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:02,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:02,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:02,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:02,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:02,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:02,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:02,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:03,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:03,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:03,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:03,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:03,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:03,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:03,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:03,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:03,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:03,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:03,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:03,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:03,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:03,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:03,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:03,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:03,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:03,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:03,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:03,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:03,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:03,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:03,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:03,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:03,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:03,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:03,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:03,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:03,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:03,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:03,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:03,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:03,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:21:05,779 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:21:06,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:21:06,464 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:21:07,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:07,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:07,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:07,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:07,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:07,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:07,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:07,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:07,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:07,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:07,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:07,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:07,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:07,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:07,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:07,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:07,780 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:21:09,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:09,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:09,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:09,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:09,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:09,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:09,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:09,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:09,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:09,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:09,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:09,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:09,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:09,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:09,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:09,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:09,781 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:21:11,782 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:21:11,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:11,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:11,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:11,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:11,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:11,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:11,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:11,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:11,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:11,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:11,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:11,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:11,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:11,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:11,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:11,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:12,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:12,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:12,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:12,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:12,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:12,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:12,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:12,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:12,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:12,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:12,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:12,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:12,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:12,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:12,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:12,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:13,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:13,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:13,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:13,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:13,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:13,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:13,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:13,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:13,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:13,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:13,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:13,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:13,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:13,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:13,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:13,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:13,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:21:15,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:15,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:15,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:15,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:15,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:15,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:15,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:15,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:15,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:15,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:15,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:15,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:15,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:15,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:15,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:15,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:15,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:21:17,785 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:21:19,786 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:21:21,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:21:21,684 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:21:21,787 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:21:23,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:23,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:23,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:23,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:23,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:23,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:23,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:23,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:23,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:23,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:23,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:23,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:23,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:23,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:23,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:23,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:23,787 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:21:24,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:24,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:24,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:24,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:24,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:24,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:24,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:24,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:24,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:24,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:24,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:24,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:25,789 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:21:26,229 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:21:32,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:32,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:32,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:32,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:32,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:32,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:32,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:32,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:32,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:32,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:32,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:32,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:32,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:32,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:32,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:32,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:33,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:33,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:33,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:33,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:33,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:33,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:33,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:33,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:33,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:33,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:33,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:33,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:33,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:33,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:33,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:33,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:35,792 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:21:37,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:21:37,119 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:21:39,794 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:21:42,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:42,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:42,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:42,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:42,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:42,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:42,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:42,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:42,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:42,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:42,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:42,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:42,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:42,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:42,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:42,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:45,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:45,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:45,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:45,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:45,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:45,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:45,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:45,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:45,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:45,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:45,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:45,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:45,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:45,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:45,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:45,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:46,797 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:21:50,798 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:21:50,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:50,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:50,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:50,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:50,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:50,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:50,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:50,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:50,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:50,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:50,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:50,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:50,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:50,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:50,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:50,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:50,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:50,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:50,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:50,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:50,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:50,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:50,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:50,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:50,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:50,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:50,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:50,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:50,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:50,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:50,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:50,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:52,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:21:52,542 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:21:52,799 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:21:56,303 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:21:56,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:56,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:56,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:56,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:56,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:56,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:56,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:56,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:56,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:56,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:56,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:56,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:56,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:56,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:56,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:56,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:21:56,801 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:22:00,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:00,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:00,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:00,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:00,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:00,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:00,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:00,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:00,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:00,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:00,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:00,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:00,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:00,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:00,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:00,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:00,802 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:22:03,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:03,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:03,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:03,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:03,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:03,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:03,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:03,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:03,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:03,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:03,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:03,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:03,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:03,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:03,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:03,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:04,804 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:22:04,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:04,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:04,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:04,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:04,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:04,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:04,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:04,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:04,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:04,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:04,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:04,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:04,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:04,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:04,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:04,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:06,804 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:22:06,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:06,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:06,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:06,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:06,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:06,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:06,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:06,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:06,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:06,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:06,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:06,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:06,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:06,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:06,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:06,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:07,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:22:07,767 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:22:08,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:08,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:08,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:08,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:08,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:08,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:08,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:08,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:08,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:08,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:08,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:08,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:08,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:08,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:08,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:08,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:09,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:09,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:09,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:09,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:09,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:09,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:09,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:09,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:09,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:09,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:09,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:09,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:09,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:09,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:09,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:09,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:10,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:22:11,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:11,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:11,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:11,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:11,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:11,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:11,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:11,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:11,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:11,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:11,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:11,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:11,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:11,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:11,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:11,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:11,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:11,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:11,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:11,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:11,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:11,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:11,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:11,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:11,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:11,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:11,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:11,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:11,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:11,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:11,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:11,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:12,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:22:16,808 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:22:18,809 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:22:19,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:19,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:19,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:19,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:19,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:19,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:19,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:19,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:19,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:19,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:19,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:19,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:19,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:19,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:19,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:19,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:22,811 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:22:22,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:22,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:22,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:22,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:22,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:22,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:22,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:22,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:22,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:22,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:22,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:22,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:22:22,989 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:22:22,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:22,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:22,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:22,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:22,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:24,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:22:26,380 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:22:26,813 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:22:28,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:28,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:28,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:28,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:28,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:28,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:28,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:28,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:28,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:28,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:28,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:28,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:28,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:28,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:28,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:28,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:28,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:28,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:28,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:28,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:28,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:28,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:28,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:28,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:28,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:28,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:28,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:28,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:28,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:28,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:28,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:28,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:30,814 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:22:32,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:22:33,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:33,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:33,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:33,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:33,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:33,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:33,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:33,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:33,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:33,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:33,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:33,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:33,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:33,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:33,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:33,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:34,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:34,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:34,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:34,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:34,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:34,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:34,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:34,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:34,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:34,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:34,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:34,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:34,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:34,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:34,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:34,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:34,816 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:22:35,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:35,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:35,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:35,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:35,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:35,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:35,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:35,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:35,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:35,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:35,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:35,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:35,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:35,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:35,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:35,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:38,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:22:38,230 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:22:38,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:38,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:38,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:38,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:38,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:38,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:38,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:38,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:38,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:38,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:38,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:38,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:38,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:38,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:38,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:38,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:38,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:22:39,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:39,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:39,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:39,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:39,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:39,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:39,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:39,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:39,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:39,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:39,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:39,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:39,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:39,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:39,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:39,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:40,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:22:41,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:41,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:41,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:41,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:41,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:41,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:41,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:41,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:41,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:41,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:41,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:41,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:41,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:41,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:41,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:41,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:42,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:22:42,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:42,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:42,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:42,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:42,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:42,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:42,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:42,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:42,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:42,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:42,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:42,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:42,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:42,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:42,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:42,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:44,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:22:45,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:45,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:45,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:45,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:45,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:45,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:45,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:45,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:45,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:45,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:45,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:45,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:45,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:45,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:45,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:45,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:46,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:22:47,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:47,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:47,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:47,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:47,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:47,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:47,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:47,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:47,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:47,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:47,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:47,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:47,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:47,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:47,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:47,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:48,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:22:49,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:49,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:49,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:49,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:49,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:49,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:49,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:49,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:49,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:49,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:49,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:49,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:49,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:49,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:49,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:49,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:50,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:50,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:50,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:50,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:50,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:50,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:50,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:50,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:50,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:50,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:50,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:50,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:50,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:50,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:50,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:50,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:50,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:22:52,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:22:53,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:53,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:53,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:53,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:53,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:53,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:53,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:53,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:53,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:53,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:53,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:53,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:53,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:53,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:53,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:53,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:53,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:53,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:53,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:53,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:53,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:53,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:53,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:53,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:53,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:53,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:53,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:53,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:53,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:53,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:53,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:53,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:53,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:22:53,455 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:22:54,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:54,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:54,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:54,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:54,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:54,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:54,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:54,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:54,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:54,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:54,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:54,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:54,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:54,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:54,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:54,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:54,826 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:22:55,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:55,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:55,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:55,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:55,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:55,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:55,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:55,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:55,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:55,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:55,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:55,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:55,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:55,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:55,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:55,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:56,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:56,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:56,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:56,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:56,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:56,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:56,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:56,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:56,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:56,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:56,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:56,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:56,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:56,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:56,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:56,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:56,456 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:22:56,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:22:57,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:57,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:57,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:57,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:57,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:57,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:57,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:57,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:57,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:57,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:57,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:57,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:57,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:57,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:57,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:57,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:58,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:58,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:58,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:58,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:58,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:58,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:58,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:58,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:58,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:58,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:58,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:58,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:58,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:58,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:58,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:58,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:22:58,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:23:00,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:00,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:00,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:00,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:00,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:00,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:00,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:00,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:00,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:00,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:00,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:00,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:00,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:00,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:00,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:00,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:00,829 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:23:00,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:00,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:00,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:00,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:00,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:00,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:00,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:00,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:00,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:00,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:00,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:00,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:00,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:00,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:00,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:00,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:02,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:23:03,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:03,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:03,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:03,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:03,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:03,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:03,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:03,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:03,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:03,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:03,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:03,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:03,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:03,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:03,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:03,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:04,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:04,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:04,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:04,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:04,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:04,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:04,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:04,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:04,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:04,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:04,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:04,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:04,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:04,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:04,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:04,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:04,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:23:06,831 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:23:07,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:07,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:07,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:07,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:07,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:07,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:07,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:07,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:07,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:07,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:07,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:07,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:07,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:07,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:07,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:07,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:08,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:23:08,776 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:23:08,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:23:10,833 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:23:11,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:11,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:11,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:11,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:11,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:11,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:11,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:11,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:11,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:11,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:11,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:11,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:11,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:11,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:12,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:12,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:12,834 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:23:13,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:13,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:13,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:13,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:13,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:13,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:13,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:13,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:13,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:13,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:13,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:13,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:13,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:13,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:13,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:13,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:14,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:14,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:14,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:14,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:14,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:14,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:14,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:14,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:14,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:14,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:14,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:14,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:14,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:14,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:14,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:14,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:14,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:23:15,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:15,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:15,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:15,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:15,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:15,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:15,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:15,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:15,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:15,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:15,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:15,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:15,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:15,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:15,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:15,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:16,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:16,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:16,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:16,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:16,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:16,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:16,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:16,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:16,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:16,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:16,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:16,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:16,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:16,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:16,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:16,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:16,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:23:18,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:23:20,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:23:22,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:23:22,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:22,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:22,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:22,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:23,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:23,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:23,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:23,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:23,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:23,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:23,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:23,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:23,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:23,370 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 05:23:23,599 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 05:23:23,666 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 05:23:23,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 05:23:24,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:23:24,207 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:23:24,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:23:25,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:23:26,572 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:23:29,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:29,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:29,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:29,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:29,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:29,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:29,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:29,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:29,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:29,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:29,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:29,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:29,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:29,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:29,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:29,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:32,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:23:36,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:23:38,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:38,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:38,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:38,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:38,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:38,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:38,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:38,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:38,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:38,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:38,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:38,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:38,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:38,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:38,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:38,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:38,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:38,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:38,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:38,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:38,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:38,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:38,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:38,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:38,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:38,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:38,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:38,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:38,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:38,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:38,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:38,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:39,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:23:39,500 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:23:42,846 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:23:46,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:23:50,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:50,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:50,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:50,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:50,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:50,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:50,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:50,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:50,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:50,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:50,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:50,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:50,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:50,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:50,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:50,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:50,850 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:23:52,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:52,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:52,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:52,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:52,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:52,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:52,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:52,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:52,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:52,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:52,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:52,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:52,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:52,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:52,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:52,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:54,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:54,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:54,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:54,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:54,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:54,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:54,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:54,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:54,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:54,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:54,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:54,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:54,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:54,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:54,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:54,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:54,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:23:54,720 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:23:54,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:23:56,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:56,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:56,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:56,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:56,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:56,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:56,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:56,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:56,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:56,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:56,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:56,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:56,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:56,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:56,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:56,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:23:56,650 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:23:58,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:24:00,854 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:24:01,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:01,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:01,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:01,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:01,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:01,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:01,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:01,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:01,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:01,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:01,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:01,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:01,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:01,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:01,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:01,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:02,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:02,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:02,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:02,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:02,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:02,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:02,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:02,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:02,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:02,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:02,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:02,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:02,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:02,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:02,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:02,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:05,856 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:24:06,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:06,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:06,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:06,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:06,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:06,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:06,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:06,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:06,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:06,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:06,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:06,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:06,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:06,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:06,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:06,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:08,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:08,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:08,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:08,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:08,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:08,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:08,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:08,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:08,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:08,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:08,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:08,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:08,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:08,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:08,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:08,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:08,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:08,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:08,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:08,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:08,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:08,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:08,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:08,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:08,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:08,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:08,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:08,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:08,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:08,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:08,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:08,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:09,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:24:10,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:24:10,103 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:24:11,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:24:12,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:12,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:12,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:12,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:12,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:12,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:12,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:12,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:12,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:12,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:12,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:12,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:12,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:12,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:12,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:12,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:12,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:12,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:12,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:12,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:12,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:12,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:12,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:12,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:12,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:12,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:12,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:12,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:12,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:12,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:12,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:12,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:14,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:14,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:14,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:14,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:14,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:14,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:14,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:14,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:14,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:14,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:14,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:14,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:14,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:14,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:14,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:14,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:14,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:14,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:14,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:14,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:14,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:14,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:14,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:14,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:14,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:14,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:14,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:14,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:14,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:14,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:14,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:14,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:15,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:24:17,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:24:21,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:24:21,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:21,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:21,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:21,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:21,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:21,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:21,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:21,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:21,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:21,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:21,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:21,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:21,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:21,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:21,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:21,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:23,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:24:25,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:24:25,443 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:24:26,724 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:24:27,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:24:28,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:28,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:28,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:28,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:28,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:28,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:28,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:28,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:28,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:28,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:28,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:28,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:28,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:28,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:28,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:28,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:29,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:29,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:29,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:29,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:29,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:29,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:29,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:29,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:29,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:29,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:29,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:29,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:29,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:29,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:29,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:29,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:29,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:24:31,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:24:32,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:32,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:32,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:32,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:32,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:32,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:32,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:32,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:32,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:32,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:32,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:32,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:32,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:32,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:32,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:32,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:33,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:24:36,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:36,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:36,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:36,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:36,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:36,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:36,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:36,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:36,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:36,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:36,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:36,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:36,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:36,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:36,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:36,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:37,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:24:38,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:38,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:38,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:38,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:38,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:38,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:38,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:38,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:38,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:38,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:38,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:38,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:38,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:38,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:38,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:38,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:38,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:38,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:38,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:38,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:38,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:38,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:38,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:38,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:38,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:38,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:38,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:38,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:38,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:38,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:38,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:38,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:39,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:24:39,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:39,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:39,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:39,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:39,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:39,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:39,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:39,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:39,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:39,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:39,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:39,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:39,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:39,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:39,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:39,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:40,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:24:40,714 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:24:41,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:24:43,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:43,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:43,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:43,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:43,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:43,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:43,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:43,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:43,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:43,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:43,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:43,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:43,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:43,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:43,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:43,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:43,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:43,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:43,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:43,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:43,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:43,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:43,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:43,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:43,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:43,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:43,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:43,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:43,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:43,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:43,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:43,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:43,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:24:45,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:24:46,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:46,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:46,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:46,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:46,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:46,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:46,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:46,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:46,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:46,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:46,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:46,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:46,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:46,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:46,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:46,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:47,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:24:48,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:48,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:48,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:48,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:48,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:48,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:48,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:48,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:48,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:48,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:48,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:48,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:48,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:48,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:48,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:48,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:49,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:24:51,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:24:52,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:52,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:52,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:52,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:52,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:52,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:52,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:52,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:52,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:52,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:52,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:52,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:52,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:52,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:52,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:52,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:53,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:24:55,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:24:55,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:24:55,944 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:24:56,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:56,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:56,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:56,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:56,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:56,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:56,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:56,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:56,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:56,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:56,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:56,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:56,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:56,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:56,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:56,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:56,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:56,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:56,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:56,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:56,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:56,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:56,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:56,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:56,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:56,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:56,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:56,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:56,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:56,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:56,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:56,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:56,800 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:24:57,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:57,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:57,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:57,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:57,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:57,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:57,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:57,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:57,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:57,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:57,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:57,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:57,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:57,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:57,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:57,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:57,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:57,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:57,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:57,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:57,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:57,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:57,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:57,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:57,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:57,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:57,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:57,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:57,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:57,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:57,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:57,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:57,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:24:58,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:58,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:58,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:58,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:58,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:58,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:58,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:58,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:58,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:58,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:58,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:58,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:58,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:58,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:58,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:58,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:59,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:59,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:59,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:59,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:59,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:59,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:59,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:59,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:59,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:59,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:59,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:59,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:59,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:59,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:59,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:59,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:59,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:59,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:59,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:59,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:59,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:59,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:59,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:59,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:59,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:59,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:59,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:59,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:59,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:59,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:59,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:59,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:24:59,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:25:00,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:00,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:00,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:00,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:00,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:00,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:00,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:00,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:00,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:00,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:00,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:00,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:00,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:00,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:00,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:00,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:00,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:00,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:00,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:00,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:00,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:00,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:00,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:00,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:00,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:00,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:00,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:00,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:00,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:00,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:00,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:00,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:01,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:25:03,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:25:05,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:05,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:05,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:05,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:05,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:05,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:05,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:05,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:05,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:05,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:05,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:05,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:05,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:05,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:05,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:05,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:05,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:25:07,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:07,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:07,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:07,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:07,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:07,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:07,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:07,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:07,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:07,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:07,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:07,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:07,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:07,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:07,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:07,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:07,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:07,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:07,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:07,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:07,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:07,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:07,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:07,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:07,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:07,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:07,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:07,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:07,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:07,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:07,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:07,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:07,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:25:08,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:08,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:08,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:08,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:08,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:08,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:08,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:08,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:08,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:08,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:08,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:08,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:08,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:08,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:08,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:08,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:08,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:08,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:08,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:08,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:08,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:08,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:08,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:08,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:08,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:08,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:08,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:08,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:08,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:08,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:08,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:08,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:09,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:25:11,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:25:11,249 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:25:11,882 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:25:13,883 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:25:14,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:14,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:14,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:14,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:14,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:14,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:14,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:14,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:14,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:14,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:14,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:14,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:14,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:14,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:14,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:14,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:15,883 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:25:16,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:16,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:16,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:16,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:16,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:16,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:16,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:16,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:16,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:16,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:16,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:16,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:16,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:16,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:16,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:16,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:17,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:17,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:17,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:17,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:17,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:17,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:17,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:17,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:17,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:17,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:17,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:17,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:17,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:17,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:17,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:17,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:17,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:25:18,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:18,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:18,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:18,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:18,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:18,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:18,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:18,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:18,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:18,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:18,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:18,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:18,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:18,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:18,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:18,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:19,885 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:25:21,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:21,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:21,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:21,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:21,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:21,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:21,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:21,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:21,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:21,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:21,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:21,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:21,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:21,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:21,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:21,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:21,885 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:25:23,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:23,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:23,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:23,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:23,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:25:23,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:23,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:23,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:23,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:23,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:23,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:23,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:23,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:25,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:25:26,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:25:26,496 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:25:26,876 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:25:33,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:25:40,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:25:41,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:41,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:41,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:41,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:41,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:41,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:41,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:41,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:41,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:41,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:41,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:41,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:41,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:41,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:41,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:41,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:41,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:25:41,720 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:25:44,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:44,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:44,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:44,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:44,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:44,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:44,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:44,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:44,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:44,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:44,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:44,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:44,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:44,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:44,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:44,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:44,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:25:45,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:45,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:45,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:45,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:45,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:45,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:45,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:45,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:45,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:45,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:45,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:45,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:45,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:45,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:45,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:45,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:48,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:25:52,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:25:53,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:53,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:53,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:53,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:53,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:53,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:53,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:53,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:53,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:53,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:53,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:53,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:53,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:53,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:53,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:53,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:25:56,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:25:56,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:25:56,945 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:25:57,211 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:26:00,900 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:26:02,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:02,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:02,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:02,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:02,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:02,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:02,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:02,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:02,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:02,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:02,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:02,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:02,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:02,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:02,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:02,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:02,901 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:26:04,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:04,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:04,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:04,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:04,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:04,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:04,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:04,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:04,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:04,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:04,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:04,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:04,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:04,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:04,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:04,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:05,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:05,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:05,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:05,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:05,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:05,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:05,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:05,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:05,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:05,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:05,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:05,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:05,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:05,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:05,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:05,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:06,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:06,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:06,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:06,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:06,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:06,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:06,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:06,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:06,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:06,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:06,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:06,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:06,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:06,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:06,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:06,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:06,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:26:07,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:07,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:07,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:07,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:07,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:07,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:07,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:07,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:07,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:07,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:07,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:07,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:07,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:07,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:07,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:07,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:10,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:26:12,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:26:12,213 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:26:12,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:26:15,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:15,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:15,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:15,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:15,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:15,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:15,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:15,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:15,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:15,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:15,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:15,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:15,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:15,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:15,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:15,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:15,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:15,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:15,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:15,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:15,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:15,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:15,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:15,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:15,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:15,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:15,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:15,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:15,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:15,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:15,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:15,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:16,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:16,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:16,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:16,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:16,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:16,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:16,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:16,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:16,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:16,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:16,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:16,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:16,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:16,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:16,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:16,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:16,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:16,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:16,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:16,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:16,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:16,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:16,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:16,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:16,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:16,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:16,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:16,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:16,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:16,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:16,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:16,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:16,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:26:18,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:18,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:18,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:18,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:18,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:18,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:18,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:18,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:18,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:18,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:18,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:18,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:18,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:18,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:18,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:18,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:18,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:26:21,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:21,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:21,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:21,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:21,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:21,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:21,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:21,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:21,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:21,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:21,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:21,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:21,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:21,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:21,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:21,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:22,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:26:24,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:24,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:24,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:24,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:24,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:24,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:24,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:24,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:24,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:24,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:24,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:24,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:24,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:24,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:24,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:24,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:24,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:26:27,028 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:26:27,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:26:27,438 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:26:28,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:26:29,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:29,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:29,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:29,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:29,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:29,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:29,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:29,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:29,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:29,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:29,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:29,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:29,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:29,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:29,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:29,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:30,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:26:31,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:31,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:31,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:31,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:31,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:31,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:31,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:31,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:31,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:31,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:31,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:31,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:31,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:31,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:31,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:31,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:32,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:26:34,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:34,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:34,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:34,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:34,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:34,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:34,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:34,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:34,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:34,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:34,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:34,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:34,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:34,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:34,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:34,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:34,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:26:38,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:26:38,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:38,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:38,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:38,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:38,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:38,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:38,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:38,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:38,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:38,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:38,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:38,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:38,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:38,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:39,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:39,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:40,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:40,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:40,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:40,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:40,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:40,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:40,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:40,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:40,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:40,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:40,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:40,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:40,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:40,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:40,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:40,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:40,916 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:26:41,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:41,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:41,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:41,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:41,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:41,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:41,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:41,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:41,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:41,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:41,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:41,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:41,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:41,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:41,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:41,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:42,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:26:42,744 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:26:42,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:26:43,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:43,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:43,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:43,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:43,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:43,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:43,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:43,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:43,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:43,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:43,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:43,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:43,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:43,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:43,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:43,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:44,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:26:45,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:45,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:45,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:45,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:45,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:45,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:45,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:45,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:45,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:45,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:45,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:45,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:45,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:45,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:45,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:45,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:46,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:46,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:46,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:46,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:46,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:46,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:46,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:46,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:46,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:46,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:46,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:46,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:46,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:46,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:46,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:46,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:46,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:26:47,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:47,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:47,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:47,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:47,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:47,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:47,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:47,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:47,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:47,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:47,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:47,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:47,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:47,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:47,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:47,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:47,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:47,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:47,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:47,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:47,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:47,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:47,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:47,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:47,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:47,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:47,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:47,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:47,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:47,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:47,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:47,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:48,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:26:50,921 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:26:52,922 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:26:53,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:53,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:53,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:53,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:53,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:53,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:53,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:53,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:53,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:53,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:53,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:53,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:53,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:53,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:53,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:53,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:54,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:26:56,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:56,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:56,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:56,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:56,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:56,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:56,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:56,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:56,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:56,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:56,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:56,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:56,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:56,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:56,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:56,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:26:56,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:26:57,105 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:26:57,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:26:57,968 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:26:58,925 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:27:00,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:00,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:00,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:00,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:00,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:00,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:00,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:00,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:00,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:00,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:00,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:00,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:00,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:00,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:00,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:00,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:00,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:00,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:00,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:00,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:00,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:00,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:00,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:00,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:00,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:00,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:00,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:00,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:00,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:00,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:00,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:00,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:00,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:27:01,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:01,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:02,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:02,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:02,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:02,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:02,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:02,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:02,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:02,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:02,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:02,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:02,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:02,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:02,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:02,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:02,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:02,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:02,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:02,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:02,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:02,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:02,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:02,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:02,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:02,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:02,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:02,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:02,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:02,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:02,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:02,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:02,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:02,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:02,927 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:27:03,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:03,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:03,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:03,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:03,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:03,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:03,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:03,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:03,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:03,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:03,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:03,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:03,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:03,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:03,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:03,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:03,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:03,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:03,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:03,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:03,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:03,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:03,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:03,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:03,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:03,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:03,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:03,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:03,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:03,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:03,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:03,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:04,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:27:06,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:27:08,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:08,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:08,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:08,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:08,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:08,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:08,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:08,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:08,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:08,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:08,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:08,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:08,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:08,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:08,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:08,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:08,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:27:09,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:09,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:09,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:09,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:09,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:09,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:09,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:09,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:09,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:09,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:09,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:09,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:09,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:09,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:09,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:09,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:09,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:09,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:09,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:09,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:09,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:09,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:09,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:09,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:09,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:09,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:09,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:09,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:09,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:09,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:09,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:09,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:10,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:27:12,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:12,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:12,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:12,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:12,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:12,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:12,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:12,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:12,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:12,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:12,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:12,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:12,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:12,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:12,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:12,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:12,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:27:13,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:13,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:13,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:13,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:13,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:13,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:13,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:13,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:13,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:13,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:13,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:13,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:13,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:13,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:13,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:13,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:13,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:27:13,204 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:27:14,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:14,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:14,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:14,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:14,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:14,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:14,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:14,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:14,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:14,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:14,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:14,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:14,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:14,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:14,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:14,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:14,932 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:27:16,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:27:18,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:18,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:18,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:18,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:18,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:18,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:18,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:18,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:18,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:18,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:18,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:18,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:18,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:18,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:18,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:18,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:18,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:27:19,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:19,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:19,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:19,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:19,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:19,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:19,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:19,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:19,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:19,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:19,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:19,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:19,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:19,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:19,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:19,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:20,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:20,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:20,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:20,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:20,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:20,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:20,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:20,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:20,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:20,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:20,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:20,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:20,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:20,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:20,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:20,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:20,935 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:27:22,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:22,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:22,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:22,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:22,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:27:22,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:22,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:22,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:23,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:23,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:23,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:23,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:23,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:23,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:23,267 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 05:27:23,490 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 05:27:23,561 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 05:27:23,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 05:27:24,937 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:27:27,270 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:27:28,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:27:28,430 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:27:32,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:32,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:32,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:32,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:32,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:32,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:32,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:32,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:32,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:32,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:32,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:32,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:32,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:32,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:32,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:32,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:34,941 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:27:38,942 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:27:43,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:27:43,656 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:27:44,945 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:27:46,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:46,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:46,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:46,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:46,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:46,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:46,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:46,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:46,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:46,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:46,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:46,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:46,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:46,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:46,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:46,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:48,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:48,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:48,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:48,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:48,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:48,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:48,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:48,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:48,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:48,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:48,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:48,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:48,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:48,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:48,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:48,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:48,947 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:27:52,949 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:27:53,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:53,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:53,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:53,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:53,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:53,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:53,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:53,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:53,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:53,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:53,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:53,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:53,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:53,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:53,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:53,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:27:56,950 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:27:57,346 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:27:58,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:27:58,887 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:27:58,951 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:28:02,953 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:28:04,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:04,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:04,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:04,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:04,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:04,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:04,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:04,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:04,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:04,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:04,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:04,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:04,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:04,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:04,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:04,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:06,955 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:28:09,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:09,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:09,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:09,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:09,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:09,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:09,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:09,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:09,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:09,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:09,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:09,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:09,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:09,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:09,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:09,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:09,956 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:28:10,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:10,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:10,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:10,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:10,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:10,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:10,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:10,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:10,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:10,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:10,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:10,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:10,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:10,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:10,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:10,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:12,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:12,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:12,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:12,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:12,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:12,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:12,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:12,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:12,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:12,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:12,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:12,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:12,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:12,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:12,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:12,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:13,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:13,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:13,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:13,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:13,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:13,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:13,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:13,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:13,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:13,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:13,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:13,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:13,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:13,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:13,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:13,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:13,958 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:28:14,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:28:14,110 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:28:15,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:15,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:15,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:15,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:15,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:15,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:15,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:15,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:15,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:15,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:15,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:15,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:15,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:15,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:15,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:15,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:15,959 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:28:16,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:16,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:16,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:16,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:16,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:16,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:16,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:16,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:16,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:16,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:16,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:16,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:16,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:16,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:16,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:16,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:19,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:19,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:19,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:19,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:19,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:19,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:19,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:19,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:19,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:19,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:19,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:19,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:19,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:19,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:19,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:19,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:19,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:19,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:19,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:19,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:19,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:19,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:19,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:19,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:19,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:19,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:19,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:19,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:19,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:19,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:19,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:19,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:19,961 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:28:21,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:28:22,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:22,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:22,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:22,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:22,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:22,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:22,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:22,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:22,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:22,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:22,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:22,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:22,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:22,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:22,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:22,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:22,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:22,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:22,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:22,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:22,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:22,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:22,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:22,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:22,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:22,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:22,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:22,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:22,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:22,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:22,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:22,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:25,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:25,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:25,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:25,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:25,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:25,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:25,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:25,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:25,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:25,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:25,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:25,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:25,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:25,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:25,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:25,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:25,963 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:28:27,414 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:28:27,964 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:28:29,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:29,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:29,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:29,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:29,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:29,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:29,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:29,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:29,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:29,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:29,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:29,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:29,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:29,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:29,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:29,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:29,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:28:29,514 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:28:29,965 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:28:31,966 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:28:34,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:34,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:34,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:34,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:34,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:34,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:34,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:34,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:34,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:34,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:34,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:34,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:34,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:34,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:34,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:34,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:35,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:35,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:35,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:35,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:35,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:35,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:35,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:35,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:35,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:35,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:35,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:35,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:35,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:35,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:35,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:35,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:35,968 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:28:37,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:37,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:37,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:37,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:37,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:37,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:37,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:37,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:37,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:37,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:37,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:37,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:37,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:37,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:37,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:37,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:37,969 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:28:39,970 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:28:41,971 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:28:42,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:42,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:42,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:42,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:42,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:42,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:42,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:42,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:42,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:42,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:42,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:42,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:42,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:42,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:42,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:42,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:43,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:43,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:43,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:43,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:43,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:43,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:43,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:43,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:43,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:43,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:43,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:43,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:43,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:43,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:43,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:43,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:43,972 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:28:44,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:44,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:44,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:44,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:44,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:44,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:44,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:44,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:44,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:44,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:44,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:44,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:44,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:44,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:44,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:44,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:44,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:28:44,777 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:28:45,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:45,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:45,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:45,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:45,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:45,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:45,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:45,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:45,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:45,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:45,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:45,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:45,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:45,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:45,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:45,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:45,973 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:28:47,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:47,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:47,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:47,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:47,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:47,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:47,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:47,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:47,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:47,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:47,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:47,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:47,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:47,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:47,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:47,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:49,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:49,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:49,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:49,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:49,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:49,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:49,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:49,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:49,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:49,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:49,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:49,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:49,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:49,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:49,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:49,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:49,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:49,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:49,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:49,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:49,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:49,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:49,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:49,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:49,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:49,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:49,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:49,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:49,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:49,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:49,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:49,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:49,975 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:28:51,976 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:28:53,977 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:28:54,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:54,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:54,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:54,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:54,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:54,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:54,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:54,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:54,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:54,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:54,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:54,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:54,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:54,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:54,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:54,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:55,978 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:28:57,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:57,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:57,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:57,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:57,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:57,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:57,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:57,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:57,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:57,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:57,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:57,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:57,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:57,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:57,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:57,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:57,489 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:28:57,979 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:28:58,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:58,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:58,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:58,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:58,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:58,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:58,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:58,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:58,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:58,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:58,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:58,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:58,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:58,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:58,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:58,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:28:59,980 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:28:59,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:28:59,991 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:29:01,981 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:29:02,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:02,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:02,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:02,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:02,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:02,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:02,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:02,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:02,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:02,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:02,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:02,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:02,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:02,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:02,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:02,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:03,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:03,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:03,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:03,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:03,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:03,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:03,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:03,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:03,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:03,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:03,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:03,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:03,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:03,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:03,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:03,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:03,982 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:29:04,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:04,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:04,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:04,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:04,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:04,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:04,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:04,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:04,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:04,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:04,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:04,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:04,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:04,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:04,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:04,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:04,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:04,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:04,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:04,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:04,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:04,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:04,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:04,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:04,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:04,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:04,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:04,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:04,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:04,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:04,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:04,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:05,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:05,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:05,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:05,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:05,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:05,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:05,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:05,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:05,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:05,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:05,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:05,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:05,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:05,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:05,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:05,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:05,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:05,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:05,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:05,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:05,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:05,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:05,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:05,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:05,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:05,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:05,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:05,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:05,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:05,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:05,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:05,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:05,983 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:29:06,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:06,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:06,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:06,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:06,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:06,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:06,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:06,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:06,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:06,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:06,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:06,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:06,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:06,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:06,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:06,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:06,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:06,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:06,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:06,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:06,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:06,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:06,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:06,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:06,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:06,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:06,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:06,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:06,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:06,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:06,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:06,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:07,984 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:29:08,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:08,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:08,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:08,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:08,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:08,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:08,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:08,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:08,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:08,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:08,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:08,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:08,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:08,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:08,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:08,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:09,985 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:29:10,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:10,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:10,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:10,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:10,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:10,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:10,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:10,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:10,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:10,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:10,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:10,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:10,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:10,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:10,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:10,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:10,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:10,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:10,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:10,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:10,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:10,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:10,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:10,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:10,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:10,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:10,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:10,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:10,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:10,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:10,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:10,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:11,986 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:29:12,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:12,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:12,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:12,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:12,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:12,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:12,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:12,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:12,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:12,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:12,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:12,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:12,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:12,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:12,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:12,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:13,987 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:29:14,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:14,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:14,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:14,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:14,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:14,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:14,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:14,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:14,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:14,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:14,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:14,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:14,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:14,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:14,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:14,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:15,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:29:15,357 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:29:15,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:29:16,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:16,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:16,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:16,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:16,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:16,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:16,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:16,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:16,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:16,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:16,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:16,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:16,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:16,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:16,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:16,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:17,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:17,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:17,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:17,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:17,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:17,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:17,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:17,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:17,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:17,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:17,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:17,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:17,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:17,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:17,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:17,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:17,989 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:29:19,990 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:29:20,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:20,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:20,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:20,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:20,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:20,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:20,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:20,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:20,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:20,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:20,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:20,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:20,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:20,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:20,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:20,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:21,991 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:29:22,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:22,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:22,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:22,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:22,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:22,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:22,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:22,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:22,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:22,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:22,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:22,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:22,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:22,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:22,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:22,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:23,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:23,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:23,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:23,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:23,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:23,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:23,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:23,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:23,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:23,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:23,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:23,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:23,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:23,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:23,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:23,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:23,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:23,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:23,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:23,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:23,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:23,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:23,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:23,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:23,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:23,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:23,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:23,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:23,991 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:29:27,563 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:29:30,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:29:30,590 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:29:31,994 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:29:37,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:29:41,998 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:29:42,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:42,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:42,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:42,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:42,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:42,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:42,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:42,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:42,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:42,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:42,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:42,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:42,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:42,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:42,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:42,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:45,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:29:45,898 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:29:45,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:29:50,001 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:29:50,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:50,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:50,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:50,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:50,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:50,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:50,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:50,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:50,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:50,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:50,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:50,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:50,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:50,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:50,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:50,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:54,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:29:54,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:54,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:54,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:54,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:54,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:54,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:54,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:54,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:54,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:54,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:54,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:54,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:54,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:54,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:54,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:54,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:57,634 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:29:58,004 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:29:59,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:59,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:59,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:59,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:59,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:59,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:59,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:59,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:59,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:59,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:59,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:59,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:59,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:59,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:59,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:29:59,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:01,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:30:01,161 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:30:02,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:30:04,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:30:08,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:08,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:08,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:08,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:08,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:08,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:08,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:08,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:08,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:08,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:08,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:08,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:08,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:08,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:08,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:08,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:09,008 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:30:11,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:11,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:11,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:11,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:11,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:11,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:11,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:11,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:11,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:11,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:11,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:11,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:11,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:11,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:11,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:11,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:12,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:12,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:12,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:12,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:12,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:12,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:12,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:12,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:12,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:12,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:12,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:12,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:12,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:12,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:12,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:12,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:13,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:30:15,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:30:16,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:16,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:16,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:16,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:16,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:16,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:16,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:16,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:16,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:16,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:16,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:16,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:16,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:16,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:16,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:16,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:16,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:30:16,384 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:30:17,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:17,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:17,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:17,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:17,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:17,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:17,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:17,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:17,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:17,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:17,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:17,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:17,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:17,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:17,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:17,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:19,012 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:30:21,013 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:30:21,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:21,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:21,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:21,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:21,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:21,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:21,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:21,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:21,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:21,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:21,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:21,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:21,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:21,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:21,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:21,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:21,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:21,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:21,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:21,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:21,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:21,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:21,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:21,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:21,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:21,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:21,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:21,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:21,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:21,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:21,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:21,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:24,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:24,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:24,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:24,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:24,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:24,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:24,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:24,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:24,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:24,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:24,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:24,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:24,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:24,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:24,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:24,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:24,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:24,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:24,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:24,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:24,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:24,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:24,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:24,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:24,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:24,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:24,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:24,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:24,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:24,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:24,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:24,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:25,015 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:30:27,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:30:27,706 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:30:29,017 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:30:31,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:30:31,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:31,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:31,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:31,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:31,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:31,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:31,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:31,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:31,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:31,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:31,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:31,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:31,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:31,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:31,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:31,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:31,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:30:31,714 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:30:32,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:32,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:32,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:32,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:32,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:32,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:32,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:32,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:32,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:32,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:32,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:32,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:32,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:32,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:32,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:32,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:32,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:32,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:32,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:32,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:32,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:32,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:32,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:32,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:32,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:32,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:32,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:32,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:32,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:32,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:32,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:32,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:33,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:33,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:33,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:33,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:33,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:33,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:33,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:33,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:33,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:33,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:33,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:33,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:33,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:33,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:33,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:33,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:35,019 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:30:37,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:30:38,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:38,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:38,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:38,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:38,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:38,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:38,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:38,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:38,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:38,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:38,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:38,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:38,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:38,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:38,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:38,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:39,021 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:30:41,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:30:41,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:41,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:41,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:41,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:41,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:41,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:41,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:41,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:41,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:41,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:41,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:41,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:41,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:41,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:41,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:41,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:41,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:41,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:41,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:41,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:41,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:41,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:41,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:41,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:41,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:41,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:41,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:41,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:41,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:41,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:41,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:41,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:43,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:30:44,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:44,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:44,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:44,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:44,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:44,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:44,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:44,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:44,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:44,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:44,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:44,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:44,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:44,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:44,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:44,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:45,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:30:46,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:30:46,959 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:30:48,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:48,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:48,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:48,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:48,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:48,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:48,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:48,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:48,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:48,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:48,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:48,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:48,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:48,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:48,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:48,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:49,025 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:30:49,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:49,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:49,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:49,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:49,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:49,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:49,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:49,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:49,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:49,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:49,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:49,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:49,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:49,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:49,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:49,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:50,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:50,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:50,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:50,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:50,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:50,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:50,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:50,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:50,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:50,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:50,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:50,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:50,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:50,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:50,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:50,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:51,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:30:51,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:51,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:51,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:51,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:51,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:51,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:51,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:51,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:51,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:51,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:51,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:51,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:51,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:51,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:51,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:51,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:53,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:53,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:53,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:53,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:53,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:53,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:53,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:53,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:53,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:53,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:53,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:53,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:53,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:53,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:53,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:53,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:54,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:30:55,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:55,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:55,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:55,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:55,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:55,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:55,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:55,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:55,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:55,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:55,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:55,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:55,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:55,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:55,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:55,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:56,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:30:57,785 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:30:58,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:30:58,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:58,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:58,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:58,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:58,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:58,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:58,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:58,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:58,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:58,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:58,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:58,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:58,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:58,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:58,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:30:58,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:00,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:31:01,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:01,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:01,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:01,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:01,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:01,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:01,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:01,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:01,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:01,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:01,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:01,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:01,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:01,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:01,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:01,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:02,031 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:31:02,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:31:02,251 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:31:04,032 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:31:04,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:04,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:04,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:04,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:04,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:04,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:04,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:04,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:04,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:04,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:04,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:04,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:04,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:04,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:04,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:04,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:05,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:05,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:05,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:05,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:05,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:05,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:05,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:05,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:05,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:05,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:05,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:05,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:05,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:05,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:05,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:05,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:05,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:05,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:05,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:05,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:05,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:05,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:05,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:05,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:05,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:05,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:05,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:05,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:05,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:05,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:05,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:05,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:06,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:31:06,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:06,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:06,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:06,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:06,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:06,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:06,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:06,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:06,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:06,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:06,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:06,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:06,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:06,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:06,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:06,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:07,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:07,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:07,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:07,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:07,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:07,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:07,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:07,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:07,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:07,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:07,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:07,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:07,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:07,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:07,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:07,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:07,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:07,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:07,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:07,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:07,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:07,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:07,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:07,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:07,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:07,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:07,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:07,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:07,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:07,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:07,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:07,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:08,034 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:31:08,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:08,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:08,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:08,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:08,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:08,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:08,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:08,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:08,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:08,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:08,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:08,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:08,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:08,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:08,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:08,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:08,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:08,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:08,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:08,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:08,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:08,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:08,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:08,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:08,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:08,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:08,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:08,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:08,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:08,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:08,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:08,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:10,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:10,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:10,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:10,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:10,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:10,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:10,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:10,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:10,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:10,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:10,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:31:10,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:10,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:10,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:10,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:10,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:10,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:10,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:10,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:10,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:10,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:10,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:10,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:10,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:10,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:10,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:10,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:10,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:10,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:10,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:10,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:10,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:10,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:11,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:11,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:11,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:11,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:11,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:11,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:11,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:11,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:11,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:11,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:11,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:11,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:11,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:11,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:11,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:11,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:11,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:11,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:11,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:11,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:11,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:11,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:11,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:11,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:11,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:11,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:11,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:11,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:11,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:11,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:11,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:11,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:12,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:31:14,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:31:15,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:15,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:15,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:15,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:15,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:15,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:15,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:15,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:15,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:15,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:15,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:15,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:15,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:15,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:15,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:15,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:16,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:31:16,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:16,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:16,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:16,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:16,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:16,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:16,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:16,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:16,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:16,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:16,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:16,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:16,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:16,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:16,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:16,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:17,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:17,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:17,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:17,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:17,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:17,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:17,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:17,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:17,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:17,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:17,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:17,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:17,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:17,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:17,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:17,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:17,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:31:17,464 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:31:17,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:17,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:17,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:17,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:17,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:17,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:17,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:17,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:17,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:17,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:17,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:17,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:17,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:17,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:17,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:17,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:18,038 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:31:20,039 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:31:21,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:21,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:21,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:21,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:21,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:21,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:21,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:21,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:21,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:21,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:21,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:21,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:21,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:21,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:21,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:21,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:22,039 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:31:22,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:22,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:22,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:22,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:22,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:22,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:22,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:22,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:22,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:22,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:22,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:22,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:22,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:22,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:22,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:22,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:22,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:22,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:22,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:22,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:22,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:22,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:22,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:22,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:22,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:22,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:22,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:22,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:23,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 05:31:23,153 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 05:31:23,363 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 05:31:23,438 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 05:31:24,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 05:31:24,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:31:26,041 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:31:27,877 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:31:28,041 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:31:30,042 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:31:32,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:31:32,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:31:32,769 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:31:34,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:31:36,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:31:38,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:31:40,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:31:42,047 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:31:44,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:31:46,049 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:31:48,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:31:48,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:31:48,154 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:31:50,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:31:52,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:31:54,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:31:56,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:31:57,960 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:31:58,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:32:00,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:32:02,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:32:03,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:32:03,388 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:32:04,056 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:32:06,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:32:08,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:32:10,059 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:32:12,060 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:32:14,060 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:32:16,061 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:32:18,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:32:18,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:32:18,633 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:32:20,063 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:32:22,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:32:24,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:32:26,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:32:28,034 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:32:28,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:32:30,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:32:32,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:32:33,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:32:33,961 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:32:34,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:32:37,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:32:39,071 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:32:41,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:32:43,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:32:45,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:32:47,074 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:32:49,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:32:49,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:32:49,245 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:32:51,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:32:53,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:32:55,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:32:57,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:32:58,110 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:32:59,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:33:01,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:33:03,081 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:33:04,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:33:04,474 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:33:05,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:33:07,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:33:09,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:33:11,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:33:13,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:33:15,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:33:17,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:33:19,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:33:19,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:33:19,701 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:33:21,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:33:23,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:33:25,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:33:27,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:33:28,186 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:33:29,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:33:31,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:33:33,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:33:34,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:33:34,961 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:33:35,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:33:37,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:33:39,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:33:41,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:33:43,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:33:45,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:33:47,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:33:49,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:33:50,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:33:50,216 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:33:51,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:33:53,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:33:55,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:33:57,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:33:58,263 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:33:59,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:34:01,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:34:03,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:34:05,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:34:05,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:34:05,574 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:34:08,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:34:10,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:34:12,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:34:14,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:34:16,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:34:18,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:34:20,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:34:20,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:34:20,823 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:34:22,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:34:24,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:34:26,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:34:28,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:34:28,334 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:34:30,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:34:32,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:34:34,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:34:36,121 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:34:36,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:34:36,208 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:34:38,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:34:40,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:34:42,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:34:44,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:34:46,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:34:48,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:34:50,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:34:51,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:34:51,434 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:34:52,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:34:54,128 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:34:56,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:34:58,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:34:58,406 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:35:00,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:35:02,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:35:04,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:35:06,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:35:06,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:35:06,760 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:35:08,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:35:10,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:35:12,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:35:14,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:35:16,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:35:18,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:35:20,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:35:21,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:35:21,978 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:35:22,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:35:24,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:35:26,142 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:35:28,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:35:28,482 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:35:30,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:35:33,146 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:35:35,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:35:37,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:35:37,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:35:37,201 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:35:39,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:35:41,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:35:43,150 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:35:45,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:35:47,152 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:35:49,153 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:35:51,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:35:52,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:35:52,496 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:35:53,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:35:55,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:35:57,157 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:35:58,560 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:35:59,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:36:01,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:36:03,160 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:36:05,160 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:36:07,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:36:07,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:36:07,732 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:36:09,162 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:36:11,164 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:36:13,165 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:36:15,165 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:36:17,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:36:19,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:36:21,168 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:36:23,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:36:23,078 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:36:23,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:36:25,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:36:27,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:36:28,634 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:36:29,172 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:36:31,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:36:33,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:36:35,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:36:37,175 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:36:38,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:36:38,301 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:36:39,175 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:36:41,176 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:36:43,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:36:45,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:36:47,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:36:49,179 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:36:51,179 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:36:53,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:36:53,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:36:53,528 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:36:55,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:36:57,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:36:58,708 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:36:59,182 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:37:01,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:37:03,184 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:37:05,185 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:37:07,186 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:37:08,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:37:08,935 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:37:09,187 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:37:12,188 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:37:14,189 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:37:16,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:37:18,191 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:37:20,192 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:37:22,192 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:37:24,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:37:24,176 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:37:24,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:37:26,194 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:37:28,195 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:37:28,782 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:37:30,196 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:37:32,197 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:37:34,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:37:36,199 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:37:38,200 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:37:39,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:37:39,507 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:37:40,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:37:42,202 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:37:44,202 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:37:46,203 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:37:48,204 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:37:50,205 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:37:52,206 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:37:54,206 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:37:54,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:37:54,737 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:37:56,207 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:37:58,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:37:58,857 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:38:00,209 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:38:02,210 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:38:04,211 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:38:06,212 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:38:08,213 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:38:09,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:38:09,963 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:38:10,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:38:12,215 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:38:14,216 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:38:16,217 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:38:18,218 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:38:20,218 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:38:22,219 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:38:24,220 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:38:25,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:38:25,284 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:38:26,222 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:38:28,222 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:38:28,934 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:38:30,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:38:32,224 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:38:34,225 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:38:36,226 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:38:38,226 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:38:40,227 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:38:40,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:38:40,665 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:38:42,228 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:38:44,229 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:38:46,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:38:48,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:38:50,231 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:38:52,232 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:38:55,233 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:38:55,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:38:55,991 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:38:57,234 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:38:59,002 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:38:59,235 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:39:01,235 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:39:03,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:39:05,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:39:07,237 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:39:09,238 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:39:11,238 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:39:11,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:39:11,451 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:39:13,239 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:39:15,240 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:39:17,241 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:39:19,242 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:39:21,243 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:39:23,244 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:39:25,245 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:39:26,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:39:26,748 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:39:27,246 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:39:29,064 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:39:29,247 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:39:31,248 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:39:33,248 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:39:35,249 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:39:37,250 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:39:39,251 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:39:41,251 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:39:42,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:39:42,187 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:39:43,252 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:39:45,253 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:39:47,253 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:39:49,254 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:39:51,255 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:39:53,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:39:55,257 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:39:57,258 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:39:57,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:39:57,412 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:39:59,132 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:39:59,258 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:40:01,259 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:40:03,260 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:40:05,261 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:40:07,262 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:40:09,263 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:40:11,264 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:40:12,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:40:12,730 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:40:13,265 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:40:15,266 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:40:17,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:40:19,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:40:21,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:40:23,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:40:25,270 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:40:27,271 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:40:28,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:40:28,121 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:40:29,214 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:40:29,272 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:40:32,273 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:40:34,274 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:40:36,275 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:40:38,276 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:40:40,276 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:40:42,277 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:40:43,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:40:43,364 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:40:44,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:40:46,279 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:40:48,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:40:50,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:40:52,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:40:54,283 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:40:56,283 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:40:58,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:40:58,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:40:58,852 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:40:59,290 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:41:00,285 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:41:02,285 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:41:04,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:41:06,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:41:08,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:41:10,290 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:41:12,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:41:14,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:41:14,076 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:41:14,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:41:16,292 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:41:18,293 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:41:20,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:41:22,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:41:24,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:41:26,296 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:41:28,296 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:41:29,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:41:29,330 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:41:29,557 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:41:30,297 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:41:32,297 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:41:34,298 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:41:36,299 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:41:38,300 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:41:40,301 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:41:42,301 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:41:44,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:41:44,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:41:44,558 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:41:46,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:41:48,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:41:50,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:41:52,306 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:41:54,306 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:41:56,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:41:58,308 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:41:59,431 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:41:59,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:41:59,906 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:42:01,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:42:03,310 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:42:05,310 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:42:07,311 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:42:09,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:42:11,313 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:42:13,314 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:42:15,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:42:15,214 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:42:15,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:42:17,316 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:42:19,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:42:21,318 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:42:23,318 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:42:25,319 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:42:27,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:42:29,321 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:42:29,504 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:42:30,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:42:30,538 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:42:31,322 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:42:33,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:42:35,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:42:37,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:42:39,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:42:41,326 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:42:43,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:42:45,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:42:46,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:42:46,053 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:42:47,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:42:49,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:42:51,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:42:53,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:42:55,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:42:57,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:42:59,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:42:59,580 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:43:01,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:43:01,296 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:43:01,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:43:03,335 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:43:05,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:43:07,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:43:09,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:43:11,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:43:13,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:43:15,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:43:16,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:43:16,576 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:43:17,342 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:43:19,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:43:22,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:43:24,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:43:26,346 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:43:28,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:43:29,654 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:43:30,348 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:43:31,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:43:31,804 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:43:32,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:43:34,350 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:43:36,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:43:38,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:43:40,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:43:42,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:43:44,354 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:43:46,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:43:47,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:43:47,057 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:43:48,356 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:43:50,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:43:52,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:43:54,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:43:56,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:43:58,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:43:59,721 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:44:00,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:44:02,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:44:02,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:44:02,373 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:44:04,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:44:06,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:44:08,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:44:10,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:44:12,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:44:14,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:44:16,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:44:17,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:44:17,652 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:44:18,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:44:20,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:44:22,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:44:24,371 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:44:26,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:44:28,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:44:29,784 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:44:30,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:44:32,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:44:32,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:44:32,876 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:44:34,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:44:36,376 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:44:39,377 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:44:41,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:44:43,379 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:44:45,379 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:44:47,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:44:48,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:44:48,216 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:44:49,381 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:44:51,382 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:44:53,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:44:55,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:44:57,386 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:44:59,386 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:44:59,844 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:45:01,387 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:45:03,388 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:45:03,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:45:03,568 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:45:05,389 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:45:07,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:45:09,391 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:45:11,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:45:13,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:45:15,393 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:45:17,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:45:18,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:45:18,847 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:45:19,395 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:45:21,396 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:45:23,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:45:25,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:45:27,399 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:45:29,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:45:29,918 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:45:31,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:45:33,402 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:45:34,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:45:34,082 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:45:35,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:45:37,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:45:39,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:45:41,406 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:45:43,407 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:45:45,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:45:47,409 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:45:49,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:45:49,372 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:45:49,409 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:45:51,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:45:53,411 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:45:55,412 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:45:57,413 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:45:59,414 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:45:59,993 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:46:01,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:46:03,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:46:04,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:46:04,666 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:46:05,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:46:08,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:46:10,419 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:46:12,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:46:14,421 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:46:16,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:46:18,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:46:20,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:46:20,122 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:46:20,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:46:22,425 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:46:24,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:46:26,427 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:46:28,428 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:46:30,066 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:46:30,429 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:46:32,430 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:46:34,431 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:46:35,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:46:35,351 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:46:36,432 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:46:38,433 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:46:40,434 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:46:42,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:46:44,436 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:46:46,437 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:46:48,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:46:50,439 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:46:50,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:46:50,733 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:46:52,440 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:46:54,441 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:46:56,442 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:46:58,443 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:47:00,136 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:47:00,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:47:02,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:47:04,445 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:47:06,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:47:06,045 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:47:06,446 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:47:08,447 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:47:10,448 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:47:12,449 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:47:14,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:47:16,451 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:47:18,452 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:47:20,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:47:21,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:47:21,365 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:47:22,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:47:24,455 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:47:26,456 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:47:28,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:47:30,210 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:47:30,458 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:47:32,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:47:34,460 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:47:36,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:47:36,738 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:47:37,461 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:47:39,462 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:47:41,463 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:47:43,464 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:47:45,465 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:47:47,466 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:47:49,467 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:47:51,468 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:47:52,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:47:52,034 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:47:53,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:47:55,470 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:47:57,471 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:47:59,472 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:48:00,284 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:48:01,473 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:48:03,474 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:48:05,475 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:48:07,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:48:07,258 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:48:07,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:48:09,480 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:48:11,481 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:48:13,482 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:48:15,483 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:48:17,484 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:48:19,484 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:48:21,485 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:48:22,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:48:22,608 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:48:23,487 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:48:25,487 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:48:27,488 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:48:29,489 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:48:30,360 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:48:31,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:48:33,491 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:48:35,492 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:48:37,492 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:48:37,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:48:37,939 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:48:39,493 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:48:41,494 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:48:43,495 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:48:45,496 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:48:47,496 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:48:49,497 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:48:51,501 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:48:53,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:48:53,165 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:48:54,502 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:48:56,503 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:48:58,503 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:49:00,435 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:49:00,504 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:49:02,505 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:49:04,506 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:49:06,507 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:49:08,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:49:08,391 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:49:08,508 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:49:10,509 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:49:12,510 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:49:14,511 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:49:16,511 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:49:18,512 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:49:20,513 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:49:22,514 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:49:23,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:49:23,698 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:49:24,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:49:26,516 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:49:28,516 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:49:30,507 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:49:30,517 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:49:32,518 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:49:34,519 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:49:36,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:49:38,521 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:49:39,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:49:39,076 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:49:40,522 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:49:42,523 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:49:44,524 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:49:46,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:49:48,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:49:50,526 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:49:52,527 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:49:54,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:49:54,387 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:49:54,528 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:49:56,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:49:58,530 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:50:00,530 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:50:00,581 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:50:02,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:50:04,532 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:50:07,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:50:09,534 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:50:09,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:50:09,636 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:50:11,534 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:50:13,535 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:50:15,536 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:50:17,536 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:50:19,537 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:50:21,538 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:50:23,538 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:50:24,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:50:24,869 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:50:25,539 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:50:27,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:50:29,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:50:30,653 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:50:31,541 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:50:33,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:50:35,543 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:50:37,544 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:50:39,544 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:50:40,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:50:40,185 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:50:41,545 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:50:43,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:50:45,547 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:50:47,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:50:49,549 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:50:51,550 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:50:53,551 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:50:55,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:50:55,478 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:50:55,552 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:50:57,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:50:59,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:51:00,726 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:51:01,555 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:51:03,555 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:51:05,556 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:51:07,557 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:51:09,558 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:51:10,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:51:10,774 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:51:11,559 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:51:13,559 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:51:15,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:51:17,561 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:51:19,562 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:51:21,563 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:51:23,563 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:51:25,564 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:51:25,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:51:25,998 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:51:27,565 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:51:29,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:51:30,799 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:51:31,567 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:51:33,567 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:51:35,568 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:51:38,569 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:51:40,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:51:41,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:51:41,274 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:51:42,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:51:44,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:51:46,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:51:48,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:51:50,574 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:51:52,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:51:54,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:51:56,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:51:56,520 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:51:56,576 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:51:58,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:52:00,578 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:52:00,872 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:52:02,579 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:52:04,580 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:52:06,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:52:08,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:52:10,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:52:11,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:52:11,914 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:52:12,583 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:52:14,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:52:16,585 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:52:18,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:52:20,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:52:22,587 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:52:24,588 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:52:26,589 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:52:27,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:52:27,185 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:52:28,590 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:52:30,591 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:52:30,946 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:52:32,592 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:52:34,592 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:52:36,593 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:52:38,594 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:52:40,595 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:52:42,596 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:52:42,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:52:42,729 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:52:44,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:52:46,598 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:52:48,599 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:52:50,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:52:52,601 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:52:54,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:52:56,603 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:52:58,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:52:58,128 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:52:58,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:53:00,605 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:53:01,020 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:53:02,606 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:53:04,607 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:53:06,608 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:53:08,608 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:53:10,609 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:53:13,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:53:13,373 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:53:13,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:53:15,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:53:17,613 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:53:19,614 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:53:21,615 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:53:23,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:53:25,617 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:53:27,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:53:28,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:53:28,680 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:53:29,619 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:53:31,093 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:53:31,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:53:33,621 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:53:35,622 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:53:37,623 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:53:39,624 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:53:41,624 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:53:43,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:53:43,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:53:43,903 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:53:45,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:53:47,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:53:49,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:53:51,629 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:53:53,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:53:55,631 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:53:57,632 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:53:59,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:53:59,124 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:53:59,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:54:01,169 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:54:01,634 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:54:03,634 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:54:05,635 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:54:07,636 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:54:09,637 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:54:11,637 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:54:13,638 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:54:14,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:54:14,389 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:54:15,639 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:54:17,640 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:54:20,641 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:54:22,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:54:24,643 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:54:26,643 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:54:28,644 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:54:29,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:54:29,617 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:54:30,645 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:54:31,244 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:54:32,646 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:54:34,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:54:36,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:54:38,648 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:54:40,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:54:42,651 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:54:44,652 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:54:44,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:54:44,838 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:54:46,653 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:54:48,653 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:54:50,654 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:54:52,655 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:54:54,657 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:54:56,658 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:54:58,659 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:55:00,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:55:00,159 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:55:00,659 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:55:01,320 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:55:02,660 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:55:04,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:55:06,663 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:55:08,664 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:55:10,665 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:55:12,666 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:55:14,667 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:55:15,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:55:15,385 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:55:16,667 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:55:18,668 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:55:20,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:55:22,670 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:55:24,671 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:55:26,672 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:55:28,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:55:30,674 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:55:30,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:55:30,711 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:55:31,382 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:55:32,675 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:55:34,676 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:55:36,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:55:38,678 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:55:40,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:55:42,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:55:44,680 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:55:45,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:55:45,934 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:55:46,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:55:48,682 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:55:51,683 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:55:53,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:55:55,685 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:55:57,685 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:55:59,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:56:01,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:56:01,182 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:56:01,438 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:56:01,687 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:56:03,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:56:05,689 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:56:07,690 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:56:09,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:56:11,692 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:56:13,693 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:56:15,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:56:16,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:56:16,404 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:56:17,695 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:56:19,696 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:56:21,697 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:56:23,697 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:56:25,698 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:56:27,699 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:56:29,699 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:56:31,497 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:56:31,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:56:31,675 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:56:31,700 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:56:33,701 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:56:35,702 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:56:37,702 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:56:39,703 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:56:41,704 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:56:43,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:56:45,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:56:46,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:56:46,990 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:56:47,706 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:56:49,707 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:56:51,708 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:56:53,708 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:56:55,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:56:57,710 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:56:59,710 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:57:01,572 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:57:01,711 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:57:02,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:57:02,411 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:57:03,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:57:05,713 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:57:07,714 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:57:09,715 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:57:11,715 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:57:13,716 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:57:15,717 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:57:17,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:57:17,707 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:57:17,718 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:57:19,719 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:57:21,719 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:57:24,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:57:26,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:57:28,722 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:57:30,723 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:57:31,650 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:57:32,723 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:57:32,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:57:32,934 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:57:34,724 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:57:36,725 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:57:38,726 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:57:40,727 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:57:42,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:57:44,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:57:46,729 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:57:48,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:57:48,190 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:57:48,730 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:57:50,730 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:57:52,731 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:57:54,731 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:57:56,732 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:57:58,733 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:58:00,734 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:58:01,721 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:58:02,734 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:58:03,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:58:03,447 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:58:04,735 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:58:06,736 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:58:08,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:58:10,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:58:12,738 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:58:14,739 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:58:16,740 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:58:18,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:58:18,669 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:58:18,741 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:58:20,742 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:58:22,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:58:24,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:58:26,744 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:58:28,745 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:58:30,746 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:58:31,794 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:58:32,747 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:58:33,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:58:33,986 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:58:34,747 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:58:37,749 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:58:39,750 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:58:41,751 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:58:43,752 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:58:45,753 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:58:47,754 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:58:49,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:58:49,333 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:58:49,755 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:58:51,756 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:58:53,757 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:58:55,758 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:58:57,759 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:58:59,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:59:01,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:59:01,866 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:59:03,761 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:59:04,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:59:04,715 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:59:05,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:59:07,763 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:59:09,764 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:59:11,765 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:59:13,766 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:59:15,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:59:17,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:59:19,769 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:59:19,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:59:19,939 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:59:21,770 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:59:23,771 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:59:25,772 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:59:27,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:59:29,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:59:31,775 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:59:31,942 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 05:59:33,776 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:59:35,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:59:35,318 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:59:35,777 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:59:37,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:59:39,779 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:59:41,779 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:59:43,780 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:59:45,781 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:59:47,782 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:59:49,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:59:50,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 05:59:50,554 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 05:59:51,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:59:53,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:59:55,785 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:59:57,786 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 05:59:59,787 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:00:01,788 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:00:02,014 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:00:03,788 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:00:05,789 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:00:05,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:00:05,820 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:00:07,790 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:00:09,791 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:00:12,792 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:00:14,793 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:00:16,793 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:00:18,794 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:00:20,795 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:00:21,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:00:21,100 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:00:22,796 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:00:24,797 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:00:26,798 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:00:28,799 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:00:30,800 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:00:32,123 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:00:32,801 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:00:34,802 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:00:36,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:00:36,377 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:00:36,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:00:38,804 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:00:40,805 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:00:42,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:00:44,807 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:00:46,808 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:00:48,808 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:00:50,810 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:00:51,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:00:51,683 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:00:52,811 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:00:54,811 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:00:56,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:00:58,813 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:01:00,814 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:01:02,162 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:01:02,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:01:04,816 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:01:06,817 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:01:06,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:01:06,943 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:01:08,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:01:10,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:01:12,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:01:14,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:01:16,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:01:18,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:01:20,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:01:22,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:01:22,250 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:01:22,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:01:24,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:01:26,826 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:01:28,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:01:30,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:01:32,234 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:01:32,829 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:01:35,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:01:37,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:01:37,594 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:01:37,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:01:39,831 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:01:41,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:01:43,833 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:01:45,834 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:01:47,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:01:49,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:01:51,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:01:52,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:01:52,863 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:01:53,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:01:55,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:01:57,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:01:59,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:02:01,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:02:02,309 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:02:03,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:02:05,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:02:07,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:02:08,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:02:08,149 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:02:09,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:02:11,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:02:13,846 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:02:15,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:02:17,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:02:19,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:02:21,849 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:02:23,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:02:23,474 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:02:23,850 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:02:25,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:02:27,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:02:29,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:02:31,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:02:32,386 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:02:33,854 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:02:35,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:02:37,856 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:02:38,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:02:38,698 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:02:39,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:02:41,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:02:43,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:02:45,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:02:47,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:02:49,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:02:51,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:02:53,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:02:53,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:02:53,919 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:02:55,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:02:57,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:02:59,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:03:01,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:03:02,463 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:03:04,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:03:06,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:03:08,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:03:09,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:03:09,192 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:03:10,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:03:12,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:03:14,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:03:16,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:03:18,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:03:20,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:03:22,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:03:24,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:03:24,486 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:03:24,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:03:26,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:03:28,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:03:30,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:03:32,538 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:03:32,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:03:34,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:03:36,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:03:38,882 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:03:39,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:03:39,714 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:03:40,882 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:03:42,883 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:03:44,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:03:46,885 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:03:48,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:03:50,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:03:52,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:03:54,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:03:55,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:03:55,053 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:03:56,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:03:58,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:04:00,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:04:02,611 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:04:02,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:04:04,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:04:07,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:04:09,894 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:04:10,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:04:10,278 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:04:11,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:04:13,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:04:15,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:04:17,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:04:19,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:04:21,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:04:23,900 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:04:25,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:04:25,502 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:04:25,901 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:04:27,902 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:04:29,902 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:04:31,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:04:32,682 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:04:33,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:04:35,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:04:37,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:04:39,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:04:40,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:04:40,849 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:04:41,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:04:43,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:04:45,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:04:47,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:04:49,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:04:51,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:04:53,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:04:55,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:04:56,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:04:56,087 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:04:57,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:04:59,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:05:01,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:05:02,754 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:05:03,916 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:05:05,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:05:07,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:05:09,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:05:11,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:05:11,349 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:05:11,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:05:13,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:05:15,921 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:05:17,922 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:05:19,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:05:21,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:05:23,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:05:25,925 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:05:26,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:05:26,597 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:05:27,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:05:29,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:05:31,927 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:05:32,825 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:05:33,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:05:35,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:05:37,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:05:39,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:05:41,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:05:41,891 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:05:41,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:05:43,932 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:05:46,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:05:48,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:05:50,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:05:52,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:05:54,935 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:05:56,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:05:57,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:05:57,194 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:05:58,937 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:06:00,938 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:06:02,897 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:06:02,939 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:06:04,940 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:06:06,941 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:06:08,942 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:06:10,942 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:06:12,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:06:12,743 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:06:12,943 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:06:14,944 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:06:16,945 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:06:18,946 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:06:20,947 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:06:22,948 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:06:24,949 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:06:26,949 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:06:28,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:06:28,085 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:06:28,950 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:06:30,951 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:06:32,952 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:06:32,974 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:06:34,953 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:06:36,954 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:06:38,955 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:06:40,956 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:06:42,957 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:06:43,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:06:43,385 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:06:44,958 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:06:46,958 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:06:48,959 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:06:50,960 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:06:52,961 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:06:54,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:06:56,963 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:06:58,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:06:58,757 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:06:58,964 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:07:00,965 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:07:02,966 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:07:03,041 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:07:04,967 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:07:06,967 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:07:08,969 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:07:10,969 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:07:12,970 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:07:14,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:07:14,070 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:07:14,971 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:07:16,972 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:07:18,973 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:07:20,974 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:07:22,975 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:07:24,976 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:07:26,977 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:07:28,978 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:07:29,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:07:29,515 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:07:30,979 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:07:32,980 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:07:33,113 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:07:34,980 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:07:36,981 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:07:38,982 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:07:40,982 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:07:43,984 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:07:44,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:07:44,784 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:07:45,985 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:07:47,985 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:07:49,986 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:07:51,987 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:07:53,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:07:55,989 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:07:57,990 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:07:59,990 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:08:00,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:08:00,039 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:08:01,991 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:08:03,180 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:08:03,992 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:08:05,993 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:08:07,993 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:08:09,994 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:08:11,995 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:08:13,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:08:15,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:08:15,593 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:08:15,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:08:17,997 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:08:19,998 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:08:21,998 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:08:23,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:08:26,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:08:28,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:08:30,001 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:08:30,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:08:30,818 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:08:32,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:08:33,256 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:08:34,003 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:08:36,003 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:08:38,004 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:08:40,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:08:42,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:08:44,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:08:46,007 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:08:46,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:08:46,189 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:08:48,008 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:08:50,009 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:08:52,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:08:54,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:08:56,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:08:58,012 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:09:00,013 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:09:01,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:09:01,607 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:09:02,014 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:09:03,332 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:09:04,015 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:09:06,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:09:08,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:09:10,017 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:09:12,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:09:14,019 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:09:16,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:09:16,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:09:16,829 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:09:18,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:09:20,021 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:09:22,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:09:24,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:09:27,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:09:29,025 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:09:31,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:09:32,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:09:32,147 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:09:33,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:09:33,409 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:09:35,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:09:37,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:09:39,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:09:41,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:09:43,031 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:09:45,032 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:09:47,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:09:47,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:09:47,427 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:09:49,034 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:09:51,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:09:53,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:09:55,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:09:57,038 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:09:59,039 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:10:01,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:10:02,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:10:02,656 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:10:03,041 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:10:03,485 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:10:05,042 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:10:07,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:10:09,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:10:11,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:10:13,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:10:15,047 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:10:17,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:10:17,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:10:17,915 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:10:19,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:10:21,049 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:10:23,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:10:25,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:10:27,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:10:29,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:10:31,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:10:33,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:10:33,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:10:33,247 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:10:33,560 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:10:35,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:10:37,056 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:10:39,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:10:42,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:10:44,059 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:10:46,060 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:10:48,061 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:10:48,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:10:48,529 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:10:50,063 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:10:52,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:10:54,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:10:56,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:10:58,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:11:00,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:11:02,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:11:03,637 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:11:03,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:11:03,751 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:11:04,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:11:06,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:11:08,071 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:11:10,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:11:12,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:11:14,074 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:11:16,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:11:18,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:11:18,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:11:18,998 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:11:20,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:11:22,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:11:24,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:11:26,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:11:28,081 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:11:30,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:11:32,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:11:33,714 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:11:34,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:11:34,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:11:34,274 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:11:36,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:11:38,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:11:40,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:11:42,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:11:44,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:11:46,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:11:48,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:11:49,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:11:49,497 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:11:50,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:11:52,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:11:54,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:11:56,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:11:58,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:12:00,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:12:02,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:12:03,787 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:12:04,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:12:04,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:12:04,718 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:12:06,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:12:08,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:12:10,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:12:12,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:12:14,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:12:16,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:12:18,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:12:20,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:12:20,091 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:12:20,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:12:23,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:12:25,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:12:27,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:12:29,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:12:31,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:12:33,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:12:33,862 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:12:35,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:12:35,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:12:35,312 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:12:37,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:12:39,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:12:41,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:12:43,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:12:45,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:12:47,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:12:49,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:12:50,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:12:50,602 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:12:51,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:12:53,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:12:55,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:12:57,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:12:59,121 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:13:01,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:13:03,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:13:03,935 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:13:05,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:13:05,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:13:05,877 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:13:07,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:13:09,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:13:11,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:13:13,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:13:15,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:13:17,128 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:13:19,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:13:21,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:13:21,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:13:21,196 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:13:23,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:13:25,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:13:27,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:13:30,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:13:32,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:13:34,010 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:13:34,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:13:36,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:13:36,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:13:36,502 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:13:38,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:13:40,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:13:42,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:13:44,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:13:46,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:13:48,140 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:13:50,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:13:51,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:13:51,832 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:13:52,142 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:13:54,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:13:56,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:13:58,145 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:14:00,146 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:14:02,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:14:04,091 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:14:04,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:14:06,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:14:07,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:14:07,076 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:14:08,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:14:10,150 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:14:12,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:14:14,152 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:14:16,153 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:14:18,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:14:20,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:14:22,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:14:22,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:14:22,328 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:14:24,157 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:14:26,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:14:28,159 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:14:30,160 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:14:32,160 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:14:34,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:14:34,166 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:14:36,162 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:14:37,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:14:37,629 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:14:38,163 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:14:40,164 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:14:42,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:14:44,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:14:46,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:14:48,168 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:14:50,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:14:52,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:14:52,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:14:52,853 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:14:54,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:14:56,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:14:58,172 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:15:00,172 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:15:02,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:15:04,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:15:04,241 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:15:06,175 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:15:08,176 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:15:08,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:15:08,199 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:15:10,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:15:12,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:15:14,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:15:16,179 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:15:18,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:15:20,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:15:22,182 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:15:23,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:15:23,551 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:15:24,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:15:26,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:15:28,184 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:15:34,316 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:15:38,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:15:38,775 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:15:54,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:15:54,011 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:16:04,392 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:16:09,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:16:09,279 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:16:24,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:16:24,593 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:16:27,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:16:27,445 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 06:16:27,496 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 06:16:27,573 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 06:16:28,207 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 06:16:28,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:16:30,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:16:34,493 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:16:37,212 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:16:39,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:16:39,873 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:16:55,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:16:55,097 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:16:57,221 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:17:04,574 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:17:10,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:17:10,323 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:17:25,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:17:25,549 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:17:34,652 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:17:40,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:17:40,775 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:17:56,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:17:56,012 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:18:04,731 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:18:11,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:18:11,239 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:18:26,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:18:26,512 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:18:34,810 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:18:41,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:18:41,787 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:18:57,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:18:57,013 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:19:04,887 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:19:12,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:19:12,235 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:19:27,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:19:27,460 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:19:34,968 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:19:42,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:19:42,689 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:19:57,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:19:57,928 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:20:05,045 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:20:13,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:20:13,153 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:20:28,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:20:28,427 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:20:35,123 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:20:43,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:20:43,653 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:20:50,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:20:51,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:20:53,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:20:59,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:20:59,126 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:21:03,335 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:21:05,199 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:21:06,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:06,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:06,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:06,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:06,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:06,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:06,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:06,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:06,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:06,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:06,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:06,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:06,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:06,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:06,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:06,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:09,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:21:13,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:21:14,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:21:14,579 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:21:17,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:21:21,342 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:21:22,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:22,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:22,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:22,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:22,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:22,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:22,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:22,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:22,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:22,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:22,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:22,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:22,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:22,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:22,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:22,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:25,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:21:27,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:21:27,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:27,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:27,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:27,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:27,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:27,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:27,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:27,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:27,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:27,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:27,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:27,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:27,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:27,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:27,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:27,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:29,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:21:29,922 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:21:31,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:31,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:31,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:31,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:31,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:31,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:31,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:31,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:31,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:31,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:31,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:31,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:31,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:31,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:31,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:31,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:31,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:21:35,276 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:21:35,346 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:21:37,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:21:38,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:38,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:38,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:38,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:38,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:38,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:38,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:38,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:38,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:38,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:38,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:38,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:38,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:38,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:38,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:38,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:41,348 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:21:43,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:21:44,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:44,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:44,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:44,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:44,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:44,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:44,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:44,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:44,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:44,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:44,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:44,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:44,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:44,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:44,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:44,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:45,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:21:45,275 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:21:47,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:21:47,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:47,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:47,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:47,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:47,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:47,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:47,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:47,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:47,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:47,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:47,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:47,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:47,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:47,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:47,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:47,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:49,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:21:51,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:21:51,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:51,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:51,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:51,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:51,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:51,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:51,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:51,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:51,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:51,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:51,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:51,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:51,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:51,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:51,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:51,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:51,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:51,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:51,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:51,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:51,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:51,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:51,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:51,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:51,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:51,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:51,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:51,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:51,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:51,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:51,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:51,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:53,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:53,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:53,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:53,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:53,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:53,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:53,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:53,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:53,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:53,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:53,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:53,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:53,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:53,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:53,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:53,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:54,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:54,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:54,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:54,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:54,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:54,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:54,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:54,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:54,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:54,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:54,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:54,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:54,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:54,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:54,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:54,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:54,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:54,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:54,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:54,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:54,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:54,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:54,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:54,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:54,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:54,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:54,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:54,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:54,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:54,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:54,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:54,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:55,354 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:21:56,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:56,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:56,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:56,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:56,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:56,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:56,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:56,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:56,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:56,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:56,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:56,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:56,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:56,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:56,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:56,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:21:57,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:22:00,356 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:22:00,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:22:00,614 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:22:02,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:02,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:02,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:02,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:02,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:02,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:02,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:02,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:02,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:02,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:02,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:02,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:02,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:02,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:02,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:02,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:04,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:22:04,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:04,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:04,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:04,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:04,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:04,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:04,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:04,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:04,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:04,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:04,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:04,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:04,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:04,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:04,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:04,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:05,352 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:22:06,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:06,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:06,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:06,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:06,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:06,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:06,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:06,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:06,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:06,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:06,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:06,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:06,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:06,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:06,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:06,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:06,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:22:07,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:07,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:07,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:07,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:07,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:07,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:07,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:07,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:07,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:07,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:07,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:07,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:07,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:07,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:07,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:07,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:08,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:22:10,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:22:11,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:11,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:11,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:11,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:11,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:11,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:11,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:11,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:11,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:11,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:11,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:11,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:11,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:11,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:11,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:11,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:11,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:11,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:11,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:11,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:11,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:11,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:11,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:11,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:11,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:11,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:11,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:11,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:11,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:11,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:11,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:11,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:12,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:22:12,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:12,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:12,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:12,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:12,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:12,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:12,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:12,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:12,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:12,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:12,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:12,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:12,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:12,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:12,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:12,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:14,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:14,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:14,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:14,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:14,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:14,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:14,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:14,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:14,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:14,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:14,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:14,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:14,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:14,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:14,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:14,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:15,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:22:15,836 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:22:16,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:22:16,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:16,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:16,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:16,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:16,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:16,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:16,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:16,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:16,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:16,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:16,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:16,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:16,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:16,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:16,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:16,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:18,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:22:20,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:22:20,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:20,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:22,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:22:22,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:22,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:22,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:22,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:22,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:22,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:22,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:22,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:22,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:22,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:22,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:22,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:22,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:22,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:22,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:22,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:24,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:22:26,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:22:26,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:26,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:26,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:26,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:26,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:26,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:26,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:26,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:26,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:26,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:26,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:26,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:26,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:26,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:26,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:26,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:28,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:22:29,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:29,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:29,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:29,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:29,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:29,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:29,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:29,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:29,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:29,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:29,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:29,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:29,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:29,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:29,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:29,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:30,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:22:31,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:22:31,104 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:22:31,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:31,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:31,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:31,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:31,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:31,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:31,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:31,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:31,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:31,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:31,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:31,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:31,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:31,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:31,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:31,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:32,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:22:34,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:22:35,428 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:22:36,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:36,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:36,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:36,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:36,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:36,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:36,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:36,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:36,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:36,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:36,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:36,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:36,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:36,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:36,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:36,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:36,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:22:37,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:37,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:38,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:22:38,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:38,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:38,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:38,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:38,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:38,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:38,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:38,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:38,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:38,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:38,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:38,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:38,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:38,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:38,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:38,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:38,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:38,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:38,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:38,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:38,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:38,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:38,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:38,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:38,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:38,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:38,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:38,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:38,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:38,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:38,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:38,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:39,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:40,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:40,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:40,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:40,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:40,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:40,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:40,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:40,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:40,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:40,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:40,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:40,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:40,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:40,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:40,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:40,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:40,371 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:22:41,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:41,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:41,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:41,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:41,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:41,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:41,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:41,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:41,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:41,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:41,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:41,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:41,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:41,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:41,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:41,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:42,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:22:43,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:43,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:43,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:43,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:43,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:43,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:43,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:43,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:43,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:43,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:43,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:43,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:43,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:43,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:43,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:43,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:43,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:43,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:43,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:43,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:43,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:43,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:43,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:43,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:43,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:43,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:43,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:43,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:43,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:43,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:43,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:43,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:44,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:22:46,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:46,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:46,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:46,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:46,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:46,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:46,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:46,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:46,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:46,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:46,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:46,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:46,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:46,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:46,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:46,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:46,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:22:46,373 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:22:46,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:22:48,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:48,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:48,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:48,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:48,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:48,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:48,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:48,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:48,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:48,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:48,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:48,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:48,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:48,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:48,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:48,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:48,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:22:48,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:48,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:48,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:48,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:48,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:48,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:48,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:48,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:48,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:48,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:48,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:48,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:48,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:48,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:48,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:48,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:49,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:49,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:49,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:49,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:49,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:49,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:49,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:49,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:49,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:49,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:49,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:49,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:49,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:49,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:49,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:49,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:50,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:22:51,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:51,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:51,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:51,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:51,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:51,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:51,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:51,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:51,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:51,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:51,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:51,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:52,376 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:22:54,377 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:22:55,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:55,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:55,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:55,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:55,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:55,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:55,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:55,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:55,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:55,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:55,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:55,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:55,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:55,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:55,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:55,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:59,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:59,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:59,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:59,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:59,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:59,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:59,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:59,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:59,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:59,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:59,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:59,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:59,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:59,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:59,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:22:59,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:01,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:23:01,600 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:23:02,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:23:05,504 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:23:08,382 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:23:11,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:11,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:11,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:11,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:11,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:11,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:11,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:11,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:11,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:11,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:11,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:11,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:11,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:11,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:11,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:11,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:12,384 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:23:14,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:23:16,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:23:16,829 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:23:18,387 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:23:22,388 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:23:26,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:23:27,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:27,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:27,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:27,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:27,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:27,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:27,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:27,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:27,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:27,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:27,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:27,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:27,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:27,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:27,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:27,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:30,391 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:23:32,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:23:32,194 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:23:34,393 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:23:34,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:34,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:34,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:34,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:34,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:34,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:34,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:34,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:34,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:34,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:34,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:34,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:34,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:34,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:34,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:34,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:35,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:35,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:35,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:35,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:35,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:35,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:35,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:35,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:35,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:35,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:35,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:35,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:35,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:35,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:35,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:35,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:35,583 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:23:36,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:23:40,396 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:23:42,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:23:46,399 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:23:46,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:46,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:46,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:46,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:46,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:46,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:46,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:46,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:46,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:46,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:46,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:46,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:46,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:46,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:46,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:46,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:47,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:23:47,550 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:23:48,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:48,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:48,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:48,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:48,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:48,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:48,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:48,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:48,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:48,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:48,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:48,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:48,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:48,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:48,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:48,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:48,399 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:23:50,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:23:50,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:50,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:50,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:50,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:50,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:50,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:50,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:50,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:50,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:50,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:50,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:50,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:50,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:50,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:50,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:50,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:54,402 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:23:54,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:54,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:54,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:54,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:54,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:54,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:54,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:54,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:54,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:54,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:54,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:54,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:54,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:54,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:54,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:54,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:54,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:54,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:54,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:54,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:54,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:54,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:54,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:54,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:54,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:54,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:54,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:54,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:54,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:54,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:54,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:54,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:23:56,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:56,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:57,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:57,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:57,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:57,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:57,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:57,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:57,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:57,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:57,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:57,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:57,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:57,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:57,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:57,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:57,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:57,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:23:58,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:24:02,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:24:02,864 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:24:03,406 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:24:05,407 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:24:05,657 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:24:06,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:06,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:06,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:06,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:06,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:06,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:06,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:06,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:06,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:06,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:06,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:06,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:06,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:06,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:06,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:06,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:07,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:24:08,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:08,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:08,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:08,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:08,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:08,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:08,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:08,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:08,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:08,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:08,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:08,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:08,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:08,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:08,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:08,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:09,409 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:24:11,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:24:11,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:11,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:11,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:11,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:11,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:11,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:11,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:11,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:11,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:11,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:11,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:11,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:11,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:11,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:11,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:11,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:12,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:12,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:12,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:12,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:12,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:12,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:12,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:12,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:12,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:12,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:12,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:12,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:12,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:12,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:12,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:12,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:13,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:24:13,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:13,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:13,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:13,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:13,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:13,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:13,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:13,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:13,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:13,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:13,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:13,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:13,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:13,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:13,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:13,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:13,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:13,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:13,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:13,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:13,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:13,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:13,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:13,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:13,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:13,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:13,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:13,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:13,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:13,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:13,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:13,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:15,411 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:24:16,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:16,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:16,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:16,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:16,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:16,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:16,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:16,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:16,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:16,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:16,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:16,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:16,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:16,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:16,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:16,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:16,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:16,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:16,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:16,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:16,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:16,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:16,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:16,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:16,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:16,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:16,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:16,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:16,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:16,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:16,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:16,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:17,412 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:24:18,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:24:18,140 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:24:19,413 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:24:19,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:19,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:19,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:19,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:19,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:19,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:19,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:19,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:19,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:19,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:19,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:19,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:19,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:19,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:19,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:19,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:21,414 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:24:22,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:22,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:22,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:22,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:22,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:22,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:22,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:22,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:22,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:22,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:22,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:22,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:22,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:22,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:22,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:22,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:23,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:24:23,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:23,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:23,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:23,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:23,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:23,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:23,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:23,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:23,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:23,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:23,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:23,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:23,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:23,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:23,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:23,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:24,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:24,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:24,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:24,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:24,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:24,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:24,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:24,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:24,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:24,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:24,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:24,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:24,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:24,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:24,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:24,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:25,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:24:25,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:25,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:25,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:25,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:25,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:25,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:25,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:25,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:25,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:25,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:25,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:25,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:25,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:25,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:25,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:25,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:27,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:24:29,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:29,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:29,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:29,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:29,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:29,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:29,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:29,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:29,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:29,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:29,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:29,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:29,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:29,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:29,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:29,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:29,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:24:30,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:30,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:30,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:30,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:30,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:30,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:30,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:30,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:30,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:30,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:30,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:30,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:30,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:30,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:30,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:30,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:31,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:24:32,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:32,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:32,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:32,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:32,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:32,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:32,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:32,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:32,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:32,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:32,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:32,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:32,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:32,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:32,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:32,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:33,419 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:24:33,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:24:33,453 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:24:35,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:24:35,733 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:24:37,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:37,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:37,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:37,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:37,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:37,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:37,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:37,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:37,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:37,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:37,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:37,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:37,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:37,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:37,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:37,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:37,421 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:24:38,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:38,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:38,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:38,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:38,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:38,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:38,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:38,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:38,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:38,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:38,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:38,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:38,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:38,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:38,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:38,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:38,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:38,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:38,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:38,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:38,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:38,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:38,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:38,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:38,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:38,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:38,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:38,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:38,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:38,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:38,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:38,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:24:39,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:39,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:40,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:40,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:40,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:40,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:40,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:40,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:40,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:40,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:40,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:40,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:40,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:40,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:40,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:40,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:40,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:40,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:41,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:24:41,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:41,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:41,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:41,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:41,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:41,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:41,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:41,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:41,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:41,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:41,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:41,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:41,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:41,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:41,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:41,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:41,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:41,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:41,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:41,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:41,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:41,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:41,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:41,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:41,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:41,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:41,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:41,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:41,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:41,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:41,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:41,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:24:43,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:43,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:44,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:44,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:44,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:44,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:44,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:44,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:44,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:44,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:44,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:44,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:44,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:44,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:44,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:44,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:44,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:44,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:45,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:24:46,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:46,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:46,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:46,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:46,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:46,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:46,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:46,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:46,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:46,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:46,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:46,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:46,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:46,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:46,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:46,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:47,425 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:24:48,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:24:48,737 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:24:48,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:48,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:48,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:48,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:48,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:48,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:48,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:48,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:48,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:48,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:48,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:48,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:48,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:48,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:48,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:48,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:49,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:24:50,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:50,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:50,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:50,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:50,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:50,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:50,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:50,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:50,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:50,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:50,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:50,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:50,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:50,478 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 06:24:50,731 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 06:24:50,809 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 06:24:51,514 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 06:24:51,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:24:53,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:53,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:53,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:53,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:53,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:53,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:53,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:53,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:53,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:53,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:53,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:53,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:53,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:53,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:53,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:53,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:56,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:56,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:56,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:56,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:56,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:56,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:56,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:56,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:56,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:56,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:56,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:56,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:56,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:56,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:56,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:56,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:57,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:57,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:57,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:57,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:57,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:57,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:57,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:57,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:57,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:57,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:57,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:57,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:57,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:57,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:57,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:57,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:24:59,517 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:25:03,519 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:25:03,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:25:03,956 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:25:04,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:04,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:04,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:04,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:04,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:04,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:04,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:04,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:04,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:04,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:04,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:04,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:04,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:04,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:04,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:04,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:05,845 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:25:09,521 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:25:13,522 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:25:15,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:15,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:15,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:15,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:15,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:15,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:15,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:15,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:15,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:15,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:15,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:15,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:15,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:15,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:15,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:15,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:17,524 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:25:19,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:25:19,192 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:25:21,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:25:23,526 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:25:27,528 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:25:31,530 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:25:33,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:25:34,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:25:34,576 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:25:35,921 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:25:36,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:36,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:36,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:36,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:36,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:36,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:36,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:36,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:36,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:36,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:36,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:36,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:36,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:36,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:36,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:36,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:37,532 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:25:39,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:25:39,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:39,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:39,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:39,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:39,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:39,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:39,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:39,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:39,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:39,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:39,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:39,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:39,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:39,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:39,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:39,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:39,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:39,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:39,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:39,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:39,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:39,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:39,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:39,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:39,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:39,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:39,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:39,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:39,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:39,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:39,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:39,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:43,534 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:25:45,535 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:25:47,536 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:25:48,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:48,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:48,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:48,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:48,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:48,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:48,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:48,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:48,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:48,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:48,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:48,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:48,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:48,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:48,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:48,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:49,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:25:49,891 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:25:50,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:50,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:50,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:50,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:50,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:50,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:50,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:50,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:50,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:50,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:50,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:50,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:50,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:50,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:50,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:50,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:50,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:50,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:50,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:50,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:50,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:50,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:50,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:50,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:50,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:50,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:50,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:50,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:50,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:50,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:50,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:50,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:51,538 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:25:53,538 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:25:55,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:55,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:55,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:55,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:55,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:55,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:55,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:55,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:55,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:55,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:55,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:55,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:55,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:55,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:55,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:55,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:56,539 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:25:56,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:56,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:56,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:56,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:56,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:56,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:56,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:56,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:56,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:56,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:56,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:56,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:56,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:56,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:56,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:56,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:58,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:58,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:58,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:58,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:58,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:58,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:58,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:58,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:58,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:58,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:58,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:58,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:58,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:58,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:58,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:58,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:25:58,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:26:00,541 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:26:01,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:01,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:01,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:01,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:01,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:01,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:01,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:01,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:01,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:01,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:01,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:01,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:01,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:01,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:01,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:01,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:03,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:03,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:03,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:03,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:03,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:03,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:03,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:03,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:03,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:03,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:03,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:03,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:03,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:03,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:03,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:03,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:04,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:26:05,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:26:05,199 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:26:05,995 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:26:06,543 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:26:06,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:06,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:06,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:06,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:06,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:06,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:06,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:06,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:06,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:06,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:06,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:06,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:06,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:06,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:06,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:06,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:07,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:07,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:07,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:07,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:07,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:07,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:07,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:07,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:07,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:07,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:07,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:07,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:07,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:07,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:07,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:07,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:08,544 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:26:09,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:09,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:09,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:09,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:09,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:09,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:09,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:09,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:09,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:09,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:09,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:09,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:09,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:09,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:09,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:09,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:10,545 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:26:11,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:11,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:11,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:11,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:11,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:11,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:11,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:11,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:11,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:11,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:11,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:11,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:11,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:11,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:11,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:11,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:12,545 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:26:13,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:13,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:13,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:13,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:13,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:13,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:13,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:13,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:13,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:13,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:13,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:13,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:13,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:13,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:13,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:13,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:14,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:26:15,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:15,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:15,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:15,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:15,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:15,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:15,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:15,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:15,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:15,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:15,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:15,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:15,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:15,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:15,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:15,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:15,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:15,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:15,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:15,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:15,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:15,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:15,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:15,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:15,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:15,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:15,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:15,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:15,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:15,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:15,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:15,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:16,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:16,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:16,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:16,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:16,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:16,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:16,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:16,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:16,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:16,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:16,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:16,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:16,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:16,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:16,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:16,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:16,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:16,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:16,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:16,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:16,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:16,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:16,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:16,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:16,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:16,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:16,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:16,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:16,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:16,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:16,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:16,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:16,547 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:26:18,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:26:18,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:18,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:18,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:18,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:18,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:18,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:18,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:18,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:18,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:18,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:18,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:18,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:18,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:18,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:18,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:18,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:20,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:26:20,424 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:26:20,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:26:22,549 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:26:23,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:23,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:23,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:23,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:23,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:23,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:23,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:23,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:23,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:23,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:23,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:23,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:23,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:23,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:23,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:23,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:23,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:23,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:23,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:23,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:23,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:23,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:23,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:23,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:23,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:23,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:23,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:23,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:23,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:23,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:23,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:23,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:24,550 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:26:24,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:24,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:24,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:24,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:24,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:24,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:24,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:24,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:24,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:24,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:24,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:24,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:24,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:24,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:24,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:24,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:24,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:24,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:24,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:24,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:24,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:24,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:24,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:24,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:24,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:24,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:24,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:24,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:24,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:24,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:24,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:24,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:25,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:25,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:25,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:25,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:25,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:25,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:25,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:25,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:25,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:25,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:25,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:25,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:25,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:25,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:25,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:25,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:26,551 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:26:28,552 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:26:30,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:30,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:30,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:30,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:30,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:30,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:30,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:30,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:30,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:30,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:30,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:30,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:30,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:30,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:30,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:30,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:30,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:26:32,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:32,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:32,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:32,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:32,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:32,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:32,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:32,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:32,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:32,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:32,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:32,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:32,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:32,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:32,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:32,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:32,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:26:34,555 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:26:35,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:26:35,648 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:26:35,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:35,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:36,070 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:26:36,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:36,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:36,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:36,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:36,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:36,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:36,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:36,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:36,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:36,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:36,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:36,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:36,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:36,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:36,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:36,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:36,555 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:26:37,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:37,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:37,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:37,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:37,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:37,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:37,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:37,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:37,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:37,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:37,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:37,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:37,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:37,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:37,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:37,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:37,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:37,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:37,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:37,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:37,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:37,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:37,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:37,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:37,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:37,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:37,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:37,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:37,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:37,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:37,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:37,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:38,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:38,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:38,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:38,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:38,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:38,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:38,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:38,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:38,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:38,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:38,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:38,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:38,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:38,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:38,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:38,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:38,556 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:26:39,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:39,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:39,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:39,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:39,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:39,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:39,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:39,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:39,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:39,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:39,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:39,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:39,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:39,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:39,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:39,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:40,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:40,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:40,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:40,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:40,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:40,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:40,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:40,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:40,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:40,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:40,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:40,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:40,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:40,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:40,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:40,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:40,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:40,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:40,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:40,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:40,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:40,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:40,557 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:26:40,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:40,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:40,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:40,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:40,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:40,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:40,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:40,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:40,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:40,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:41,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:41,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:41,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:41,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:41,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:41,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:41,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:41,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:41,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:41,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:41,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:41,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:41,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:41,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:41,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:41,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:42,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:42,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:42,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:42,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:42,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:42,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:42,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:42,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:42,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:42,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:42,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:42,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:42,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:42,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:42,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:42,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:42,558 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:26:44,559 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:26:44,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:44,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:44,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:44,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:44,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:44,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:44,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:44,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:44,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:44,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:44,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:44,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:44,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:44,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:44,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:44,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:45,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:45,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:45,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:45,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:45,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:45,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:45,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:45,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:45,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:45,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:45,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:45,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:46,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:26:48,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:26:48,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:48,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:48,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:48,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:48,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:48,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:48,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:48,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:48,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:48,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:48,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:48,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:48,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:48,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:48,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:48,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:50,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:26:50,872 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:26:56,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:56,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:56,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:56,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:56,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:56,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:56,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:56,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:56,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:56,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:56,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:56,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:56,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:56,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:56,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:56,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:56,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:56,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:56,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:56,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:56,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:56,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:56,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:56,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:56,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:56,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:56,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:56,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:56,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:56,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:56,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:56,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:26:56,563 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:27:00,565 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:27:01,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:01,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:01,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:01,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:01,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:01,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:01,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:01,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:01,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:01,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:01,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:01,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:01,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:01,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:01,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:01,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:06,142 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:27:06,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:27:06,226 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:27:06,567 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:27:08,568 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:27:12,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:27:13,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:13,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:13,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:13,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:13,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:13,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:13,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:13,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:13,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:13,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:13,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:13,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:13,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:13,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:13,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:13,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:16,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:27:18,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:18,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:18,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:18,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:18,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:18,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:18,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:18,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:18,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:18,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:18,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:18,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:18,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:18,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:18,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:18,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:20,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:27:21,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:27:21,475 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:27:24,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:27:26,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:27:30,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:27:32,578 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:27:36,219 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:27:36,580 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:27:36,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:27:36,698 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:27:38,580 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:27:38,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:38,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:38,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:38,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:38,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:38,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:38,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:38,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:38,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:38,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:38,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:38,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:38,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:38,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:38,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:38,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:41,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:41,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:41,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:41,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:41,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:41,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:41,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:41,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:41,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:41,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:41,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:41,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:41,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:41,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:41,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:41,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:42,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:27:43,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:43,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:43,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:43,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:43,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:43,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:43,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:43,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:43,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:43,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:43,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:43,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:43,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:43,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:43,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:43,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:44,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:27:46,583 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:27:47,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:47,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:47,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:47,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:47,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:47,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:47,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:47,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:47,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:47,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:47,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:47,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:47,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:47,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:47,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:47,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:47,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:47,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:47,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:47,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:47,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:47,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:47,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:47,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:47,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:47,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:47,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:47,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:47,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:47,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:47,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:47,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:49,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:27:49,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:49,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:49,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:49,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:49,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:49,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:49,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:49,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:49,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:49,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:49,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:49,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:49,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:49,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:49,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:49,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:51,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:27:51,923 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:27:53,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:27:55,587 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:27:55,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:55,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:55,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:55,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:55,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:55,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:55,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:55,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:55,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:55,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:55,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:55,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:55,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:55,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:55,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:55,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:27:57,588 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:27:59,588 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:28:00,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:00,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:00,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:00,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:00,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:00,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:00,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:00,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:00,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:00,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:00,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:00,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:00,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:00,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:00,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:00,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:00,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:00,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:00,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:00,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:00,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:00,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:00,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:00,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:00,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:00,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:00,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:00,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:00,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:00,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:00,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:00,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:01,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:01,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:01,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:01,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:01,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:01,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:01,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:01,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:01,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:01,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:01,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:01,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:01,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:01,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:01,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:01,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:01,589 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:28:02,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:02,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:02,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:02,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:02,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:02,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:02,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:02,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:02,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:02,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:02,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:02,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:02,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:02,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:02,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:02,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:03,590 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:28:05,591 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:28:06,292 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:28:06,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:06,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:06,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:06,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:06,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:06,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:06,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:06,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:06,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:06,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:06,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:06,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:06,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:06,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:06,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:06,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:06,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:06,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:06,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:06,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:06,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:06,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:06,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:06,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:06,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:06,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:06,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:06,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:06,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:06,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:06,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:06,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:07,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:28:07,147 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:28:07,591 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:28:09,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:09,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:09,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:09,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:09,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:09,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:09,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:09,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:09,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:09,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:09,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:09,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:09,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:09,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:09,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:09,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:09,592 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:28:09,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:09,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:09,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:09,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:09,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:09,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:09,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:09,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:09,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:09,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:09,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:09,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:09,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:09,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:09,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:09,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:11,593 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:28:13,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:13,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:13,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:13,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:13,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:13,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:13,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:13,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:13,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:13,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:13,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:13,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:13,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:13,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:13,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:13,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:13,593 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:28:15,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:15,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:15,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:15,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:15,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:15,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:15,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:15,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:15,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:15,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:15,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:15,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:15,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:15,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:15,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:15,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:15,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:15,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:15,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:15,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:15,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:15,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:15,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:15,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:15,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:15,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:15,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:15,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:15,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:15,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:15,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:15,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:15,594 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:28:16,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:16,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:16,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:16,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:16,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:16,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:16,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:16,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:16,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:16,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:16,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:16,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:16,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:16,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:16,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:16,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:16,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:16,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:16,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:16,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:16,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:16,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:16,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:16,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:16,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:16,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:16,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:16,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:16,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:16,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:16,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:16,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:17,595 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:28:17,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:17,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:17,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:17,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:17,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:17,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:18,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:18,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:18,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:18,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:18,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:18,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:18,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:18,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:18,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:18,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:19,596 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:28:20,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:20,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:20,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:20,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:20,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:20,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:20,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:20,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:20,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:20,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:20,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:20,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:20,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:20,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:20,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:20,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:21,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:21,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:21,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:21,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:21,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:21,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:21,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:21,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:21,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:21,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:21,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:21,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:21,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:21,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:21,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:21,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:21,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:28:22,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:28:22,440 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:28:22,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:22,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:22,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:22,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:22,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:22,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:22,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:22,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:22,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:22,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:22,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:22,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:22,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:22,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:22,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:22,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:23,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:23,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:23,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:23,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:23,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:23,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:23,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:23,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:23,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:23,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:23,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:23,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:23,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:23,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:23,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:23,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:23,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:28:24,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:24,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:24,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:24,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:24,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:24,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:24,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:24,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:24,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:24,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:24,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:24,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:24,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:24,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:24,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:24,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:25,598 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:28:27,599 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:28:29,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:29,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:29,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:29,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:29,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:29,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:29,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:29,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:29,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:29,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:29,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:29,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:29,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:29,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:29,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:29,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:29,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:28:29,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:29,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:29,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:29,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:29,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:29,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:29,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:29,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:29,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:29,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:29,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:29,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:29,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:29,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:29,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:29,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:31,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:28:33,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:33,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:33,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:33,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:33,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:33,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:33,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:33,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:33,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:33,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:33,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:33,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:33,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:33,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:33,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:33,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:33,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:33,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:33,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:33,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:33,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:33,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:33,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:33,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:33,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:33,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:33,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:33,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:33,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:33,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:33,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:33,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:33,601 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:28:34,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:34,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:35,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:35,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:35,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:35,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:35,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:35,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:35,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:35,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:35,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:35,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:35,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:35,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:35,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:35,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:35,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:35,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:35,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:35,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:35,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:35,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:35,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:35,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:35,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:35,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:35,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:35,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:35,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:35,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:35,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:35,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:35,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:35,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:35,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:28:36,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:36,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:36,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:36,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:36,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:36,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:36,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:36,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:36,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:36,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:36,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:36,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:36,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:36,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:36,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:36,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:36,365 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:28:37,603 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:28:37,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:28:37,742 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:28:37,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:37,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:38,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:38,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:38,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:38,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:38,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:38,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:38,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:38,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:39,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:39,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:39,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:39,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:39,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:39,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:39,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:39,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:39,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:39,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:39,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:39,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:39,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:39,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:39,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:39,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:39,603 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:28:40,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:40,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:40,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:40,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:40,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:40,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:40,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:40,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:40,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:40,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:40,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:40,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:40,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:40,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:40,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:40,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:40,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:40,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:40,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:40,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:41,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:41,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:41,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:41,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:41,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:41,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:41,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:41,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:41,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:41,377 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 06:28:41,593 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 06:28:41,661 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:28:41,662 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 06:28:42,661 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 06:28:42,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:28:43,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:28:50,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:50,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:50,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:50,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:50,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:50,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:50,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:50,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:50,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:50,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:50,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:50,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:50,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:50,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:50,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:50,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:52,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:28:52,964 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:28:53,665 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:28:55,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:55,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:55,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:55,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:55,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:55,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:55,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:55,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:55,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:55,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:55,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:55,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:55,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:55,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:55,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:55,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:28:57,667 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:29:01,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:29:03,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:03,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:03,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:03,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:03,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:03,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:03,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:03,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:03,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:03,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:03,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:03,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:03,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:03,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:03,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:03,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:04,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:04,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:04,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:04,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:04,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:04,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:04,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:04,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:04,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:04,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:04,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:04,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:04,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:04,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:04,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:04,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:05,670 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:29:06,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:06,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:06,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:06,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:06,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:06,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:06,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:06,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:06,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:06,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:06,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:06,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:06,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:06,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:06,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:06,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:06,445 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:29:08,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:29:08,188 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:29:09,671 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:29:13,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:29:17,675 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:29:21,676 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:29:22,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:22,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:22,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:22,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:22,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:22,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:22,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:22,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:22,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:22,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:22,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:22,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:22,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:22,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:22,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:22,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:23,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:29:23,424 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:29:23,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:29:23,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:23,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:23,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:23,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:23,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:23,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:23,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:23,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:23,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:23,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:23,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:23,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:23,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:23,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:23,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:23,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:27,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:29:29,680 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:29:33,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:29:35,682 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:29:36,518 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:29:38,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:29:38,646 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:29:39,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:29:40,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:40,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:40,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:40,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:40,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:40,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:40,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:40,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:40,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:40,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:40,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:40,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:40,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:40,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:40,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:40,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:41,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:29:44,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:44,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:44,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:44,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:44,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:44,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:44,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:44,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:44,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:44,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:44,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:44,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:44,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:44,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:44,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:44,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:45,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:29:48,687 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:29:49,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:49,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:49,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:49,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:49,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:49,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:49,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:49,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:49,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:49,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:49,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:49,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:49,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:49,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:49,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:49,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:50,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:29:52,689 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:29:53,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:53,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:53,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:53,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:53,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:53,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:53,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:53,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:53,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:53,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:53,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:53,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:53,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:53,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:53,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:53,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:53,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:29:53,950 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:29:54,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:54,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:54,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:54,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:54,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:54,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:54,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:54,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:54,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:54,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:54,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:54,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:54,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:54,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:54,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:54,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:54,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:54,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:54,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:54,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:54,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:54,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:54,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:54,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:54,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:54,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:54,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:54,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:54,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:54,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:54,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:54,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:29:56,690 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:29:58,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:30:00,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:30:01,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:01,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:01,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:01,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:01,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:01,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:01,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:01,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:01,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:01,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:01,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:01,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:01,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:01,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:01,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:01,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:02,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:02,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:02,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:02,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:02,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:02,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:02,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:02,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:02,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:02,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:02,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:02,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:02,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:02,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:02,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:02,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:02,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:02,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:02,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:02,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:02,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:02,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:02,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:02,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:02,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:02,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:02,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:02,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:02,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:02,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:02,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:02,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:02,692 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:30:03,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:03,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:03,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:03,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:03,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:03,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:03,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:03,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:03,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:03,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:03,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:03,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:03,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:03,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:03,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:03,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:04,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:04,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:04,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:04,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:04,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:04,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:04,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:04,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:04,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:04,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:04,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:04,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:04,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:04,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:04,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:04,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:04,693 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:30:06,584 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:30:06,693 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:30:07,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:07,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:07,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:07,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:07,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:07,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:07,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:07,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:07,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:07,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:07,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:07,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:07,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:07,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:07,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:07,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:07,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:07,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:07,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:07,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:07,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:07,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:07,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:07,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:07,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:07,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:07,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:07,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:07,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:07,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:07,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:07,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:08,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:30:09,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:30:09,241 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:30:10,695 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:30:11,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:11,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:11,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:11,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:11,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:11,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:11,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:11,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:11,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:11,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:11,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:11,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:11,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:11,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:11,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:11,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:12,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:12,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:12,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:12,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:12,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:12,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:12,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:12,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:12,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:12,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:12,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:12,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:12,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:12,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:12,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:12,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:12,696 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:30:14,697 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:30:16,698 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:30:17,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:17,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:17,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:17,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:17,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:17,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:17,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:17,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:17,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:17,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:17,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:17,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:17,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:17,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:17,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:17,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:17,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:17,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:17,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:17,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:17,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:17,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:17,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:17,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:17,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:17,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:17,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:17,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:17,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:17,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:17,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:17,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,699 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:30:18,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:18,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:19,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:19,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:19,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:19,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:19,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:19,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:19,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:19,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:19,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:19,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:19,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:19,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:19,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:19,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:19,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:19,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:20,700 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:30:22,701 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:30:23,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:23,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:23,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:23,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:23,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:23,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:23,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:23,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:23,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:23,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:23,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:23,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:23,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:23,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:23,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:23,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:24,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:30:24,469 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:30:24,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:24,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:24,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:24,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:24,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:24,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:24,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:24,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:24,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:24,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:24,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:24,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:24,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:24,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:24,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:24,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:24,702 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:30:25,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:25,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:25,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:25,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:25,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:25,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:25,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:25,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:25,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:25,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:25,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:25,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:25,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:25,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:25,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:25,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:26,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:26,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:26,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:26,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:26,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:26,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:26,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:26,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:26,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:26,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:26,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:26,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:26,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:26,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:26,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:26,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:26,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:26,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:26,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:26,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:26,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:26,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:26,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:26,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:26,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:26,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:26,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:26,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:26,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:26,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:26,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:26,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:26,703 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:30:28,704 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:30:29,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:29,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:29,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:29,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:29,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:29,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:29,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:29,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:29,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:29,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:29,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:29,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:29,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:29,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:29,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:29,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:30,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:30:31,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:31,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:31,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:31,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:31,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:31,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:31,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:31,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:31,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:31,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:31,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:31,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:31,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:31,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:31,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:31,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:32,706 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:30:34,707 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:30:35,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:35,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:36,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:36,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:36,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:36,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:36,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:36,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:36,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:36,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:36,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:36,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:36,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:36,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:36,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:36,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:36,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:36,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:36,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:36,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:36,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:36,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:36,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:36,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:36,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:36,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:36,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:36,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:36,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:36,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:36,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:36,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:36,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:36,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:36,660 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:30:36,707 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:30:37,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:37,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:37,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:37,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:37,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:37,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:37,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:37,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:37,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:37,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:37,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:37,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:37,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:37,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:37,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:37,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:37,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:37,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:37,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:37,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:37,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:37,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:37,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:37,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:37,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:37,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:37,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:37,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:37,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:37,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:37,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:37,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:38,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:38,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:38,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:38,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:38,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:38,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:38,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:38,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:38,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:38,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:38,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:38,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:38,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:38,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:38,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:38,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:38,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:38,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:38,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:38,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:38,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:38,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:38,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:38,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:38,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:38,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:38,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:38,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:38,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:38,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:38,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:38,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:38,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:30:39,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:39,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:39,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:39,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:39,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:39,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:39,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:39,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:39,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:39,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:39,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:39,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:39,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:39,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:39,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:39,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:39,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:30:39,771 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:30:40,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:40,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:40,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:40,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:40,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:40,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:40,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:40,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:40,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:40,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:40,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:40,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:40,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:40,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:40,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:40,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:40,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:40,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:40,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:40,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:40,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:40,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:40,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:40,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:40,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:40,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:40,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:40,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:40,710 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:30:42,711 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:30:52,715 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:30:55,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:30:55,003 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:30:56,716 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:30:56,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:56,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:56,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:56,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:56,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:56,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:56,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:56,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:56,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:56,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:56,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:56,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:56,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:56,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:56,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:56,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:57,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:57,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:57,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:57,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:57,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:57,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:57,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:57,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:57,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:57,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:57,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:57,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:57,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:57,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:57,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:30:57,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:00,718 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:31:05,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:05,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:05,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:05,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:05,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:05,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:05,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:05,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:05,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:05,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:05,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:05,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:05,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:05,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:05,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:05,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:06,720 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:31:06,736 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:31:08,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:31:09,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:09,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:09,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:09,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:09,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:09,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:09,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:09,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:09,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:09,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:09,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:09,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:09,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:09,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:09,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:09,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:10,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:31:10,273 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:31:12,723 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:31:16,724 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:31:17,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:17,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:17,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:17,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:17,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:17,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:17,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:17,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:17,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:17,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:17,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:17,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:17,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:17,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:17,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:17,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:20,726 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:31:22,727 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:31:25,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:31:25,498 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:31:26,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:26,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:26,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:26,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:26,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:26,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:26,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:26,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:26,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:26,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:26,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:26,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:26,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:26,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:26,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:26,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:26,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:31:28,729 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:31:29,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:29,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:29,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:29,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:29,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:29,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:29,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:29,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:29,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:29,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:29,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:29,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:29,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:29,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:29,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:29,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:32,731 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:31:33,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:33,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:33,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:33,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:33,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:33,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:33,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:33,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:33,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:33,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:33,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:33,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:33,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:33,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:33,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:33,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:34,732 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:31:36,810 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:31:38,733 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:31:40,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:31:40,778 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:31:41,734 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:31:43,735 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:31:44,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:44,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:44,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:44,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:44,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:44,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:44,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:44,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:44,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:44,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:44,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:44,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:44,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:44,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:44,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:44,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:47,736 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:31:49,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:49,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:49,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:49,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:49,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:49,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:49,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:49,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:49,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:49,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:49,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:49,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:49,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:49,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:49,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:49,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:49,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:31:51,738 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:31:53,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:53,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:53,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:53,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:53,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:53,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:53,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:53,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:53,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:53,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:53,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:53,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:53,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:53,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:53,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:53,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:53,739 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:31:53,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:53,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:53,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:53,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:53,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:54,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:54,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:54,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:54,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:54,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:54,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:54,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:54,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:54,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:54,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:54,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:56,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:31:56,075 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:31:56,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:56,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:56,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:56,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:56,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:56,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:56,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:56,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:56,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:56,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:56,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:56,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:56,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:56,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:56,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:56,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:57,741 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:31:59,742 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:31:59,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:59,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:59,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:59,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:59,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:59,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:59,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:59,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:59,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:59,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:59,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:59,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:59,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:59,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:59,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:31:59,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:01,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:32:02,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:02,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:02,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:02,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:02,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:02,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:02,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:02,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:02,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:02,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:02,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:02,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:02,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:02,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:02,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:02,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:03,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:03,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:03,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:03,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:03,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:03,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:03,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:03,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:03,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:03,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:03,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:03,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:03,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:03,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:03,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:03,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:03,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:32:05,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:05,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:05,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:05,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:05,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:05,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:05,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:05,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:05,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:05,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:05,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:05,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:05,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:05,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:05,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:05,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:05,744 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:32:06,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:06,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:06,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:06,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:06,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:06,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:06,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:06,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:06,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:06,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:06,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:06,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:06,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:06,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:06,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:06,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:06,884 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:32:07,745 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:32:08,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:08,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:08,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:08,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:08,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:08,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:08,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:08,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:08,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:08,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:08,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:08,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:08,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:08,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:08,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:08,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:09,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:09,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:09,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:09,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:09,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:09,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:09,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:09,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:09,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:09,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:09,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:09,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:09,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:09,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:09,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:09,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:09,746 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:32:11,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:32:11,309 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:32:11,747 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:32:12,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:12,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:12,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:12,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:12,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:12,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:12,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:12,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:12,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:12,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:12,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:12,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:12,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:12,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:12,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:12,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:12,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:12,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:12,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:12,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:12,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:12,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:12,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:12,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:12,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:12,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:12,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:12,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:12,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:12,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:12,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:12,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:13,748 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:32:15,749 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:32:17,750 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:32:17,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:17,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:17,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:17,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:17,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:17,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:17,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:17,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:17,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:17,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:17,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:17,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:17,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:17,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:17,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:17,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:17,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:17,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:17,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:17,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:17,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:17,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:17,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:17,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:17,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:17,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:17,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:17,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:17,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:17,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:17,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:17,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:19,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:19,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:19,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:19,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:19,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:19,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:19,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:19,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:19,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:19,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:19,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:19,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:19,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:19,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:19,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:19,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:19,751 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:32:20,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:20,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:20,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:20,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:20,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:20,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:20,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:20,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:20,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:20,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:20,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:20,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:20,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:20,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:20,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:20,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:20,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:20,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:20,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:20,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:20,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:20,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:20,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:20,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:20,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:20,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:20,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:20,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:20,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:20,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:20,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:20,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:21,752 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:32:22,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:22,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:22,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:22,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:22,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:22,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:22,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:22,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:22,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:22,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:22,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:22,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:22,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:22,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:22,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:22,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:22,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:22,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:22,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:22,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:22,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:22,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:22,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:22,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:22,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:22,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:22,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:22,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:22,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:22,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:22,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:22,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:23,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:23,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:23,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:23,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:23,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:23,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:23,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:23,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:23,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:23,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:23,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:23,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:23,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:23,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:23,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:23,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:23,753 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:32:24,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:24,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:24,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:24,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:24,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:24,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:24,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:24,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:24,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:24,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:24,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:24,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:24,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:24,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:24,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:24,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:25,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:25,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:25,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:25,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:25,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:25,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:25,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:25,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:25,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:25,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:25,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:25,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:25,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:25,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:25,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:25,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:25,754 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:32:26,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:26,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:26,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:26,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:26,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:26,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:26,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:26,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:26,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:26,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:26,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:26,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:26,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:26,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:26,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:26,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:26,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:32:26,629 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:32:27,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:27,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:27,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:27,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:27,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:27,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:27,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:27,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:27,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:27,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:27,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:27,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:27,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:27,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:27,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:27,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:27,755 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:32:29,756 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:32:31,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:31,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:31,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:31,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:31,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:31,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:31,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:31,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:31,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:31,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:31,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:31,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:31,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:31,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:31,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:31,757 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:32:31,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:32,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:32,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:32,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:32,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:32,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:32,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:32,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:32,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:32,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:32,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:32,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:32,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:32,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:32,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:32,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:32,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:33,758 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:32:34,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:34,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:34,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:34,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:34,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:34,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:34,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:34,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:34,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:34,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:34,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:34,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:34,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:34,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:34,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:34,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:34,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:34,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:34,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:34,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:34,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:34,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:34,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:34,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:34,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:34,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:34,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:34,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:34,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:34,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:34,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:34,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:35,759 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:32:35,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:35,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:35,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:35,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:35,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:35,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:35,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:35,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:35,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:35,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:35,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:35,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:35,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:35,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:35,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:35,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:35,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:35,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:35,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:35,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:35,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:35,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:35,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:35,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:35,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:35,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:35,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:35,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:35,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:35,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:35,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:35,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:36,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:36,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:36,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:36,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:36,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:36,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:36,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:36,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:36,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:36,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:36,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:36,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:36,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:36,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:36,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:36,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:36,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:36,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:36,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:36,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:36,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:36,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:36,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:36,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:36,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:36,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:36,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:36,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:36,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:36,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:36,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:36,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:36,960 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:32:37,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:32:37,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:37,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:38,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:38,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:38,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:38,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:38,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:38,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:38,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:38,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:38,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:38,369 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 06:32:38,571 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 06:32:38,655 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 06:32:38,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 06:32:39,761 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:32:41,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:32:41,855 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:32:42,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:42,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:42,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:42,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:42,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:42,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:42,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:42,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:42,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:42,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:42,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:42,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:42,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:42,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:42,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:42,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:49,765 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:32:53,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:53,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:53,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:53,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:53,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:53,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:53,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:53,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:53,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:53,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:53,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:53,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:53,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:53,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:53,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:53,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:32:55,766 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:32:57,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:32:57,078 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:33:02,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:33:03,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:03,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:03,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:03,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:03,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:03,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:03,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:03,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:03,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:03,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:03,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:03,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:03,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:03,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:03,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:03,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:05,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:05,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:05,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:05,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:05,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:05,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:05,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:05,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:05,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:05,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:05,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:05,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:05,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:05,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:05,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:05,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:06,770 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:33:06,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:06,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:06,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:06,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:06,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:06,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:06,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:06,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:06,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:06,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:06,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:06,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:06,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:06,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:06,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:06,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:07,118 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:33:10,772 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:33:12,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:33:12,501 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:33:14,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:14,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:14,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:14,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:14,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:14,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:14,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:14,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:14,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:14,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:14,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:14,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:14,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:14,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:14,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:14,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:14,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:33:16,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:33:20,776 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:33:24,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:33:24,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:24,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:24,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:24,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:24,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:24,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:24,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:24,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:24,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:24,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:24,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:24,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:24,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:24,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:24,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:24,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:26,779 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:33:27,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:33:27,725 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:33:30,781 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:33:30,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:30,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:30,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:30,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:30,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:30,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:30,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:30,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:30,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:30,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:30,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:30,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:30,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:30,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:30,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:30,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:32,781 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:33:36,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:33:36,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:36,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:36,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:36,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:36,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:36,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:36,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:36,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:36,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:36,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:36,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:36,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:36,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:36,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:36,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:36,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:37,188 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:33:38,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:33:39,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:39,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:39,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:39,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:39,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:39,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:39,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:39,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:39,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:39,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:39,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:39,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:39,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:39,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:39,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:39,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:42,785 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:33:43,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:33:43,101 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:33:44,786 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:33:46,787 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:33:48,788 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:33:50,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:50,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:50,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:50,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:50,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:50,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:50,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:50,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:50,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:50,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:50,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:50,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:50,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:50,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:50,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:50,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:52,790 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:33:54,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:54,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:54,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:54,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:54,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:54,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:54,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:54,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:54,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:54,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:54,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:54,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:54,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:54,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:54,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:54,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:54,791 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:33:54,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:54,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:54,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:54,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:54,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:54,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:54,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:54,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:54,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:54,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:54,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:54,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:54,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:54,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:54,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:54,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:56,792 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:33:56,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:56,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:56,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:56,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:56,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:56,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:56,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:56,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:56,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:56,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:56,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:56,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:56,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:56,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:56,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:56,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:33:58,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:33:58,325 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:33:58,793 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:34:00,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:00,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:00,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:00,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:00,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:00,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:00,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:00,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:00,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:00,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:00,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:00,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:00,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:00,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:00,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:00,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:00,794 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:34:01,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:01,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:01,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:01,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:01,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:01,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:01,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:01,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:01,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:01,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:01,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:01,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:01,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:01,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:01,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:01,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:02,794 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:34:04,795 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:34:05,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:05,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:05,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:05,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:05,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:05,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:05,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:05,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:05,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:05,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:05,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:05,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:05,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:05,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:05,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:05,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:06,796 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:34:07,263 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:34:08,797 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:34:10,798 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:34:11,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:11,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:11,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:11,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:11,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:11,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:11,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:11,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:11,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:11,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:11,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:11,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:11,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:11,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:11,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:11,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:12,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:12,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:12,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:12,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:12,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:12,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:12,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:12,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:12,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:12,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:12,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:12,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:12,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:12,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:12,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:12,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:12,799 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:34:13,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:13,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:13,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:13,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:34:13,548 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:34:13,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:13,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:13,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:13,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:13,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:13,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:13,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:13,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:13,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:13,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:13,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:13,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:13,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:13,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:13,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:13,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:13,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:13,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:13,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:13,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:13,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:13,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:13,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:13,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:13,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:13,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:13,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:13,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:13,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:14,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:14,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:14,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:14,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:14,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:14,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:14,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:14,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:14,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:14,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:14,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:14,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:14,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:14,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:14,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:14,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:14,800 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:34:15,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:15,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:15,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:15,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:15,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:15,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:15,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:15,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:15,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:15,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:15,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:15,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:15,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:15,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:15,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:15,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:16,800 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:34:18,801 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:34:18,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:18,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:18,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:18,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:18,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:18,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:18,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:18,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:18,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:18,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:18,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:18,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:18,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:18,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:18,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:18,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:20,802 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:34:21,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:21,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:21,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:21,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:21,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:21,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:21,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:21,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:21,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:21,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:21,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:21,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:21,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:21,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:21,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:21,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:22,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:22,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:22,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:22,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:22,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:22,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:22,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:22,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:22,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:22,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:22,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:22,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:22,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:22,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:22,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:22,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:22,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:34:23,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:23,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:23,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:23,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:23,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:23,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:23,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:23,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:23,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:23,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:23,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:23,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:23,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:23,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:23,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:23,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:23,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:23,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:23,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:23,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:23,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:23,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:23,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:23,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:23,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:23,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:23,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:23,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:23,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:23,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:23,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:23,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:24,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:34:25,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:25,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:25,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:25,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:25,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:25,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:25,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:25,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:25,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:25,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:25,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:25,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:25,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:25,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:25,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:25,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:26,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:26,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:26,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:26,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:26,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:26,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:26,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:26,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:26,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:26,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:26,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:26,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:26,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:26,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:26,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:26,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:26,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:26,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:26,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:26,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:26,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:26,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:26,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:26,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:26,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:26,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:26,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:26,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:26,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:26,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:26,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:26,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:26,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:34:28,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:28,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:28,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:28,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:28,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:28,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:28,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:28,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:28,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:28,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:28,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:28,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:28,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:28,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:28,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:28,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:28,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:34:28,775 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:34:28,804 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:34:29,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:29,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:29,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:29,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:29,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:29,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:29,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:29,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:29,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:29,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:29,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:29,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:29,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:29,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:29,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:29,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:30,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:30,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:30,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:30,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:30,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:30,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:30,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:30,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:30,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:30,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:30,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:30,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:30,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:30,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:30,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:30,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:30,805 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:34:31,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:31,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:31,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:31,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:31,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:31,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:31,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:31,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:31,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:31,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:31,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:31,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:31,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:31,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:31,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:31,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:32,805 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:34:34,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:34,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:34,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:34,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:34,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:34,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:34,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:34,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:34,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:34,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:34,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:34,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:34,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:34,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:34,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:34,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:34,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:34,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:34,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:34,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:34,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:34,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:34,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:34,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:34,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:34,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:34,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:34,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:34,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:34,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:34,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:34,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:34,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:34:36,807 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:34:37,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:37,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:37,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:37,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:37,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:37,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:37,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:37,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:37,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:37,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:37,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:37,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:37,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:37,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:37,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:37,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:37,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:37,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:37,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:37,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:37,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:37,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:37,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:37,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:37,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:37,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:37,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:37,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:37,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:37,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:37,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:37,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:37,331 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:34:38,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:38,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:38,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:38,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:38,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:38,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:38,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:38,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:38,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:38,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:38,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:38,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:38,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:38,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:38,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:38,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:38,808 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:34:38,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:38,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:38,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:38,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:38,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:38,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:38,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:38,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:38,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:38,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:38,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:38,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:38,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:38,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:38,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:38,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:39,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:39,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:39,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:39,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:39,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:39,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:39,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:39,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:39,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:39,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:39,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:39,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:39,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:39,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:39,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:39,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:39,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:39,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:39,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:39,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:40,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:40,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:40,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:40,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:40,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:40,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:40,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:40,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:41,809 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:34:44,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:34:44,006 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:34:44,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:44,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:44,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:44,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:45,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:45,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:45,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:45,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:45,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:45,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:45,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:45,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:45,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:45,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:45,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:45,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:45,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:45,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:45,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:45,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:45,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:45,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:45,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:45,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:45,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:45,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:45,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:45,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:45,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:45,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:45,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:45,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:51,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:51,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:51,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:51,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:51,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:51,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:51,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:51,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:51,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:51,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:51,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:51,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:51,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:51,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:51,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:51,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:51,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:51,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:51,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:51,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:51,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:51,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:51,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:51,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:51,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:51,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:51,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:51,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:51,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:51,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:51,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:51,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:51,813 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:34:52,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:52,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:52,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:52,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:52,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:52,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:52,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:52,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:52,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:52,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:52,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:52,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:52,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:52,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:52,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:52,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:34:57,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:34:59,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:34:59,350 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:35:01,817 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:35:03,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:03,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:03,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:03,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:03,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:03,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:03,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:03,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:03,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:03,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:03,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:03,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:03,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:03,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:03,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:03,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:03,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:03,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:03,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:03,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:03,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:03,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:03,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:03,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:03,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:03,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:03,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:03,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:03,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:03,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:03,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:03,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:05,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:35:07,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:07,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:07,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:07,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:07,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:07,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:07,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:07,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:07,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:07,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:07,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:07,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:07,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:07,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:07,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:07,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:07,399 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:35:09,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:35:13,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:13,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:13,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:13,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:13,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:13,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:13,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:13,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:13,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:13,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:13,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:13,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:13,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:13,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:13,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:13,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:13,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:13,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:13,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:13,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:13,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:13,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:13,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:13,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:13,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:13,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:13,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:13,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:13,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:13,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:13,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:13,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:13,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:35:14,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:35:14,575 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:35:16,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:16,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:16,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:16,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:16,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:16,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:16,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:16,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:16,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:16,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:16,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:16,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:16,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:16,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:16,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:16,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:17,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:35:18,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:18,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:18,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:18,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:18,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:18,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:18,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:18,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:18,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:18,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:18,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:18,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:18,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:18,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:18,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:18,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:19,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:35:23,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:35:27,826 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:35:29,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:35:29,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:35:29,927 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:35:30,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:30,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:30,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:30,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:30,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:30,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:30,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:30,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:30,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:30,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:30,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:30,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:30,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:30,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:30,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:30,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:32,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:32,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:32,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:32,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:32,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:32,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:32,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:32,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:32,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:32,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:32,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:32,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:32,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:32,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:32,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:32,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:33,829 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:35:35,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:35:37,471 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:35:39,831 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:35:41,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:35:42,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:42,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:42,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:42,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:42,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:42,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:42,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:42,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:42,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:42,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:42,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:42,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:42,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:42,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:42,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:42,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:43,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:43,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:43,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:43,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:43,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:43,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:43,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:43,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:43,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:43,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:43,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:43,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:43,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:43,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:43,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:43,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:43,833 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:35:45,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:35:45,186 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:35:47,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:35:49,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:35:51,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:35:53,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:35:56,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:56,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:56,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:56,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:56,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:56,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:56,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:56,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:56,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:56,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:56,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:56,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:56,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:56,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:56,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:56,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:57,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:35:59,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:59,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:59,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:59,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:59,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:59,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:59,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:59,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:59,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:59,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:59,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:59,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:59,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:59,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:59,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:59,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:35:59,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:36:00,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:00,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:00,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:00,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:00,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:00,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:00,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:00,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:00,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:00,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:00,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:00,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:00,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:00,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:00,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:00,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:00,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:36:00,575 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:36:00,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:00,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:00,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:00,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:00,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:00,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:00,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:00,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:00,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:00,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:00,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:00,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:00,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:00,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:00,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:00,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:01,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:36:03,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:03,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:03,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:03,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:03,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:03,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:03,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:03,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:03,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:03,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:03,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:03,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:03,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:03,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:03,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:03,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:03,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:36:04,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:04,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:04,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:04,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:04,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:04,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:04,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:04,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:04,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:04,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:04,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:04,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:04,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:04,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:04,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:04,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:05,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:36:07,543 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:36:07,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:36:09,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:36:11,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:36:12,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:12,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:12,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:12,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:12,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:12,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:12,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:12,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:12,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:12,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:12,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:12,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:12,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:12,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:12,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:12,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:13,846 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:36:15,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:36:15,800 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:36:15,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:36:15,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:15,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:17,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:36:18,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:18,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:18,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:18,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:18,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:18,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:18,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:18,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:18,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:18,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:18,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:18,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:18,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:18,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:18,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:18,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:19,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:19,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:19,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:19,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:19,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:19,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:19,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:19,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:19,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:19,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:19,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:19,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:19,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:19,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:19,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:19,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:19,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:19,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:19,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:19,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:19,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:19,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:19,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:19,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:19,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:19,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:19,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:19,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:19,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:19,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:19,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:19,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:19,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:36:21,849 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:36:23,850 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:36:24,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:24,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:24,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:24,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:24,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:24,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:24,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:24,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:24,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:24,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:24,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:24,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:24,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:24,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:24,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:24,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:24,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:24,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:24,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:24,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:24,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:25,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:36:26,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:26,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:26,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:26,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:26,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:26,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:26,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:26,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:26,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:26,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:26,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:26,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:26,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:26,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:26,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:26,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:27,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:36:28,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:28,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:28,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:28,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:28,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:28,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:28,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:28,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:28,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:28,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:28,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:28,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:28,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:28,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:28,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:28,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:29,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:36:31,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:36:31,078 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:36:31,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:36:31,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:31,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:32,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:32,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:32,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:32,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:32,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:32,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:32,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:32,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:32,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:32,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:32,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:32,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:32,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:32,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:32,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:32,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:33,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:33,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:33,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:33,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:33,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:33,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:33,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:33,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:33,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:33,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:33,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:33,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:33,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:33,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:33,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:33,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:33,854 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:36:35,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:35,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:35,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:35,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:35,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:35,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:35,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:35,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:35,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:35,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:35,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:35,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:35,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:35,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:35,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:35,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:35,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:35,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:35,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:35,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:35,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:35,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:35,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:35,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:35,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:35,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:35,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:35,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:35,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:35,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:35,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:35,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:35,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:36:36,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:36,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:36,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:36,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:36,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:36,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:36,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:36,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:36,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:36,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:36,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:36,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:36,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:36,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:36,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:36,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:37,619 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:36:37,856 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:36:39,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:39,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:39,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:39,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:39,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:39,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:39,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:39,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:39,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:39,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:39,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:39,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:39,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:39,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:39,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:39,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:39,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:39,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:39,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:39,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:39,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:39,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:39,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:39,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:39,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:39,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:39,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:39,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:39,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:39,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:39,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:39,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:39,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:36:40,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:40,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:40,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:40,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:40,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:40,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:40,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:40,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:40,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:40,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:40,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:40,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:40,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:40,793 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 06:36:41,012 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:36:41,023 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 06:36:41,096 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 06:36:42,007 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 06:36:42,007 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:36:46,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:36:46,312 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:36:47,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:47,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:47,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:47,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:47,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:47,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:47,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:47,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:47,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:47,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:47,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:47,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:47,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:47,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:47,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:47,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:52,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:36:54,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:54,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:54,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:54,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:54,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:54,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:54,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:54,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:54,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:54,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:54,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:54,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:54,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:54,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:54,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:54,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:54,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:54,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:54,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:54,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:54,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:54,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:54,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:54,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:54,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:54,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:54,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:54,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:54,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:54,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:54,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:54,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:58,012 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:36:59,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:36:59,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:01,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:37:01,539 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:37:01,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:01,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:01,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:01,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:01,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:01,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:01,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:01,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:01,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:01,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:01,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:01,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:01,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:01,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:01,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:01,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:02,014 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:37:03,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:03,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:03,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:03,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:03,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:03,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:03,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:03,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:03,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:03,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:03,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:03,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:03,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:03,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:03,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:03,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:06,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:37:07,764 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:37:10,017 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:37:11,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:11,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:11,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:11,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:11,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:11,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:11,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:11,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:11,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:11,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:11,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:11,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:11,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:11,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:11,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:11,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:12,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:37:12,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:12,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:12,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:12,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:12,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:12,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:12,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:12,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:12,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:12,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:12,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:12,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:12,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:12,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:12,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:12,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:16,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:16,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:16,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:16,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:16,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:16,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:16,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:16,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:16,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:16,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:16,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:16,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:16,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:16,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:16,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:16,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:16,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:37:16,847 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:37:17,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:37:19,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:19,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:19,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:19,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:19,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:19,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:19,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:19,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:19,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:19,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:19,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:19,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:19,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:19,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:19,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:19,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:19,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:19,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:19,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:19,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:19,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:20,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:20,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:20,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:20,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:20,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:20,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:20,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:20,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:20,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:20,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:20,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:21,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:37:23,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:37:24,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:24,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:24,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:24,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:24,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:24,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:24,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:24,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:24,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:24,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:24,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:24,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:24,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:24,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:24,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:24,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:24,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:24,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:24,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:24,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:24,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:24,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:24,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:24,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:24,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:24,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:24,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:24,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:24,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:24,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:24,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:24,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:27,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:37:29,025 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:37:32,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:37:32,272 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:37:33,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:37:35,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:37:37,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:37,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:37,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:37:37,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:37,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:37,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:37,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:37,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:37,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:37,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:37,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:37,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:37,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:37,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:37,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:37,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:37,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:37,837 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:37:38,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:38,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:38,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:38,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:38,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:38,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:38,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:38,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:38,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:38,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:38,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:38,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:38,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:38,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:38,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:38,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:41,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:37:43,031 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:37:44,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:44,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:44,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:44,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:44,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:44,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:44,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:44,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:44,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:44,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:44,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:44,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:44,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:44,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:44,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:44,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:45,032 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:37:45,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:45,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:45,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:45,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:45,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:45,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:45,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:45,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:45,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:45,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:45,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:45,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:45,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:45,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:45,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:45,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:47,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:37:47,607 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:37:49,034 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:37:51,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:37:53,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:37:55,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:37:57,038 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:37:57,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:57,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:57,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:57,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:57,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:57,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:57,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:57,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:57,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:57,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:57,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:57,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:57,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:57,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:57,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:57,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:37:59,039 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:38:01,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:38:01,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:01,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:01,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:01,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:01,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:01,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:01,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:01,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:01,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:01,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:01,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:01,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:01,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:01,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:01,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:01,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:01,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:01,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:01,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:01,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:01,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:01,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:01,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:01,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:01,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:01,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:01,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:01,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:01,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:01,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:01,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:01,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:02,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:38:02,849 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:38:03,041 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:38:03,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:03,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:03,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:03,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:03,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:03,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:03,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:03,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:03,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:03,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:03,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:03,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:03,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:03,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:03,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:03,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:05,042 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:38:06,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:06,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:06,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:06,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:06,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:06,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:06,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:06,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:06,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:06,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:06,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:06,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:06,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:06,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:06,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:06,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:07,042 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:38:07,913 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:38:09,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:38:10,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:10,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:10,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:10,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:10,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:10,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:10,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:10,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:10,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:10,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:10,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:10,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:10,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:10,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:10,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:10,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:11,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:38:13,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:38:13,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:13,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:13,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:13,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:13,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:13,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:13,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:13,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:13,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:13,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:13,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:13,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:13,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:13,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:13,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:13,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:14,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:14,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:14,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:14,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:14,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:14,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:14,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:14,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:14,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:14,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:14,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:14,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:14,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:14,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:14,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:14,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:15,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:38:15,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:15,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:15,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:15,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:15,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:15,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:15,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:15,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:15,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:15,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:15,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:15,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:15,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:15,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:15,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:15,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:15,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:15,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:15,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:15,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:15,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:15,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:15,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:15,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:15,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:15,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:15,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:15,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:15,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:15,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:15,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:15,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:17,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:17,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:17,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:17,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:17,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:17,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:17,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:17,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:17,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:17,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:17,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:17,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:17,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:17,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:17,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:17,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:17,047 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:38:17,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:17,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:17,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:17,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:17,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:17,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:17,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:17,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:17,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:17,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:17,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:17,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:17,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:17,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:17,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:17,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:18,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:38:18,144 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:38:18,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:18,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:18,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:18,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:18,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:18,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:18,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:18,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:18,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:18,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:18,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:18,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:18,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:18,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:18,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:18,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:19,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:38:21,049 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:38:23,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:38:23,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:23,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:23,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:23,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:23,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:23,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:23,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:23,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:23,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:23,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:23,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:23,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:23,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:23,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:23,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:23,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:24,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:24,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:24,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:24,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:24,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:24,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:24,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:24,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:24,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:24,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:24,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:24,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:24,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:24,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:24,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:24,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:25,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:38:26,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:26,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:27,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:38:27,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:27,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:27,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:27,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:27,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:27,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:27,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:27,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:27,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:27,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:27,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:27,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:27,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:27,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:27,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:27,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:29,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:38:29,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:29,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:29,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:29,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:29,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:29,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:29,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:29,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:29,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:29,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:29,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:29,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:29,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:29,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:29,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:29,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:30,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:30,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:30,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:30,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:30,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:30,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:30,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:30,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:30,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:30,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:30,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:30,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:30,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:30,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:30,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:30,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:30,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:30,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:30,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:30,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:30,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:30,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:30,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:30,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:30,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:30,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:30,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:30,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:30,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:30,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:30,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:30,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:31,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:38:31,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:31,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:31,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:31,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:31,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:31,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:31,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:31,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:31,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:31,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:31,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:31,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:31,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:31,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:31,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:31,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:33,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:38:33,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:33,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:33,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:33,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:33,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:33,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:33,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:33,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:33,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:33,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:33,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:33,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:33,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:33,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:33,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:33,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:33,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:38:33,484 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:38:33,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:33,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:33,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:33,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:33,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:33,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:33,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:33,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:33,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:33,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:33,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:33,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:33,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:33,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:33,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:33,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:34,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:34,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:34,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:34,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:34,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:34,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:34,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:34,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:34,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:34,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:34,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:34,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:34,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:34,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:34,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:34,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:35,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:38:35,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:35,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:35,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:35,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:35,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:35,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:35,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:35,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:35,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:35,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:35,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:35,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:35,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:35,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:35,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:35,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:36,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:36,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:36,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:36,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:36,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:36,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:36,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:36,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:36,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:36,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:36,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:36,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:37,056 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:38:37,987 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:38:39,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:38:41,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:41,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:41,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:41,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:41,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:41,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:41,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:41,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:42,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:42,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:42,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:42,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:42,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:42,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:42,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:42,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:47,060 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:38:47,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:47,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:47,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:47,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:47,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:47,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:47,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:47,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:47,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:47,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:47,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:47,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:47,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:47,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:47,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:47,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:48,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:38:48,745 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:38:51,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:38:54,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:54,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:54,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:54,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:54,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:54,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:54,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:54,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:54,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:54,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:54,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:54,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:54,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:54,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:54,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:54,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:55,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:55,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:55,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:55,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:55,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:55,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:55,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:55,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:55,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:55,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:55,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:55,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:55,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:55,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:55,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:55,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:38:57,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:38:59,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:39:01,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:01,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:03,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:03,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:03,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:03,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:03,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:03,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:03,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:03,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:03,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:03,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:03,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:03,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:03,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:03,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:03,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:03,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:03,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:39:03,970 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:39:04,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:39:08,064 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:39:08,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:39:08,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:08,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:08,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:08,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:08,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:08,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:08,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:08,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:08,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:08,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:08,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:08,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:08,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:08,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:08,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:08,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:10,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:10,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:10,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:10,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:10,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:10,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:10,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:10,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:10,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:10,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:10,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:10,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:10,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:10,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:10,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:10,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:12,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:39:14,071 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:39:15,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:15,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:15,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:15,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:15,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:15,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:15,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:15,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:15,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:15,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:15,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:15,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:15,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:15,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:15,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:15,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:18,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:39:19,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:39:19,514 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:39:20,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:20,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:20,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:20,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:20,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:20,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:20,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:20,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:20,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:20,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:20,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:20,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:20,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:20,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:20,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:20,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:21,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:21,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:21,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:21,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:21,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:21,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:21,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:21,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:21,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:21,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:21,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:21,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:21,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:21,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:21,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:21,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:21,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:21,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:21,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:21,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:21,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:21,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:21,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:21,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:21,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:21,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:21,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:21,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:21,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:21,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:21,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:21,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:22,074 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:39:23,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:23,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:23,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:23,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:23,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:23,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:23,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:23,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:23,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:23,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:23,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:23,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:23,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:23,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:23,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:23,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:24,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:39:26,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:26,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:26,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:26,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:26,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:26,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:26,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:26,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:26,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:26,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:26,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:26,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:26,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:26,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:26,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:26,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:28,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:39:30,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:39:32,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:39:34,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:34,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:34,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:34,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:34,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:34,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:34,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:34,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:34,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:34,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:34,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:34,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:34,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:34,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:34,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:34,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:34,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:39:34,836 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:39:36,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:39:38,081 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:39:38,141 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:39:39,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:39,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:39,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:39,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:39,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:39,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:39,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:39,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:39,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:39,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:39,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:39,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:39,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:39,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:39,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:39,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:40,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:39:42,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:39:42,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:42,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:42,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:42,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:42,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:42,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:42,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:42,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:42,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:42,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:42,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:42,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:42,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:42,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:42,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:42,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:45,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:45,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:45,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:45,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:45,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:45,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:45,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:45,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:45,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:45,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:45,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:45,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:45,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:45,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:45,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:45,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:46,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:39:48,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:39:50,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:39:50,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:39:50,096 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:39:52,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:39:54,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:39:56,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:39:58,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:39:58,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:58,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:58,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:58,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:58,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:58,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:58,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:58,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:58,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:58,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:58,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:58,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:58,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:58,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:58,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:58,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:58,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:58,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:58,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:58,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:58,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:58,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:58,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:58,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:59,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:59,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:59,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:59,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:59,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:59,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:59,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:39:59,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:00,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:40:02,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:40:03,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:03,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:03,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:03,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:03,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:03,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:03,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:03,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:03,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:03,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:03,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:03,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:03,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:03,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:03,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:03,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:03,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:03,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:03,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:03,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:03,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:03,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:03,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:03,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:03,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:03,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:03,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:03,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:03,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:03,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:03,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:03,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:04,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:40:04,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:04,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:04,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:04,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:04,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:04,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:04,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:04,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:04,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:04,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:04,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:04,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:04,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:04,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:04,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:04,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:05,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:40:05,381 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:40:06,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:40:08,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:40:08,230 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:40:10,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:40:10,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:10,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:10,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:10,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:10,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:10,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:10,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:10,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:10,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:10,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:10,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:10,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:10,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:10,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:10,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:10,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:10,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:10,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:10,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:10,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:10,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:10,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:10,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:10,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:10,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:10,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:10,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:10,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:10,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:10,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:10,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:10,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:12,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:40:13,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:13,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:13,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:13,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:13,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:13,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:13,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:13,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:13,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:13,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:13,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:13,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:13,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:13,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:13,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:13,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:14,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:40:14,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:14,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:14,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:14,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:14,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:14,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:14,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:14,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:14,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:14,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:14,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:14,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:14,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:14,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:14,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:14,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:16,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:40:16,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:16,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:16,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:16,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:16,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:16,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:16,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:16,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:16,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:16,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:16,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:16,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:16,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:16,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:16,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:16,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:17,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:17,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:17,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:17,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:17,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:17,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:17,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:17,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:17,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:17,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:17,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:17,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:17,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:17,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:17,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:17,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:18,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:40:18,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:18,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:18,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:18,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:18,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:18,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:18,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:18,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:18,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:18,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:18,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:18,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:18,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:18,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:18,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:18,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:20,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:40:20,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:20,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:20,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:20,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:20,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:20,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:20,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:20,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:20,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:20,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:20,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:20,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:20,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:20,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:20,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:20,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:20,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:40:20,611 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:40:22,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:40:22,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:22,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:22,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:22,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:22,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:22,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:22,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:22,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:22,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:22,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:22,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:22,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:22,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:22,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:22,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:22,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:40:24,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:24,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:26,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:26,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:26,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:26,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:26,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:26,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:26,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:26,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:26,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:26,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:26,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:26,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:26,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:26,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:26,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:26,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:26,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:40:26,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:26,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:26,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:26,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:26,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:26,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:26,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:26,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:26,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:26,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:26,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:26,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:26,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:26,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:26,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:26,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:28,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:40:29,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:29,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:30,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:40:30,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:30,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:30,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:30,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:30,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:30,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:30,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:30,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:30,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:30,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:30,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:30,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:30,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:30,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:30,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:30,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:31,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:31,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:31,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:31,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:31,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:31,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:31,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:31,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:31,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:31,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:31,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:31,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:31,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:31,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:31,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:31,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:31,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:31,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:31,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:31,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:31,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:31,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:31,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:31,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:31,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:31,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:31,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:31,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:31,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:31,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:31,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:31,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:32,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:32,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:32,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:32,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:32,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:32,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:32,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:32,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:32,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:32,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:32,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:32,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:32,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:32,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:32,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:32,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:32,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:40:32,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:32,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:32,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:32,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:32,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:32,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:32,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:32,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:32,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:32,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:32,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:32,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:32,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:32,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:32,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:32,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:33,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:33,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:33,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:33,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:33,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:33,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:33,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:33,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:33,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:33,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:33,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:33,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:33,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 06:40:33,549 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 06:40:33,745 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 06:40:33,816 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 06:40:34,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 06:40:34,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:40:35,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:40:35,934 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:40:36,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:40:38,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:40:38,329 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:40:40,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:40:42,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:40:45,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:40:47,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:40:49,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:40:51,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:40:51,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:40:51,504 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:40:53,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:40:55,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:40:57,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:40:59,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:41:01,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:41:03,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:41:05,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:41:06,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:41:06,732 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:41:07,121 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:41:08,404 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:41:09,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:41:11,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:41:13,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:41:15,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:41:17,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:41:19,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:41:21,128 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:41:22,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:41:22,125 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:41:23,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:41:25,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:41:27,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:41:29,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:41:31,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:41:33,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:41:35,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:41:37,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:41:37,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:41:37,450 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:41:38,480 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:41:39,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:41:41,140 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:41:43,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:41:45,142 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:41:47,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:41:49,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:41:51,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:41:52,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:41:52,672 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:41:53,146 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:41:55,146 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:41:57,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:41:59,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:42:01,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:42:03,150 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:42:05,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:42:07,152 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:42:08,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:42:08,068 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:42:08,558 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:42:09,153 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:42:12,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:42:14,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:42:16,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:42:18,157 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:42:20,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:42:22,159 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:42:23,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:42:23,290 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:42:24,160 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:42:26,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:42:28,162 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:42:30,163 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:42:32,164 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:42:34,165 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:42:36,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:42:38,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:42:38,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:42:38,514 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:42:38,740 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:42:40,168 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:42:42,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:42:44,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:42:46,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:42:48,172 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:42:50,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:42:52,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:42:53,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:42:53,904 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:42:54,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:42:56,175 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:42:58,176 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:43:00,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:43:02,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:43:04,179 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:43:06,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:43:08,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:43:08,705 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:43:09,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:43:09,243 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:43:10,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:43:12,182 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:43:14,182 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:43:16,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:43:18,184 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:43:20,185 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:43:22,186 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:43:24,186 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:43:24,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:43:24,610 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:43:26,187 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:43:28,188 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:43:30,189 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:43:32,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:43:34,191 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:43:36,192 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:43:38,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:43:38,771 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:43:39,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:43:39,948 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:43:40,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:43:42,194 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:43:44,195 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:43:46,196 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:43:48,197 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:43:50,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:43:52,199 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:43:54,200 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:43:55,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:43:55,210 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:43:56,200 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:43:58,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:44:00,202 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:44:02,203 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:44:04,204 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:44:07,205 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:44:08,848 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:44:09,206 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:44:10,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:44:10,444 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:44:11,207 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:44:13,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:44:15,209 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:44:17,210 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:44:19,211 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:44:21,212 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:44:23,212 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:44:25,213 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:44:25,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:44:25,672 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:44:27,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:44:29,215 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:44:31,216 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:44:33,217 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:44:35,218 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:44:37,219 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:44:38,923 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:44:39,220 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:44:41,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:44:41,059 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:44:41,221 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:44:43,222 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:44:45,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:44:47,224 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:44:49,225 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:44:51,225 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:44:53,226 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:44:55,227 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:44:56,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:44:56,284 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:44:57,228 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:44:59,229 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:45:01,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:45:03,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:45:05,231 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:45:07,232 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:45:08,996 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:45:09,233 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:45:11,234 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:45:11,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:45:11,628 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:45:13,235 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:45:15,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:45:17,237 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:45:19,238 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:45:21,239 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:45:23,240 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:45:25,241 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:45:26,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:45:26,943 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:45:27,241 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:45:29,242 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:45:31,243 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:45:33,244 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:45:35,245 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:45:37,246 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:45:39,072 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:45:40,248 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:45:42,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:45:42,167 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:45:42,248 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:45:44,249 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:45:46,250 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:45:48,251 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:45:50,252 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:45:52,253 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:45:54,254 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:45:56,255 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:45:57,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:45:57,433 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:45:58,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:46:00,257 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:46:02,258 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:46:04,259 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:46:06,260 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:46:08,261 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:46:09,147 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:46:10,262 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:46:12,263 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:46:12,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:46:12,826 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:46:14,264 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:46:16,265 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:46:18,266 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:46:20,266 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:46:22,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:46:24,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:46:26,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:46:28,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:46:28,219 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:46:28,270 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:46:30,271 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:46:32,272 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:46:34,273 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:46:36,274 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:46:38,275 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:46:39,220 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:46:40,276 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:46:42,277 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:46:43,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:46:43,449 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:46:44,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:46:46,279 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:46:48,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:46:50,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:46:52,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:46:54,283 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:46:56,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:46:58,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:46:58,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:46:58,754 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:47:00,285 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:47:02,286 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:47:04,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:47:06,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:47:08,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:47:09,296 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:47:10,290 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:47:12,293 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:47:14,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:47:14,152 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:47:15,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:47:17,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:47:19,296 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:47:21,297 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:47:23,298 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:47:25,298 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:47:27,299 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:47:29,300 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:47:29,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:47:29,530 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:47:31,301 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:47:33,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:47:35,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:47:37,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:47:39,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:47:39,368 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:47:41,306 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:47:43,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:47:44,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:47:44,759 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:47:45,308 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:47:47,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:47:49,310 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:47:51,311 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:47:53,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:47:55,313 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:47:57,314 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:47:59,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:47:59,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:47:59,985 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:48:01,316 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:48:03,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:48:05,318 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:48:07,319 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:48:09,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:48:09,444 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:48:11,321 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:48:13,322 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:48:15,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:48:15,210 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:48:15,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:48:17,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:48:19,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:48:21,326 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:48:23,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:48:25,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:48:27,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:48:29,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:48:30,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:48:30,436 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:48:31,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:48:33,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:48:35,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:48:37,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:48:39,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:48:39,518 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:48:41,335 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:48:43,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:48:45,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:48:45,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:48:45,732 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:48:47,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:48:49,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:48:51,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:48:53,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:48:55,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:48:57,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:48:59,342 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:49:00,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:49:00,990 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:49:01,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:49:03,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:49:05,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:49:07,346 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:49:09,346 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:49:09,579 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:49:11,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:49:13,348 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:49:15,348 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:49:16,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:49:16,210 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:49:17,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:49:19,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:49:21,350 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:49:23,350 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:49:25,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:49:27,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:49:29,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:49:31,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:49:31,522 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:49:32,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:49:34,354 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:49:36,354 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:49:38,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:49:39,653 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:49:40,356 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:49:42,356 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:49:44,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:49:46,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:49:46,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:49:46,784 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:49:48,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:49:50,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:49:52,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:49:54,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:49:56,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:49:58,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:50:00,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:50:02,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:50:02,006 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:50:02,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:50:04,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:50:06,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:50:08,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:50:09,729 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:50:10,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:50:12,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:50:14,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:50:16,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:50:17,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:50:17,290 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:50:18,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:50:20,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:50:22,371 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:50:24,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:50:26,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:50:28,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:50:30,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:50:32,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:50:32,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:50:32,566 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:50:34,376 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:50:36,377 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:50:38,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:50:39,802 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:50:40,379 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:50:42,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:50:44,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:50:46,381 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:50:47,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:50:47,819 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:50:48,382 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:50:50,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:50:52,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:50:55,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:50:57,386 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:50:59,387 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:51:01,388 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:51:03,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:51:03,077 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:51:03,389 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:51:05,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:51:07,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:51:09,391 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:51:09,878 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:51:11,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:51:13,393 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:51:15,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:51:17,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:51:18,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:51:18,396 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:51:19,395 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:51:21,396 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:51:23,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:51:25,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:51:27,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:51:29,399 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:51:31,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:51:33,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:51:33,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:51:33,708 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:51:35,402 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:51:37,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:51:39,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:51:39,955 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:51:41,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:51:43,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:51:45,406 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:51:47,407 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:51:49,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:51:49,084 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:51:49,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:51:51,409 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:51:53,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:51:55,411 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:51:57,412 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:51:59,413 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:52:01,414 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:52:03,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:52:04,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:52:04,422 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:52:05,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:52:07,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:52:09,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:52:10,033 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:52:11,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:52:13,419 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:52:15,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:52:17,421 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:52:19,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:52:19,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:52:19,696 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:52:21,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:52:23,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:52:25,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:52:28,425 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:52:30,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:52:32,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:52:34,427 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:52:34,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:52:34,919 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:52:36,428 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:52:38,429 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:52:40,108 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:52:40,430 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:52:42,431 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:52:44,432 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:52:46,432 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:52:48,433 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:52:50,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:52:50,146 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:52:50,434 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:52:52,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:52:54,436 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:52:56,436 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:52:58,437 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:53:00,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:53:02,439 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:53:04,440 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:53:05,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:53:05,367 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:53:06,440 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:53:08,441 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:53:10,182 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:53:10,442 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:53:12,443 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:53:14,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:53:16,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:53:18,445 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:53:20,446 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:53:20,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:53:20,591 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:53:22,447 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:53:24,447 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:53:26,448 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:53:28,449 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:53:30,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:53:32,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:53:34,451 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:53:35,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:53:35,954 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:53:36,451 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:53:38,452 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:53:40,257 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:53:41,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:53:43,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:53:45,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:53:47,455 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:53:49,456 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:53:51,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:53:51,179 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:53:51,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:53:53,458 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:53:55,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:53:57,460 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:53:59,460 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:54:01,461 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:54:03,462 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:54:05,462 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:54:06,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:54:06,549 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:54:07,463 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:54:09,464 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:54:10,332 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:54:11,468 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:54:13,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:54:15,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:54:17,470 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:54:19,471 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:54:21,472 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:54:22,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:54:22,141 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:54:23,472 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:54:25,473 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:54:27,474 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:54:29,475 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:54:31,476 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:54:33,477 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:54:35,478 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:54:37,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:54:37,365 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:54:37,478 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:54:39,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:54:40,404 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:54:41,480 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:54:43,481 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:54:45,482 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:54:47,483 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:54:49,483 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:54:51,484 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:54:52,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:54:52,592 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:54:53,485 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:54:55,486 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:54:57,487 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:54:59,488 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:55:01,489 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:55:03,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:55:05,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:55:07,491 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:55:07,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:55:07,963 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:55:10,480 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:55:10,493 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:55:12,494 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:55:14,494 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:55:16,495 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:55:18,496 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:55:20,497 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:55:22,497 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:55:23,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:55:23,186 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:55:24,498 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:55:26,499 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:55:28,500 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:55:30,500 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:55:32,501 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:55:34,502 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:55:36,502 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:55:38,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:55:38,465 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:55:38,503 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:55:40,504 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:55:40,555 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:55:42,504 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:55:44,505 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:55:46,506 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:55:48,507 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:55:50,508 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:55:52,508 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:55:53,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:55:53,712 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:55:54,509 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:55:56,510 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:55:58,511 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:56:00,512 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:56:02,513 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:56:05,514 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:56:07,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:56:08,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:56:09,000 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:56:09,516 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:56:10,630 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:56:11,517 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:56:13,518 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:56:15,519 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:56:17,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:56:19,521 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:56:21,522 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:56:23,523 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:56:24,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:56:24,302 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:56:25,524 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:56:27,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:56:29,526 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:56:31,527 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:56:33,528 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:56:35,528 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:56:37,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:56:39,530 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:56:39,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:56:39,660 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:56:40,703 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:56:41,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:56:43,532 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:56:45,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:56:47,534 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:56:49,534 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:56:51,535 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:56:53,536 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:56:54,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:56:54,921 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:56:55,537 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:56:57,538 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:56:59,539 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:57:01,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:57:03,541 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:57:05,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:57:07,543 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:57:09,544 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:57:10,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:57:10,166 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:57:10,780 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:57:11,545 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:57:13,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:57:15,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:57:17,547 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:57:19,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:57:21,549 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:57:23,550 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:57:25,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:57:25,390 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:57:25,551 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:57:27,552 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:57:29,552 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:57:31,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:57:33,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:57:35,555 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:57:38,556 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:57:40,557 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:57:40,845 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:57:40,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:57:40,950 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:57:42,558 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:57:44,559 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:57:46,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:57:48,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:57:50,561 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:57:52,562 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:57:54,563 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:57:56,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:57:56,170 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:57:56,564 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:57:58,565 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:58:00,565 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:58:02,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:58:04,567 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:58:06,568 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:58:08,569 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:58:10,569 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:58:10,908 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:58:11,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:58:11,495 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:58:12,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:58:14,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:58:16,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:58:18,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:58:20,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:58:22,574 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:58:24,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:58:26,576 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:58:26,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:58:26,860 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:58:28,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:58:30,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:58:32,579 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:58:34,579 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:58:36,580 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:58:38,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:58:40,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:58:40,966 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:58:42,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:58:42,166 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:58:42,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:58:44,583 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:58:46,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:58:48,585 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:58:50,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:58:52,587 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:58:54,588 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:58:56,589 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:58:57,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:58:57,405 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:58:58,590 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:59:00,590 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:59:02,591 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:59:04,592 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:59:06,593 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:59:08,594 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:59:11,025 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:59:11,595 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:59:12,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:59:12,692 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:59:13,595 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:59:15,596 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:59:17,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:59:19,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:59:21,598 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:59:23,599 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:59:25,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:59:27,601 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:59:28,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:59:28,050 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:59:29,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:59:31,603 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:59:33,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:59:35,605 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:59:37,606 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:59:39,607 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:59:41,084 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 06:59:41,608 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:59:43,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:59:43,273 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:59:43,609 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:59:45,609 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:59:47,610 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:59:49,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:59:51,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:59:53,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:59:55,613 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:59:57,614 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 06:59:58,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 06:59:58,494 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 06:59:59,615 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:00:01,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:00:03,617 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:00:05,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:00:07,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:00:09,619 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:00:11,145 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:00:11,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:00:13,621 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:00:13,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:00:13,893 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:00:15,621 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:00:17,622 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:00:19,623 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:00:21,624 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:00:23,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:00:25,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:00:27,626 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:00:29,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:00:29,174 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:00:29,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:00:31,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:00:33,629 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:00:35,629 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:00:37,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:00:39,631 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:00:41,215 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:00:41,632 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:00:43,632 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:00:44,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:00:44,391 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:00:45,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:00:48,634 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:00:50,635 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:00:52,636 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:00:54,637 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:00:56,638 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:00:58,638 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:00:59,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:00:59,784 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:01:00,639 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:01:02,640 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:01:04,641 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:01:06,641 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:01:08,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:01:10,643 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:01:11,284 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:01:12,644 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:01:14,645 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:01:15,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:01:15,111 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:01:16,646 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:01:18,646 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:01:20,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:01:22,648 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:01:24,649 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:01:26,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:01:28,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:01:30,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:01:30,334 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:01:30,651 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:01:32,652 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:01:34,653 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:01:36,654 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:01:38,655 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:01:40,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:01:41,357 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:01:42,657 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:01:44,657 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:01:45,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:01:45,628 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:01:46,658 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:01:48,659 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:01:50,660 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:01:52,661 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:01:54,661 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:01:56,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:01:59,664 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:02:00,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:02:00,859 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:02:01,664 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:02:03,665 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:02:05,666 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:02:07,667 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:02:09,668 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:02:11,429 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:02:11,668 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:02:13,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:02:15,670 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:02:16,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:02:16,085 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:02:17,671 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:02:19,672 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:02:21,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:02:23,674 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:02:25,675 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:02:27,676 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:02:29,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:02:31,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:02:31,327 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:02:31,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:02:33,678 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:02:35,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:02:37,680 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:02:39,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:02:41,506 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:02:41,682 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:02:43,683 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:02:45,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:02:46,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:02:46,643 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:02:47,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:02:49,685 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:02:51,687 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:02:53,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:02:55,689 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:02:57,690 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:02:59,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:03:01,692 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:03:01,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:03:01,867 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:03:03,693 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:03:05,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:03:07,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:03:09,695 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:03:11,579 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:03:11,696 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:03:13,697 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:03:15,697 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:03:17,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:03:17,095 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:03:17,698 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:03:19,699 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:03:21,700 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:03:23,701 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:03:25,702 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:03:27,703 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:03:29,704 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:03:31,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:03:32,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:03:32,317 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:03:33,706 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:03:36,707 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:03:38,708 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:03:40,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:03:41,651 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:03:42,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:03:44,710 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:03:46,711 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:03:47,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:03:47,538 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:03:48,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:03:50,713 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:03:52,714 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:03:54,714 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:03:56,715 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:03:58,716 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:04:00,717 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:04:02,718 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:04:02,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:04:02,772 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:04:04,719 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:04:06,720 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:04:08,720 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:04:10,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:04:11,726 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:04:12,722 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:04:14,723 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:04:16,724 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:04:18,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:04:18,065 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:04:18,724 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:04:20,725 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:04:22,726 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:04:24,727 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:04:26,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:04:28,729 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:04:30,730 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:04:32,730 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:04:33,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:04:33,305 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:04:34,731 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:04:36,732 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:04:38,733 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:04:40,734 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:04:41,802 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:04:42,734 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:04:44,735 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:04:46,736 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:04:48,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:04:48,622 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:04:48,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:04:50,738 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:04:52,739 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:04:55,740 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:04:57,741 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:04:59,742 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:05:01,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:05:03,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:05:04,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:05:04,078 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:05:05,744 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:05:07,745 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:05:09,746 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:05:11,747 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:05:11,877 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:05:13,747 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:05:15,748 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:05:17,749 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:05:19,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:05:19,342 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:05:19,750 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:05:21,751 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:05:23,752 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:05:25,752 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:05:27,753 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:05:29,754 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:05:31,755 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:05:33,756 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:05:34,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:05:34,588 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:05:35,757 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:05:37,758 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:05:39,759 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:05:41,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:05:41,954 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:05:43,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:05:45,761 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:05:47,761 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:05:49,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:05:49,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:05:49,887 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:05:51,763 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:05:53,763 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:05:56,764 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:05:58,765 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:06:00,765 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:06:02,766 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:06:04,767 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:06:05,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:06:05,236 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:06:06,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:06:08,769 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:06:10,770 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:06:12,026 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:06:12,771 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:06:14,772 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:06:16,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:06:18,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:06:20,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:06:20,557 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:06:20,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:06:22,775 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:06:24,776 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:06:26,777 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:06:28,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:06:30,779 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:06:32,780 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:06:34,781 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:06:35,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:06:35,897 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:06:36,782 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:06:38,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:06:40,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:06:42,099 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:06:42,785 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:06:44,786 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:06:46,787 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:06:48,788 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:06:50,789 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:06:51,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:06:51,273 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:06:52,790 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:06:54,791 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:06:56,792 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:06:58,793 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:07:00,794 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:07:02,795 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:07:04,796 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:07:06,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:07:06,496 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:07:06,797 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:07:08,797 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:07:10,798 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:07:12,175 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:07:12,799 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:07:14,800 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:07:16,801 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:07:18,802 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:07:20,802 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:07:21,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:07:21,714 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:07:22,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:07:25,804 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:07:27,805 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:07:29,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:07:31,807 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:07:33,807 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:07:35,808 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:07:37,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:07:37,018 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:07:37,809 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:07:39,810 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:07:41,811 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:07:42,247 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:07:43,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:07:45,813 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:07:47,814 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:07:49,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:07:51,816 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:07:52,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:07:52,285 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:07:53,817 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:07:55,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:07:57,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:07:59,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:08:01,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:08:03,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:08:05,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:08:07,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:08:07,596 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:08:07,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:08:09,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:08:11,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:08:12,320 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:08:13,826 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:08:15,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:08:17,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:08:19,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:08:21,829 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:08:22,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:08:22,924 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:08:23,829 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:08:25,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:08:27,831 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:08:29,831 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:08:31,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:08:33,833 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:08:35,833 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:08:37,834 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:08:38,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:08:38,311 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:08:39,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:08:41,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:08:42,393 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:08:43,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:08:45,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:08:47,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:08:49,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:08:51,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:08:53,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:08:53,536 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:08:53,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:08:55,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:08:57,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:09:00,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:09:02,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:09:04,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:09:06,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:09:08,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:09:08,826 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:09:08,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:09:10,846 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:09:12,466 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:09:12,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:09:14,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:09:16,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:09:18,849 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:09:20,850 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:09:22,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:09:24,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:09:24,083 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:09:24,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:09:26,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:09:28,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:09:30,854 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:09:32,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:09:34,856 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:09:36,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:09:38,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:09:39,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:09:39,388 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:09:40,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:09:42,541 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:09:42,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:09:44,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:09:46,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:09:48,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:09:50,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:09:52,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:09:54,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:09:54,609 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:09:54,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:09:56,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:09:58,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:10:00,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:10:02,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:10:04,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:10:06,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:10:08,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:10:09,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:10:09,956 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:10:10,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:10:12,616 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:10:12,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:10:14,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:10:17,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:10:19,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:10:21,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:10:23,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:10:25,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:10:25,279 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:10:25,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:10:27,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:10:29,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:10:31,883 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:10:33,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:10:35,885 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:10:37,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:10:39,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:10:40,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:10:40,503 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:10:41,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:10:42,693 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:10:43,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:10:45,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:10:47,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:10:49,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:10:51,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:10:53,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:10:55,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:10:55,774 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:10:55,894 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:10:57,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:10:59,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:11:01,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:11:03,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:11:05,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:11:07,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:11:09,900 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:11:11,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:11:11,081 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:11:11,901 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:11:12,768 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:11:13,902 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:11:15,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:11:17,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:11:19,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:11:21,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:11:23,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:11:25,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:11:26,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:11:26,365 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:11:27,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:11:29,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:11:32,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:11:34,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:11:36,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:11:38,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:11:40,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:11:41,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:11:41,589 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:11:42,845 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:11:42,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:11:44,916 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:11:46,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:11:48,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:11:50,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:11:52,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:11:54,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:11:56,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:11:56,883 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:11:56,921 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:11:58,922 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:12:00,922 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:12:02,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:12:04,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:12:06,925 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:12:08,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:12:10,927 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:12:12,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:12:12,104 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:12:12,921 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:12:12,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:12:14,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:12:16,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:12:18,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:12:20,932 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:12:22,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:12:24,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:12:26,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:12:27,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:12:27,326 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:12:28,935 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:12:30,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:12:32,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:12:34,937 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:12:36,938 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:12:38,939 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:12:40,940 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:12:42,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:12:42,668 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:12:42,940 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:12:42,995 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:12:44,941 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:12:46,942 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:12:48,943 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:12:50,944 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:12:52,945 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:12:54,945 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:12:56,946 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:12:57,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:12:57,937 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:12:58,947 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:13:00,949 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:13:03,950 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:13:05,951 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:13:07,951 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:13:09,952 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:13:11,952 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:13:13,078 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:13:13,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:13:13,193 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:13:13,953 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:13:15,954 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:13:17,954 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:13:19,955 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:13:21,956 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:13:23,956 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:13:25,957 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:13:27,957 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:13:28,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:13:28,428 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:13:29,958 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:13:31,959 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:13:33,959 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:13:35,960 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:13:37,961 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:13:39,961 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:13:41,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:13:43,143 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:13:43,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:13:43,726 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:13:43,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:13:45,963 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:13:47,964 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:13:49,965 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:13:51,966 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:13:53,967 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:13:55,968 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:13:57,970 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:13:59,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:13:59,136 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:13:59,970 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:14:01,971 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:14:03,972 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:14:05,973 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:14:07,974 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:14:09,975 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:14:11,976 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:14:13,214 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:14:13,976 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:14:14,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:14:14,502 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:14:15,978 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:14:17,979 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:14:20,980 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:14:22,981 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:14:24,981 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:14:26,982 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:14:28,983 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:14:29,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:14:29,791 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:14:30,983 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:14:32,984 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:14:34,985 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:14:36,986 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:14:38,987 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:14:40,987 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:14:42,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:14:43,289 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:14:44,989 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:14:45,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:14:45,048 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:14:46,990 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:14:48,990 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:14:50,991 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:14:52,992 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:14:54,993 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:14:56,994 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:14:58,995 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:15:00,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:15:00,301 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:15:00,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:15:02,997 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:15:04,998 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:15:06,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:15:09,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:15:11,001 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:15:13,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:15:13,364 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:15:15,003 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:15:15,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:15:15,538 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:15:17,003 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:15:19,004 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:15:21,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:15:23,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:15:25,007 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:15:27,008 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:15:29,008 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:15:30,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:15:30,761 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:15:31,009 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:15:33,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:15:35,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:15:37,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:15:39,012 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:15:41,013 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:15:43,013 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:15:43,428 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:15:45,014 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:15:46,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:15:46,071 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:15:47,015 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:15:49,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:15:51,017 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:15:53,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:15:55,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:15:57,019 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:15:59,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:16:01,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:16:01,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:16:01,291 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:16:03,021 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:16:05,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:16:07,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:16:09,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:16:11,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:16:13,025 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:16:13,503 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:16:15,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:16:16,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:16:16,600 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:16:17,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:16:20,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:16:22,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:16:24,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:16:26,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:16:28,031 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:16:30,032 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:16:31,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:16:31,925 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:16:32,032 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:16:34,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:16:36,034 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:16:38,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:16:40,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:16:42,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:16:43,576 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:16:44,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:16:46,038 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:16:47,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:16:47,157 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:16:48,039 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:16:50,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:16:52,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:16:54,041 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:16:56,042 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:16:58,042 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:17:00,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:17:02,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:17:02,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:17:02,754 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:17:04,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:17:06,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:17:08,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:17:10,047 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:17:12,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:17:13,652 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:17:14,049 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:17:16,049 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:17:18,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:17:18,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:17:18,124 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:17:20,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:17:22,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:17:24,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:17:26,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:17:28,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:17:30,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:17:33,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:17:33,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:17:33,509 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:17:35,056 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:17:37,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:17:39,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:17:41,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:17:43,059 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:17:43,725 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:17:45,060 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:17:47,061 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:17:48,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:17:48,734 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:17:49,061 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:17:51,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:17:53,063 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:17:55,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:17:57,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:17:59,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:18:01,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:18:03,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:18:03,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:18:03,955 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:18:05,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:18:07,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:18:09,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:18:11,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:18:13,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:18:13,802 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:18:15,071 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:18:17,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:18:19,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:18:19,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:18:19,289 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:18:21,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:18:23,074 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:18:25,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:18:27,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:18:29,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:18:31,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:18:33,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:18:34,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:18:34,518 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:18:35,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:18:37,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:18:39,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:18:41,081 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:18:43,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:18:43,879 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:18:45,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:18:47,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:18:49,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:18:49,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:18:49,916 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:18:51,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:18:53,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:18:55,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:18:57,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:18:59,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:19:01,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:19:03,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:19:05,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:19:05,139 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:19:06,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:19:08,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:19:10,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:19:12,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:19:13,956 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:19:14,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:19:16,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:19:18,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:19:20,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:19:20,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:19:20,365 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:19:22,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:19:24,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:19:26,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:19:28,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:19:30,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:19:32,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:19:34,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:19:35,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:19:35,638 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:19:36,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:19:38,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:19:40,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:19:42,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:19:44,035 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:19:44,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:19:46,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:19:48,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:19:50,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:19:51,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:19:51,003 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:19:52,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:19:54,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:19:56,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:19:58,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:20:00,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:20:02,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:20:04,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:20:06,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:20:06,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:20:06,462 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:20:08,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:20:10,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:20:12,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:20:14,109 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:20:14,121 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:20:16,121 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:20:18,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:20:20,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:20:21,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:20:21,756 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:20:22,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:20:24,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:20:26,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:20:28,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:20:30,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:20:32,128 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:20:35,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:20:37,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:20:37,065 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:20:37,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:20:39,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:20:41,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:20:43,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:20:44,184 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:20:45,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:20:47,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:20:49,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:20:51,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:20:52,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:20:52,292 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:20:53,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:20:55,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:20:57,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:20:59,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:21:01,140 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:21:03,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:21:05,142 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:21:07,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:21:07,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:21:07,681 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:21:09,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:21:11,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:21:13,145 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:21:14,257 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:21:15,146 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:21:17,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:21:19,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:21:21,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:21:23,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:21:23,009 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:21:23,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:21:25,150 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:21:27,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:21:29,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:21:31,152 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:21:33,153 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:21:35,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:21:37,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:21:38,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:21:38,356 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:21:39,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:21:41,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:21:43,157 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:21:44,332 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:21:45,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:21:47,159 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:21:49,160 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:21:51,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:21:53,162 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:21:53,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:21:53,582 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:21:55,163 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:21:58,164 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:22:00,165 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:22:02,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:22:04,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:22:06,168 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:22:08,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:22:08,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:22:08,911 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:22:10,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:22:12,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:22:14,172 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:22:14,406 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:22:16,172 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:22:18,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:22:20,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:22:22,175 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:22:24,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:22:24,136 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:22:24,176 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:22:26,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:22:28,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:22:30,179 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:22:32,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:22:34,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:22:36,182 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:22:38,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:22:39,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:22:39,531 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:22:40,184 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:22:42,185 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:22:44,186 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:22:44,480 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:22:46,187 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:22:48,188 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:22:50,189 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:22:52,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:22:54,191 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:22:54,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:22:54,840 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:22:56,192 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:22:58,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:23:00,194 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:23:02,195 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:23:04,196 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:23:06,197 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:23:08,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:23:10,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:23:10,066 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:23:10,199 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:23:12,200 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:23:14,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:23:14,553 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:23:16,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:23:18,202 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:23:20,203 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:23:22,204 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:23:24,205 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:23:25,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:23:25,479 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:23:26,206 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:23:28,207 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:23:30,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:23:32,209 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:23:34,210 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:23:36,211 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:23:38,212 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:23:40,213 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:23:40,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:23:40,704 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:23:42,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:23:44,215 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:23:44,628 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:23:46,216 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:23:48,217 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:23:50,218 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:23:52,218 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:23:54,219 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:23:55,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:23:55,979 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:23:56,220 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:23:59,222 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:24:01,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:24:03,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:24:05,224 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:24:07,225 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:24:09,226 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:24:11,227 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:24:11,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:24:11,290 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:24:13,228 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:24:14,704 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:24:15,228 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:24:17,229 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:24:19,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:24:21,231 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:24:23,231 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:24:25,232 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:24:26,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:24:26,533 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:24:27,233 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:24:29,233 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:24:41,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:24:41,804 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:24:44,780 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:24:57,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:24:57,046 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:25:12,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:25:12,304 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:25:14,853 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:25:27,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:25:27,565 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:25:29,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:25:29,826 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 07:25:29,878 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 07:25:29,956 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 07:25:30,255 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 07:25:30,255 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:25:31,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:25:39,259 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:25:42,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:25:42,844 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:25:44,931 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:25:58,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:25:58,093 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:26:03,270 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:26:13,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:26:13,337 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:26:15,010 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:26:28,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:26:28,563 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:26:43,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:26:43,845 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:26:45,087 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:26:59,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:26:59,068 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:27:14,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:27:14,361 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:27:15,165 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:27:29,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:27:29,584 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:27:44,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:27:44,807 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:27:45,244 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:28:00,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:28:00,031 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:28:15,320 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:28:15,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:28:15,341 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:28:30,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:28:30,555 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:28:45,398 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:28:45,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:28:45,781 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:29:01,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:29:01,029 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:29:15,477 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:29:16,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:29:16,299 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:29:31,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:29:31,529 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:29:45,558 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:29:46,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:29:46,786 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:29:55,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:29:57,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:30:00,376 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:30:02,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:30:02,009 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:30:10,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:30:12,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:12,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:12,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:12,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:12,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:12,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:12,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:12,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:12,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:12,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:12,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:12,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:12,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:12,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:12,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:12,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:14,382 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:30:15,635 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:30:17,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:30:17,233 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:30:18,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:30:22,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:30:26,387 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:30:27,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:27,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:27,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:27,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:27,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:27,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:27,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:27,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:27,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:27,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:27,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:27,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:27,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:27,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:27,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:27,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:28,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:28,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:28,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:28,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:28,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:28,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:28,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:28,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:28,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:28,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:28,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:28,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:28,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:28,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:28,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:28,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:30,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:30,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:30,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:30,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:30,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:30,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:30,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:30,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:30,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:30,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:30,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:30,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:30,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:30,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:30,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:30,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:30,388 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:30:30,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:30,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:30,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:30,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:30,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:30,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:30,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:30,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:30,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:30,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:30,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:30,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:30,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:30,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:30,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:30,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:32,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:32,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:32,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:32,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:32,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:32,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:32,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:32,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:32,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:32,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:32,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:32,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:32,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:32,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:32,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:32,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:32,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:30:32,514 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:30:33,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:33,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:33,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:33,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:33,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:33,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:33,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:33,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:33,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:33,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:33,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:33,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:33,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:33,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:33,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:33,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:34,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:30:35,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:35,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:35,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:35,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:35,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:35,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:35,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:35,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:35,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:35,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:35,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:35,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:35,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:35,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:35,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:35,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:35,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:35,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:35,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:35,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:35,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:35,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:35,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:35,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:35,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:35,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:35,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:35,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:35,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:35,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:35,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:35,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:38,391 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:30:40,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:30:44,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:30:45,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:45,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:45,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:45,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:45,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:45,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:45,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:45,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:45,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:45,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:45,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:45,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:45,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:45,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:45,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:45,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:45,710 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:30:46,395 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:30:46,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:46,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:47,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:47,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:47,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:47,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:47,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:47,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:47,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:47,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:47,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:47,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:47,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:47,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:47,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:47,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:47,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:47,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:47,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:47,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:47,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:47,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:47,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:47,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:47,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:47,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:47,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:47,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:47,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:47,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:47,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:47,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:47,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:30:47,774 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:30:49,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:49,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:49,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:49,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:49,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:49,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:49,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:49,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:49,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:49,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:49,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:49,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:49,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:49,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:49,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:49,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:50,396 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:30:51,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:51,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:51,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:51,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:51,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:51,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:51,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:51,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:51,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:51,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:51,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:51,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:51,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:51,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:51,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:51,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:52,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:30:54,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:54,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:54,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:54,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:54,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:54,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:54,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:54,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:54,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:54,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:54,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:54,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:54,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:54,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:54,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:54,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:55,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:55,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:55,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:55,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:55,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:55,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:55,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:55,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:55,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:55,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:55,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:55,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:55,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:55,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:55,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:55,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:56,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:30:57,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:57,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:57,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:57,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:57,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:57,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:57,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:57,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:57,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:57,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:57,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:57,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:57,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:57,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:57,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:57,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:30:58,399 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:31:02,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:31:03,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:31:03,118 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:31:04,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:31:04,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:04,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:04,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:04,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:04,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:04,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:04,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:04,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:04,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:04,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:04,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:04,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:04,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:04,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:04,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:04,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:06,402 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:31:09,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:09,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:09,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:09,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:09,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:09,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:09,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:09,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:09,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:09,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:09,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:09,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:09,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:09,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:09,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:09,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:10,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:31:11,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:11,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:11,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:11,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:11,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:11,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:11,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:11,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:11,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:11,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:11,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:11,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:11,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:11,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:11,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:11,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:12,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:31:13,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:13,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:13,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:13,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:13,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:13,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:13,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:13,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:13,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:13,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:13,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:13,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:13,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:13,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:13,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:13,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:14,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:31:15,784 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:31:16,406 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:31:18,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:31:18,342 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:31:18,406 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:31:20,407 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:31:22,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:31:24,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:31:26,409 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:31:28,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:31:29,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:29,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:29,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:29,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:29,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:29,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:29,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:29,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:29,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:29,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:29,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:29,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:29,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:29,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:29,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:29,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:30,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:30,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:30,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:30,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:30,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:30,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:30,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:30,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:30,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:30,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:30,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:30,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:30,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:30,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:30,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:30,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:30,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:31:31,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:31,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:31,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:31,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:31,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:31,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:31,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:31,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:31,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:31,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:31,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:31,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:31,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:31,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:31,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:31,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:32,411 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:31:32,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:32,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:32,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:32,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:32,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:32,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:32,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:32,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:32,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:32,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:32,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:32,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:32,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:32,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:32,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:32,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:33,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:31:33,662 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:31:33,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:33,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:33,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:33,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:33,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:33,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:33,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:33,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:33,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:33,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:33,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:33,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:33,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:33,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:33,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:33,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:34,412 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:31:36,412 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:31:36,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:36,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:36,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:36,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:36,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:36,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:36,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:36,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:36,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:36,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:36,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:36,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:36,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:36,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:36,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:36,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:38,413 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:31:39,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:39,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:39,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:39,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:39,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:39,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:39,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:39,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:39,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:39,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:39,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:39,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:39,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:39,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:39,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:39,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:39,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:39,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:39,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:39,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:39,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:39,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:39,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:39,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:39,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:39,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:39,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:39,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:39,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:39,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:39,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:39,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:40,414 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:31:42,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:31:43,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:43,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:43,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:43,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:43,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:43,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:43,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:43,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:43,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:43,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:43,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:43,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:43,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:43,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:43,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:43,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:43,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:43,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:43,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:43,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:43,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:43,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:43,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:43,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:43,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:43,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:43,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:43,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:43,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:43,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:43,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:43,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:44,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:44,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:44,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:44,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:44,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:44,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:44,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:44,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:44,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:44,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:44,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:44,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:44,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:44,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:44,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:44,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:45,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:31:45,859 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:31:47,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:47,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:47,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:47,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:47,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:47,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:47,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:47,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:47,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:47,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:47,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:47,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:47,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:47,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:47,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:47,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:47,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:31:47,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:47,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:47,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:47,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:47,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:47,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:47,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:47,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:47,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:47,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:47,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:47,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:47,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:47,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:47,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:47,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:48,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:48,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:48,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:48,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:48,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:48,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:48,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:48,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:48,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:48,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:48,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:48,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:48,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:48,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:48,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:48,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:48,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:31:48,986 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:31:49,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:31:50,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:50,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:50,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:50,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:50,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:50,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:50,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:50,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:50,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:50,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:50,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:50,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:50,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:50,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:50,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:50,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:50,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:50,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:50,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:50,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:50,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:50,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:50,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:50,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:50,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:50,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:50,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:50,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:50,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:50,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:50,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:50,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:51,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:31:51,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:51,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:51,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:51,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:51,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:51,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:51,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:51,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:51,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:51,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:51,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:51,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:51,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:51,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:51,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:51,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:52,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:52,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:52,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:52,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:52,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:52,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:52,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:52,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:52,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:52,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:52,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:52,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:52,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:52,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:52,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:52,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:53,419 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:31:54,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:54,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:54,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:54,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:54,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:54,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:54,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:54,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:54,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:54,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:54,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:54,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:54,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:54,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:54,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:54,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:54,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:54,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:54,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:54,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:54,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:54,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:54,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:54,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:54,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:54,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:54,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:54,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:54,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:54,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:54,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:54,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:31:55,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:55,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:57,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:57,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:57,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:57,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:57,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:57,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:57,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:57,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:57,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:57,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:57,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:57,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:57,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:57,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:57,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:57,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:57,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:57,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:57,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:57,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:57,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:57,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:57,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:57,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:57,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:57,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:57,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:57,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:31:57,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:31:59,421 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:32:04,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:04,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:04,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:04,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:04,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:04,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:04,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:04,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:04,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:04,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:04,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:04,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:04,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:04,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:04,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:04,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:04,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:32:04,212 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:32:04,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:04,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:04,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:04,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:04,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:04,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:04,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:04,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:04,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:04,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:04,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:04,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:04,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:04,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:04,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:04,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:07,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:07,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:07,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:07,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:07,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:07,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:07,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:07,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:07,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:07,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:07,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:07,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:07,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:07,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:07,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:07,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:07,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:32:13,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:32:15,934 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:32:17,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:17,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:17,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:17,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:17,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:17,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:17,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:17,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:17,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:17,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:17,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:17,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:17,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:17,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:17,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:17,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:17,428 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:32:19,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:32:19,501 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:32:21,430 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:32:25,431 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:32:29,433 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:32:30,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:30,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:30,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:30,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:30,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:30,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:30,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:30,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:30,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:30,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:30,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:30,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:30,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:30,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:30,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:30,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:33,434 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:32:34,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:34,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:34,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:34,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:34,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:34,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:34,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:34,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:34,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:34,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:34,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:34,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:34,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:34,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:34,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:34,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:34,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:34,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:34,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:34,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:34,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:34,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:34,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:34,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:34,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:34,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:34,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:34,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:34,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:34,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:34,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:34,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:34,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:32:34,894 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:32:37,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:37,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:37,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:37,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:37,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:37,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:37,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:37,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:37,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:37,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:37,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:37,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:37,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:37,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:37,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:37,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:37,436 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:32:37,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:37,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:37,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:37,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:37,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:37,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:37,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:37,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:37,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:37,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:37,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:37,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:37,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:37,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:37,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:37,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:39,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:39,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:39,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:39,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:39,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:39,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:39,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:39,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:39,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:39,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:39,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:39,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:39,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:39,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:39,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:39,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:39,437 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:32:43,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:32:43,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:43,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:43,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:43,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:43,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:43,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:43,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:43,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:43,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:43,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:43,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:43,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:43,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:43,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:43,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:43,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:46,006 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:32:46,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:46,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:46,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:46,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:46,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:46,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:46,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:46,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:46,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:46,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:46,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:46,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:46,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:46,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:46,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:46,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:47,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:47,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:47,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:47,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:47,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:47,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:47,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:47,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:47,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:47,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:47,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:47,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:47,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:47,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:47,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:47,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:47,440 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:32:49,441 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:32:50,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:32:50,220 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:32:51,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:51,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:51,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:51,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:51,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:51,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:51,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:51,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:51,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:51,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:51,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:51,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:51,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:51,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:51,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:51,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:51,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:51,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:51,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:51,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:51,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:51,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:51,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:51,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:51,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:51,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:51,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:51,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:51,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:51,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:51,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:51,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:53,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:32:55,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:32:55,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:55,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:57,445 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:32:58,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:58,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:58,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:58,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:58,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:58,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:58,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:58,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:58,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:58,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:58,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:58,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:58,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:58,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:58,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:32:58,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:00,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:00,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:00,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:00,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:00,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:00,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:00,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:00,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:00,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:00,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:00,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:00,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:00,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:00,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:00,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:00,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:01,447 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:33:03,448 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:33:05,449 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:33:05,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:33:05,516 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:33:09,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:33:09,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:09,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:09,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:09,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:09,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:09,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:09,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:09,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:09,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:09,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:09,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:09,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:10,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:10,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:10,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:10,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:11,451 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:33:13,452 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:33:13,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:13,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:13,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:13,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:13,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:13,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:13,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:13,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:13,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:13,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:13,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:13,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:13,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:13,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:13,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:13,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:15,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:33:16,075 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:33:17,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:17,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:17,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:17,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:17,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:17,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:17,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:17,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:17,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:17,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:17,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:17,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:17,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:17,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:17,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:17,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:17,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:33:19,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:19,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:19,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:19,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:19,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:19,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:19,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:19,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:19,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:19,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:19,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:19,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:19,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:19,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:19,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:19,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:19,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:33:20,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:33:20,801 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:33:23,456 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:33:25,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:33:27,458 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:33:29,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:33:30,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:30,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:30,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:30,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:30,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:30,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:30,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:30,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:30,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:30,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:30,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:30,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:30,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:30,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:30,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:30,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:31,460 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:33:33,461 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:33:34,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:34,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:35,462 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:33:36,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:33:36,121 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:33:37,462 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:33:38,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:38,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:38,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:38,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:38,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:38,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:38,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:38,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:38,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:38,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:38,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:38,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:38,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:38,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:38,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:38,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:38,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:38,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:38,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:38,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:38,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:38,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:38,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:38,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:38,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:38,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:38,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:38,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:38,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:38,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:38,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:38,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:39,463 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:33:40,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:40,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:40,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:40,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:40,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:40,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:40,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:40,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:40,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:40,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:40,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:40,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:40,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:40,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:40,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:40,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:41,464 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:33:43,465 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:33:44,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:44,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:44,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:44,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:44,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:44,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:44,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:44,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:44,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:44,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:44,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:44,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:44,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:44,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:44,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:44,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:45,466 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:33:46,145 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:33:46,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:46,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:46,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:46,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:46,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:46,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:46,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:46,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:46,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:46,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:46,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:46,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:46,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:46,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:46,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:46,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:46,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:46,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:46,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:46,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:46,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:46,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:46,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:46,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:46,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:46,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:46,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:46,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:46,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:46,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:46,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:46,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:47,467 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:33:48,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:48,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:48,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:48,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:48,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:48,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:48,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:48,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:48,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:48,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:48,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:48,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:48,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:48,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:48,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:48,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:49,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:49,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:49,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:49,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:49,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:49,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:49,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:49,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:49,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:49,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:49,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:49,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:49,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:49,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:49,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:49,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:49,468 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:33:50,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:50,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:50,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:50,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:50,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:50,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:50,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:50,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:50,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:50,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:50,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:50,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:50,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:50,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:50,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:50,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:51,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:33:51,356 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:33:51,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:33:51,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:51,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:51,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:51,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:51,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:51,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:51,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:51,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:51,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:51,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:51,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:51,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:51,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:51,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:51,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:51,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:52,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:52,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:52,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:52,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:52,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:52,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:52,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:52,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:52,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:52,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:52,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:52,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:52,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:52,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:52,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:52,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:53,470 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:33:54,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:54,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:54,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:54,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:54,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:54,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:54,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:54,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:54,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:54,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:54,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:54,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:54,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:54,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:54,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:54,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:54,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:54,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:54,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:54,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:54,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:54,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:54,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:54,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:54,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:54,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:54,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:54,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:54,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:54,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:54,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:54,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:55,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:55,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:55,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:55,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:55,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:55,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:55,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:55,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:55,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:55,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:55,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:55,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:55,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:55,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:55,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:55,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:55,471 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:33:56,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:56,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:56,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:56,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:56,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:56,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:56,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:56,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:56,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:56,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:56,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:56,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:56,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:56,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:56,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:56,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:56,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:56,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:56,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:56,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:56,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:56,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:56,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:56,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:56,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:56,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:56,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:56,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:56,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:56,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:56,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:56,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:57,472 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:33:58,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:58,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:58,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:58,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:58,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:58,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:58,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:58,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:58,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:58,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:58,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:58,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:58,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:33:58,630 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 07:33:58,851 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 07:33:58,926 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 07:33:59,473 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 07:34:00,473 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:34:06,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:34:06,578 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:34:06,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:06,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:06,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:06,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:06,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:06,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:06,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:06,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:06,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:06,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:06,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:06,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:06,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:06,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:06,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:06,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:07,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:07,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:07,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:07,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:07,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:07,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:07,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:07,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:07,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:07,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:07,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:07,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:07,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:07,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:07,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:07,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:10,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:10,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:10,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:10,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:10,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:10,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:10,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:10,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:10,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:10,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:10,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:10,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:10,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:10,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:10,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:10,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:10,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:10,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:10,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:10,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:10,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:10,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:10,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:10,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:10,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:10,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:10,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:10,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:10,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:10,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:10,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:10,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:10,477 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:34:12,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:12,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:12,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:12,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:12,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:12,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:12,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:12,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:12,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:12,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:12,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:12,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:12,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:12,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:12,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:12,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:14,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:34:16,269 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:34:16,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:16,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:16,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:16,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:16,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:16,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:16,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:16,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:16,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:16,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:16,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:16,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:16,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:16,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:16,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:16,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:18,481 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:34:21,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:21,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:21,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:21,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:21,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:21,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:21,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:21,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:21,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:21,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:21,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:21,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:21,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:21,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:21,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:21,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:21,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:34:21,934 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:34:24,483 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:34:26,484 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:34:30,485 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:34:30,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:30,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:30,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:30,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:30,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:30,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:30,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:30,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:30,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:30,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:30,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:30,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:30,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:30,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:30,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:30,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:34,487 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:34:37,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:34:37,189 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:34:37,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:37,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:37,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:37,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:37,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:37,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:37,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:37,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:37,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:37,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:37,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:37,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:37,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:37,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:37,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:37,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:38,489 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:34:40,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:34:41,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:41,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:41,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:41,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:41,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:41,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:41,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:41,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:41,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:41,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:41,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:41,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:41,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:41,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:41,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:41,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:42,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:42,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:42,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:42,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:42,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:42,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:42,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:42,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:42,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:42,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:42,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:42,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:42,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:42,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:42,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:42,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:44,491 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:34:45,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:45,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:45,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:45,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:45,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:45,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:45,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:45,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:45,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:45,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:45,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:45,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:45,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:45,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:45,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:45,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:46,342 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:34:46,492 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:34:46,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:46,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:46,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:46,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:46,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:46,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:46,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:46,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:46,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:46,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:46,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:46,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:46,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:46,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:46,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:46,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:47,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:47,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:47,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:47,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:47,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:47,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:47,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:47,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:47,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:47,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:47,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:47,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:47,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:47,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:47,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:47,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:50,494 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:34:51,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:51,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:51,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:51,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:51,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:51,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:51,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:51,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:51,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:51,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:51,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:51,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:51,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:51,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:51,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:51,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:51,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:51,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:51,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:51,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:51,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:51,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:51,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:51,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:51,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:51,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:51,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:51,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:51,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:51,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:51,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:51,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:52,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:34:52,462 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:34:52,495 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:34:53,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:53,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:53,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:53,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:53,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:53,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:53,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:53,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:53,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:53,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:53,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:53,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:53,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:53,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:53,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:53,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:55,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:55,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:55,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:55,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:55,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:55,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:55,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:55,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:55,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:55,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:55,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:55,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:55,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:55,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:55,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:55,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:56,496 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:34:57,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:57,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:57,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:57,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:57,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:57,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:57,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:57,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:57,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:57,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:57,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:57,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:57,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:57,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:57,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:57,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:34:58,497 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:35:02,498 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:35:02,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:02,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:02,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:02,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:02,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:02,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:02,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:02,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:02,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:02,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:02,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:02,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:02,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:02,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:02,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:02,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:04,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:04,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:04,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:04,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:04,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:04,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:04,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:04,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:04,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:04,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:04,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:04,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:04,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:04,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:04,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:04,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:04,499 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:35:05,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:05,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:05,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:05,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:05,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:05,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:05,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:05,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:05,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:05,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:05,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:05,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:05,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:05,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:05,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:05,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:06,501 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:35:06,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:06,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:06,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:06,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:06,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:06,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:06,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:06,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:06,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:06,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:06,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:06,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:06,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:06,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:06,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:06,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:06,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:06,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:06,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:06,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:06,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:06,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:06,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:06,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:06,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:06,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:06,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:06,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:06,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:06,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:06,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:06,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:07,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:35:07,677 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:35:10,502 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:35:13,504 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:35:15,504 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:35:16,411 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:35:17,505 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:35:19,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:19,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:19,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:19,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:19,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:19,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:19,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:19,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:19,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:19,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:19,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:19,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:19,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:19,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:19,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:19,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:19,506 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:35:20,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:20,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:20,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:20,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:20,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:20,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:20,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:20,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:20,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:20,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:20,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:20,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:20,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:20,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:20,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:20,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:22,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:22,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:22,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:22,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:22,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:22,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:22,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:22,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:22,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:22,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:22,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:22,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:22,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:22,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:22,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:22,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:22,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:35:22,903 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:35:23,508 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:35:25,508 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:35:25,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:25,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:25,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:25,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:25,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:25,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:25,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:25,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:25,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:25,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:25,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:25,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:25,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:25,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:25,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:25,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:27,509 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:35:29,510 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:35:31,511 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:35:33,512 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:35:35,512 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:35:37,513 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:35:37,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:37,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:37,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:37,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:37,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:37,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:37,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:37,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:37,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:37,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:37,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:37,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:37,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:37,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:37,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:37,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:38,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:38,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:38,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:38,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:38,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:38,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:38,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:38,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:38,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:38,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:38,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:38,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:38,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:38,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:38,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:38,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:38,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:35:38,228 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:35:38,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:38,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:38,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:38,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:38,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:38,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:38,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:38,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:38,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:38,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:38,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:38,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:38,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:38,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:38,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:38,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:39,514 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:35:40,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:40,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:40,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:40,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:40,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:40,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:40,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:40,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:40,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:40,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:40,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:40,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:40,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:40,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:40,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:40,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:41,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:41,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:41,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:41,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:41,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:41,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:41,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:41,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:41,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:41,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:41,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:41,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:41,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:41,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:41,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:41,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:41,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:35:43,516 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:35:45,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:45,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:45,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:45,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:45,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:45,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:45,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:45,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:45,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:45,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:45,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:45,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:45,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:45,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:45,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:45,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:45,516 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:35:46,479 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:35:47,517 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:35:47,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:47,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:47,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:47,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:47,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:47,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:47,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:47,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:47,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:47,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:47,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:47,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:47,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:47,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:47,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:47,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:49,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:49,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:49,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:49,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:49,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:49,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:49,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:49,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:49,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:49,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:49,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:49,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:49,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:49,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:49,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:49,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:49,518 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:35:49,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:49,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:49,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:49,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:49,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:49,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:49,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:49,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:49,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:49,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:49,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:49,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:49,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:49,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:49,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:49,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:50,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:50,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:50,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:50,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:50,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:50,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:50,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:50,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:50,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:50,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:50,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:50,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:50,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:50,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:50,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:50,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:51,519 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:35:51,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:51,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:51,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:51,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:51,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:51,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:51,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:51,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:51,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:51,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:51,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:51,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:51,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:51,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:51,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:51,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:52,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:52,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:52,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:52,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:52,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:52,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:52,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:52,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:52,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:52,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:52,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:52,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:52,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:52,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:52,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:52,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:52,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:52,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:52,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:52,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:52,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:52,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:52,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:52,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:52,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:52,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:52,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:52,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:52,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:52,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:52,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:52,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:53,519 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:35:53,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:35:53,555 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:35:54,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:54,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:54,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:54,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:54,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:54,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:54,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:54,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:54,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:54,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:54,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:54,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:54,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:54,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:54,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:54,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:55,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:35:56,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:56,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:56,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:56,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:56,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:56,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:56,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:56,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:56,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:56,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:56,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:56,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:56,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:56,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:56,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:56,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:56,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:56,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:56,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:56,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:56,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:56,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:56,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:56,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:56,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:56,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:56,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:56,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:56,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:56,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:56,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:56,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:57,521 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:35:58,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:58,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:58,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:58,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:58,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:58,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:58,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:58,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:58,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:58,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:58,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:58,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:58,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:58,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:58,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:58,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:58,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:58,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:58,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:58,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:58,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:58,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:58,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:58,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:58,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:58,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:58,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:58,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:58,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:58,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:58,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:58,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:35:59,522 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:36:01,522 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:36:08,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:36:08,785 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:36:11,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:36:11,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:11,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:11,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:11,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:11,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:11,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:11,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:11,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:11,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:11,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:11,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:11,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:11,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:11,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:11,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:11,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:15,527 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:36:16,549 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:36:18,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:18,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:18,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:18,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:18,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:18,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:18,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:18,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:18,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:18,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:18,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:18,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:18,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:18,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:18,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:18,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:20,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:20,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:20,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:20,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:20,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:20,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:20,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:20,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:20,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:20,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:20,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:20,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:20,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:20,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:20,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:20,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:21,530 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:36:24,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:24,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:24,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:24,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:24,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:24,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:24,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:24,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:24,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:24,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:24,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:24,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:24,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:24,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:24,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:24,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:24,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:24,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:24,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:24,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:24,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:24,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:24,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:24,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:24,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:24,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:24,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:24,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:24,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:24,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:24,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:24,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:25,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:36:26,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:26,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:26,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:26,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:26,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:26,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:26,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:26,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:26,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:26,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:26,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:26,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:26,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:26,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:26,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:26,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:28,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:36:28,786 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:36:29,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:36:32,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:32,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:32,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:32,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:32,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:32,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:32,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:32,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:32,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:32,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:32,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:32,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:32,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:32,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:32,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:32,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:32,534 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:36:36,536 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:36:40,537 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:36:42,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:42,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:42,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:42,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:42,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:42,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:42,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:42,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:42,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:42,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:42,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:42,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:42,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:42,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:42,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:42,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:44,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:36:44,194 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:36:44,539 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:36:46,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:46,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:46,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:46,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:46,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:46,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:46,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:46,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:46,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:46,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:46,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:46,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:46,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:46,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:46,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:46,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:46,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:36:46,622 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:36:50,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:50,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:50,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:50,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:50,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:50,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:50,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:50,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:50,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:50,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:50,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:50,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:50,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:50,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:50,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:50,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:50,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:50,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:50,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:50,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:50,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:50,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:50,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:50,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:50,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:50,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:50,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:50,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:50,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:50,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:50,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:50,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:50,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:36:52,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:36:54,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:54,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:54,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:54,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:54,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:54,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:54,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:54,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:54,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:54,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:54,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:54,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:54,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:54,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:54,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:54,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:55,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:55,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:55,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:55,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:55,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:55,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:55,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:55,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:55,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:55,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:55,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:55,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:55,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:55,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:55,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:55,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:56,544 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:36:57,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:57,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:57,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:57,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:57,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:57,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:57,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:57,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:57,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:57,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:57,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:57,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:57,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:57,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:57,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:57,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:57,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:57,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:57,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:57,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:57,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:57,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:57,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:57,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:57,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:57,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:57,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:57,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:57,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:57,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:57,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:57,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:58,545 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:36:59,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:59,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:59,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:59,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:59,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:59,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:59,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:59,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:59,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:59,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:59,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:59,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:59,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:59,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:59,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:59,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:59,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:59,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:59,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:59,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:59,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:59,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:59,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:59,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:59,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:59,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:59,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:59,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:59,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:59,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:59,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:59,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:36:59,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:36:59,460 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:37:00,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:00,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:00,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:00,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:00,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:00,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:00,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:00,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:00,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:00,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:00,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:00,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:00,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:00,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:00,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:00,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:01,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:01,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:01,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:01,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:01,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:01,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:01,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:01,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:01,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:01,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:01,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:01,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:01,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:01,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:01,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:01,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:02,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:37:04,547 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:37:06,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:37:08,549 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:37:09,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:09,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:09,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:09,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:09,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:09,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:09,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:09,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:09,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:09,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:09,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:09,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:09,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:09,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:09,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:09,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:09,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:09,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:09,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:09,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:09,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:09,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:09,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:09,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:09,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:09,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:09,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:09,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:09,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:09,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:09,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:09,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:11,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:11,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:11,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:11,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:11,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:11,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:11,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:11,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:11,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:11,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:11,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:11,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:11,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:11,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:11,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:11,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:11,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:11,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:11,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:11,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:11,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:11,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:11,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:11,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:11,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:11,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:11,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:11,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:11,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:11,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:11,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:11,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:12,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:12,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:12,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:12,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:12,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:12,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:12,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:12,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:12,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:12,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:12,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:12,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:12,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:12,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:12,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:12,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:12,551 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:37:14,552 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:37:14,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:37:14,786 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:37:16,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:37:16,696 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:37:18,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:37:20,555 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:37:22,555 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:37:23,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:23,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:23,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:23,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:23,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:23,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:23,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:23,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:23,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:23,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:23,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:23,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:23,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:23,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:23,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:23,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:24,556 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:37:25,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:25,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:25,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:25,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:25,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:25,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:25,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:25,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:25,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:25,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:25,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:25,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:25,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:25,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:25,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:25,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:26,557 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:37:27,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:27,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:27,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:27,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:27,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:27,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:27,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:27,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:27,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:27,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:27,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:27,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:27,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:27,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:27,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:27,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:28,558 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:37:29,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:29,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:29,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:29,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:29,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:29,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:29,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:29,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:29,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:29,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:29,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:29,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:29,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:29,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:29,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:29,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:30,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:37:30,100 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:37:30,559 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:37:32,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:37:34,561 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:37:36,562 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:37:38,563 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:37:40,564 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:37:40,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:40,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:40,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:40,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:40,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:40,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:40,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:40,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:40,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:40,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:40,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:40,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:40,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:40,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:40,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:40,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:41,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:41,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:41,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:41,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:41,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:41,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:41,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:41,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:41,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:41,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:41,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:41,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:41,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:41,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:41,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:41,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:41,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:41,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:41,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:41,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:41,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:41,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:41,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:41,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:41,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:41,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:41,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:41,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:41,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:41,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:41,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:41,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:42,565 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:37:43,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:43,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:43,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:43,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:43,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:43,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:43,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:43,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:43,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:43,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:43,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:43,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:43,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:43,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:43,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:43,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:44,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:37:45,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:37:45,318 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:37:46,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:46,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:46,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:46,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:46,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:46,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:46,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:46,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:46,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:46,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:46,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:46,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:46,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:46,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:46,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:46,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:46,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:46,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:46,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:46,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:46,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:46,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:46,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:46,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:46,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:46,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:46,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:46,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:46,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:46,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:46,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:46,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:46,567 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:37:46,764 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:37:48,567 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:37:48,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:48,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:48,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:48,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:48,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:48,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:48,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:48,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:48,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:48,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:48,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:48,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:48,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:48,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:48,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:48,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:50,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:50,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:50,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:50,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:50,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:50,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:50,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:50,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:50,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:50,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:50,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:50,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:50,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:50,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:50,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:50,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:50,568 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:37:51,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:51,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:51,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:51,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:51,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:51,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:51,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:51,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:51,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:51,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:51,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:51,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:51,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:51,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:51,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:51,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:52,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:52,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:52,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:52,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:52,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:52,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:52,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:52,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:52,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:52,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:52,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:52,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:52,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:52,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:52,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:52,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:52,569 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:37:53,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:53,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:53,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:53,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:53,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:53,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:53,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:53,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:53,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:53,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:53,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:53,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:53,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:53,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:53,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:53,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:53,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:53,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:53,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:53,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:53,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:53,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:53,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:53,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:53,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:53,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:53,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:53,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:53,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:53,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:53,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:53,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:54,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:54,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:54,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:54,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:54,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:54,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:54,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:54,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:54,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:54,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:54,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:54,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:54,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:54,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:54,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:54,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:54,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:37:55,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:55,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:55,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:55,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:55,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:55,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:55,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:55,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:55,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:55,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:55,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:55,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:55,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:55,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:55,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:55,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:56,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:37:57,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:57,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:57,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:57,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:57,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:57,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:57,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:57,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:57,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:57,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:57,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:57,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:57,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:57,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:57,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:57,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:58,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:58,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:58,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:58,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:58,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:58,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:58,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:58,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:58,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:58,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:58,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:58,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:58,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:37:58,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:37:58,695 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 07:37:58,941 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 07:37:59,016 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 07:37:59,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 07:38:00,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:38:00,551 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:38:00,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:38:01,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:38:06,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:06,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:06,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:06,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:06,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:06,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:06,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:06,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:06,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:06,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:06,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:06,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:06,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:06,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:06,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:06,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:08,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:38:09,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:09,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:09,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:09,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:09,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:09,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:09,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:09,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:09,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:09,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:09,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:09,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:09,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:09,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:09,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:09,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:11,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:11,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:11,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:11,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:11,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:11,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:11,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:11,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:11,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:11,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:11,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:11,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:11,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:11,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:11,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:11,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:13,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:38:14,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:14,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:14,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:14,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:14,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:14,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:14,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:14,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:14,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:14,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:14,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:14,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:14,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:14,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:14,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:14,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:15,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:38:15,776 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:38:17,060 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:38:19,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:19,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:19,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:19,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:19,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:19,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:19,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:19,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:19,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:19,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:19,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:19,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:19,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:19,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:19,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:19,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:19,580 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:38:22,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:22,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:23,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:38:27,583 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:38:28,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:28,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:28,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:28,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:28,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:28,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:28,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:28,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:28,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:28,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:28,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:28,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:28,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:28,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:28,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:28,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:30,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:30,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:30,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:30,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:30,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:30,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:30,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:30,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:30,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:30,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:30,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:30,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:30,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:30,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:30,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:30,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:30,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:30,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:30,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:30,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:30,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:30,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:30,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:30,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:30,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:30,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:30,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:30,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:30,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:30,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:30,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:30,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:31,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:38:31,082 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:38:31,585 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:38:35,587 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:38:36,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:36,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:36,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:36,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:36,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:36,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:36,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:36,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:36,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:36,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:36,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:36,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:36,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:36,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:36,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:36,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:39,588 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:38:41,590 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:38:45,592 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:38:46,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:38:46,558 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:38:47,133 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:38:47,592 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:38:51,594 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:38:52,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:52,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:52,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:52,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:52,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:52,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:52,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:52,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:52,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:52,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:52,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:52,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:52,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:52,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:52,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:52,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:53,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:53,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:53,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:53,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:53,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:53,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:53,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:53,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:53,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:53,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:53,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:53,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:53,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:53,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:53,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:53,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:53,595 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:38:55,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:55,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:55,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:55,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:55,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:55,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:55,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:55,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:55,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:55,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:55,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:55,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:55,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:55,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:55,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:55,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:38:57,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:57,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:38:59,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:39:00,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:00,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:00,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:00,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:00,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:00,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:00,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:00,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:00,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:00,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:00,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:00,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:00,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:00,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:00,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:00,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:01,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:39:01,784 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:39:02,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:02,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:02,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:02,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:02,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:02,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:02,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:02,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:02,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:02,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:02,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:02,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:02,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:02,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:02,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:02,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:03,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:03,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:03,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:03,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:03,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:03,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:03,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:03,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:03,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:03,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:03,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:03,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:03,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:03,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:03,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:03,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:03,599 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:39:04,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:04,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:04,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:04,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:04,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:04,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:04,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:04,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:04,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:04,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:04,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:04,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:04,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:04,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:04,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:04,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:05,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:39:07,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:07,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:07,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:07,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:07,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:07,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:07,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:07,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:07,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:07,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:07,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:07,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:07,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:07,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:07,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:07,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:07,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:07,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:07,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:07,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:07,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:07,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:07,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:07,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:07,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:07,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:07,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:07,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:07,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:07,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:07,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:07,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:07,601 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:39:09,601 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:39:13,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:13,603 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:39:14,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:14,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:14,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:14,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:14,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:14,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:14,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:14,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:14,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:14,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:14,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:14,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:14,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:14,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:14,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:14,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:15,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:39:16,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:16,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:16,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:16,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:16,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:16,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:16,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:16,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:16,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:16,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:16,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:16,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:16,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:16,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:16,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:16,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:17,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:39:17,020 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:39:17,241 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:39:17,605 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:39:19,606 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:39:21,607 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:39:23,608 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:39:23,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:23,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:23,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:23,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:23,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:23,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:23,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:23,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:23,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:23,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:23,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:23,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:23,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:23,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:23,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:23,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:25,609 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:39:27,609 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:39:28,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:28,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:28,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:28,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:28,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:28,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:28,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:28,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:28,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:28,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:28,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:28,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:28,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:28,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:28,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:28,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:29,610 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:39:30,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:30,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:30,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:30,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:30,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:30,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:30,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:30,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:30,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:30,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:30,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:30,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:30,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:30,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:30,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:30,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:31,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:39:32,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:39:32,301 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:39:33,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:39:33,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:33,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:33,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:33,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:33,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:33,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:33,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:33,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:33,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:33,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:33,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:33,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:33,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:33,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:33,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:33,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:35,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:39:37,613 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:39:39,614 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:39:41,614 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:39:42,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:42,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:42,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:42,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:42,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:42,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:42,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:42,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:42,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:42,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:42,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:42,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:42,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:42,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:42,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:42,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:43,615 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:39:43,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:43,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:43,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:43,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:43,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:43,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:43,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:43,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:43,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:43,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:43,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:43,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:43,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:43,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:43,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:43,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:45,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:45,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:45,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:45,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:45,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:45,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:45,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:45,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:45,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:45,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:45,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:45,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:45,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:45,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:45,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:45,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:45,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:39:47,268 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:39:47,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:39:47,599 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:39:47,617 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:39:49,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:49,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:49,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:49,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:49,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:49,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:49,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:49,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:49,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:49,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:49,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:49,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:49,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:49,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:49,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:49,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:49,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:49,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:49,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:49,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:49,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:49,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:49,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:49,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:49,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:49,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:49,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:49,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:49,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:49,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:49,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:49,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:50,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:50,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:50,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:50,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:50,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:50,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:50,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:50,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:50,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:50,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:50,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:50,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:50,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:50,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:50,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:50,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:50,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:39:52,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:52,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:52,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:52,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:52,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:52,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:52,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:52,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:52,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:52,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:52,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:52,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:52,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:52,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:52,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:52,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:52,619 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:39:52,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:52,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:52,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:52,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:52,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:52,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:52,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:52,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:52,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:52,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:52,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:52,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:52,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:52,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:52,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:52,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:54,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:54,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:54,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:54,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:54,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:54,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:54,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:54,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:54,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:54,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:54,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:54,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:54,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:54,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:54,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:54,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:54,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:39:55,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:55,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:56,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:56,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:56,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:56,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:56,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:56,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:56,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:56,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:56,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:56,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:56,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:56,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:56,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:56,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:56,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:56,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:56,621 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:39:58,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:58,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:58,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:58,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:58,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:58,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:58,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:58,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:58,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:58,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:58,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:58,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:58,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:58,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:58,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:58,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:58,622 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:39:59,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:59,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:59,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:59,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:59,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:59,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:59,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:59,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:59,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:59,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:59,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:39:59,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:00,623 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:40:02,624 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:40:02,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:40:02,839 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:40:07,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:07,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:07,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:07,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:07,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:07,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:07,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:07,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:07,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:07,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:07,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:07,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:07,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:07,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:07,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:07,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:10,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:40:16,629 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:40:17,342 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:40:18,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:40:18,074 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:40:20,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:20,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:20,631 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:40:20,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:20,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:20,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:20,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:20,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:20,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:20,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:20,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:20,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:20,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:20,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:20,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:20,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:20,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:22,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:22,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:22,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:22,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:22,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:22,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:22,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:22,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:22,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:22,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:22,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:22,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:22,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:22,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:22,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:22,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:24,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:40:24,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:24,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:24,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:24,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:24,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:24,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:24,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:24,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:24,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:24,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:24,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:24,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:24,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:24,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:24,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:24,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:26,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:26,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:26,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:26,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:26,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:26,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:26,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:26,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:26,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:26,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:26,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:26,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:26,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:26,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:26,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:26,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:28,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:28,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:28,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:28,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:28,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:28,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:28,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:28,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:28,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:28,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:28,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:28,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:28,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:28,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:28,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:28,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:28,634 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:40:29,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:29,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:29,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:29,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:29,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:29,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:29,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:29,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:29,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:29,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:29,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:29,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:29,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:29,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:29,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:29,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:32,636 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:40:33,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:40:33,293 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:40:33,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:33,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:33,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:33,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:33,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:33,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:33,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:33,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:33,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:33,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:33,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:33,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:33,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:33,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:33,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:33,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:34,637 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:40:35,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:35,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:35,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:35,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:35,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:35,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:35,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:35,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:35,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:35,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:35,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:35,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:35,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:35,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:35,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:35,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:36,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:36,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:36,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:36,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:36,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:36,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:36,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:36,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:36,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:36,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:36,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:36,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:36,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:36,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:36,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:36,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:36,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:36,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:36,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:36,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:36,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:36,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:36,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:36,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:36,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:36,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:36,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:36,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:36,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:36,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:36,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:36,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:38,639 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:40:40,640 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:40:41,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:41,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:41,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:41,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:41,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:41,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:41,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:41,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:41,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:41,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:41,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:41,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:41,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:41,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:41,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:41,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:41,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:41,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:41,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:41,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:41,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:41,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:41,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:41,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:41,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:41,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:41,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:41,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:41,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:41,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:41,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:41,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:44,641 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:40:47,419 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:40:48,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:40:48,518 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:40:48,643 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:40:50,644 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:40:52,645 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:40:55,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:55,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:55,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:55,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:55,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:55,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:55,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:55,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:55,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:55,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:55,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:55,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:55,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:55,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:55,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:55,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:57,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:40:58,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:58,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:58,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:58,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:58,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:58,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:58,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:58,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:58,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:58,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:58,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:58,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:58,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:58,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:58,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:58,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:58,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:58,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:58,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:58,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:58,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:58,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:58,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:58,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:59,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:59,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:59,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:59,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:59,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:59,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:59,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:59,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:40:59,648 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:41:01,649 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:41:02,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:02,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:02,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:02,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:02,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:02,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:02,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:02,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:02,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:02,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:02,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:02,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:02,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:02,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:02,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:02,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:03,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:41:03,739 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:41:05,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:05,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:05,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:05,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:05,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:05,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:05,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:05,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:05,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:05,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:05,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:05,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:05,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:05,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:05,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:05,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:05,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:41:06,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:06,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:06,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:06,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:06,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:06,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:06,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:06,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:06,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:06,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:06,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:06,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:06,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:06,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:06,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:06,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:07,651 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:41:09,652 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:41:09,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:09,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:09,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:09,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:09,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:09,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:09,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:09,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:09,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:09,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:09,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:09,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:09,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:09,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:09,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:09,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:09,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:09,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:09,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:09,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:09,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:09,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:09,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:09,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:09,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:09,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:09,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:09,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:09,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:09,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:09,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:09,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:11,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:11,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:11,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:11,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:11,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:11,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:11,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:11,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:11,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:11,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:11,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:11,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:11,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:11,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:11,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:11,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:11,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:11,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:11,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:11,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:11,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:11,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:11,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:11,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:11,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:11,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:11,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:11,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:11,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:11,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:11,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:11,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:11,653 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:41:12,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:12,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:12,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:12,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:12,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:12,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:12,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:12,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:12,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:12,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:12,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:12,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:12,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:12,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:12,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:12,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:13,654 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:41:14,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:14,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:14,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:14,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:14,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:14,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:14,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:14,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:14,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:14,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:14,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:14,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:14,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:14,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:14,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:14,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:14,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:14,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:14,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:14,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:14,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:14,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:14,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:14,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:14,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:14,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:14,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:14,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:14,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:14,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:14,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:14,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:15,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:15,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:15,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:15,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:15,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:15,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:15,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:15,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:15,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:15,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:15,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:15,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:15,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:15,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:15,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:15,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:16,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:16,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:16,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:16,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:16,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:16,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:16,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:16,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:16,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:16,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:16,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:16,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:16,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:16,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:16,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:16,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:17,496 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:41:17,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:41:18,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:18,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:18,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:18,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:18,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:18,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:18,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:18,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:19,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:19,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:19,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:19,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:19,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:19,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:19,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:19,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:41:19,006 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:41:19,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:19,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:41:21,657 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:41:22,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:22,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:22,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:22,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:22,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:22,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:22,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:22,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:22,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:22,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:22,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:22,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:22,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:22,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:22,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:22,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:23,658 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:41:25,659 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:41:27,660 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:41:29,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:29,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:29,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:29,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:29,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:29,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:29,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:29,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:29,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:29,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:29,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:29,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:29,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:29,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:29,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:29,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:29,661 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:41:31,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:41:33,663 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:41:34,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:41:34,232 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:41:34,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:34,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:34,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:34,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:34,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:34,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:34,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:34,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:34,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:34,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:34,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:34,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:34,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:34,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:34,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:34,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:34,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:34,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:34,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:34,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:34,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:34,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:34,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:34,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:34,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:34,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:34,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:34,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:34,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:34,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:34,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:34,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:35,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:35,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:35,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:35,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:35,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:35,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:35,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:35,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:35,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:35,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:35,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:35,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:35,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:35,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:35,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:35,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:35,664 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:41:37,665 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:41:39,665 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:41:41,666 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:41:43,667 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:41:44,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:44,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:44,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:44,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:44,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:44,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:44,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:44,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:44,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:44,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:44,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:44,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:44,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:44,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:44,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:44,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:45,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:45,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:45,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:45,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:45,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:45,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:45,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:45,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:45,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:45,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:45,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:45,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:45,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:45,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:45,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:45,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:45,668 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:41:45,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:45,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:45,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:45,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:45,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:45,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:45,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:45,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:45,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:45,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:45,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:45,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:45,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:45,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:45,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:45,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:47,574 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:41:47,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:41:48,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:48,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:48,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:48,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:48,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:48,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:48,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:48,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:48,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:48,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:48,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:48,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:48,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:48,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:48,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:48,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:49,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:49,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:49,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:49,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:49,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:49,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:49,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:49,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:49,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:49,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:49,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:49,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:49,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:49,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:49,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:49,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:49,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:41:49,456 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:41:49,670 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:41:51,670 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:41:52,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:52,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:53,671 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:41:55,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,672 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:41:55,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:55,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:56,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:56,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:56,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:56,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:56,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:56,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:56,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:56,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:56,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:56,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:56,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:56,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:56,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:41:56,620 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 07:41:56,835 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 07:41:56,903 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 07:41:57,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 07:41:57,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:41:58,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:42:04,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:42:04,730 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:42:07,834 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:42:11,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:42:14,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:14,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:14,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:14,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:14,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:14,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:14,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:14,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:14,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:14,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:14,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:14,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:14,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:14,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:14,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:14,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:17,678 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:42:17,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:42:19,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:42:19,999 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:42:21,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:42:22,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:22,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:22,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:22,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:22,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:22,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:22,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:22,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:22,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:22,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:22,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:22,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:22,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:22,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:22,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:22,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:25,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:42:27,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:42:28,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:28,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:28,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:28,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:28,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:28,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:28,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:28,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:28,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:28,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:28,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:28,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:28,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:28,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:28,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:28,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:28,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:28,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:28,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:28,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:28,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:28,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:28,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:28,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:28,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:28,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:28,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:28,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:28,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:28,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:28,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:28,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:31,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:42:35,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:42:35,221 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:42:35,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:35,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:35,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:35,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:35,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:35,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:35,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:35,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:35,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:35,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:35,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:35,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:35,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:35,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:35,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:35,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:35,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:42:37,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:37,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:37,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:37,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:37,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:37,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:37,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:37,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:37,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:37,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:37,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:37,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:37,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:37,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:37,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:37,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:38,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:38,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:38,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:38,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:38,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:38,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:38,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:38,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:38,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:38,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:38,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:38,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:38,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:38,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:38,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:38,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:39,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:39,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:39,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:39,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:39,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:39,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:39,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:39,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:39,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:39,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:39,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:39,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:39,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:39,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:39,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:39,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:39,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:39,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:39,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:39,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:39,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:39,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:39,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:39,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:39,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:39,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:39,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:39,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:39,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:39,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:39,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:39,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:39,846 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:42:40,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:40,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:40,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:40,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:40,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:40,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:40,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:40,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:40,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:40,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:40,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:40,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:40,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:40,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:40,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:40,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:41,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:42:42,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:42,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:42,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:42,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:42,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:42,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:42,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:42,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:42,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:42,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:42,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:42,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:42,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:42,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:42,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:42,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:45,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:45,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:45,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:45,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:45,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:45,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:45,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:45,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:45,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:45,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:45,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:45,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:45,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:45,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:45,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:45,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:45,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:45,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:45,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:45,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:45,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:45,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:45,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:45,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:45,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:45,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:45,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:45,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:45,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:45,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:45,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:45,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:42:45,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:42:47,760 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:42:48,849 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:42:50,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:42:50,567 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:42:52,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:42:54,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:42:58,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:43:00,854 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:43:02,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:02,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:02,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:02,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:02,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:02,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:02,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:02,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:02,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:02,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:02,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:02,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:02,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:02,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:02,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:02,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:02,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:02,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:02,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:02,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:02,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:02,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:02,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:02,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:02,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:02,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:02,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:02,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:02,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:02,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:02,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:02,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:02,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:43:05,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:05,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:05,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:05,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:05,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:05,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:05,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:05,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:05,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:05,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:05,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:05,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:05,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:05,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:05,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:05,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:05,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:43:05,799 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:43:06,856 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:43:07,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:07,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:07,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:07,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:07,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:07,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:07,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:07,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:07,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:07,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:07,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:07,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:07,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:07,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:07,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:07,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:08,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:43:09,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:09,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:09,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:09,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:09,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:09,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:09,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:09,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:09,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:09,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:09,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:09,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:09,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:09,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:09,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:09,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:10,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:43:10,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:10,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:10,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:10,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:10,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:10,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:10,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:10,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:10,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:10,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:10,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:10,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:10,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:10,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:10,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:10,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:12,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:43:13,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:13,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:13,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:13,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:13,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:13,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:13,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:13,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:13,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:13,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:13,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:13,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:13,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:13,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:13,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:13,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:13,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:13,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:13,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:13,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:13,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:13,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:13,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:13,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:13,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:13,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:13,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:13,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:13,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:13,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:13,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:13,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:14,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:43:15,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:15,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:15,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:15,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:15,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:15,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:15,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:15,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:15,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:15,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:15,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:15,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:15,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:15,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:15,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:15,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:15,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:15,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:15,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:15,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:15,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:15,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:15,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:15,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:15,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:15,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:15,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:15,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:15,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:15,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:15,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:15,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:16,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:16,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:16,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:16,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:16,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:16,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:16,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:16,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:16,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:16,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:16,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:16,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:16,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:16,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:16,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:16,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:16,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:16,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:16,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:16,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:16,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:16,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:16,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:16,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:16,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:16,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:16,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:16,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:16,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:16,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:16,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:16,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:16,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:43:17,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:17,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:17,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:17,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:17,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:17,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:17,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:17,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:17,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:17,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:17,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:17,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:17,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:17,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:17,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:17,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:17,837 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:43:17,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:17,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:17,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:17,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:17,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:17,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:17,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:17,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:17,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:17,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:17,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:17,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:18,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:18,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:18,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:18,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:19,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:19,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:19,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:19,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:19,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:19,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:19,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:19,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:19,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:19,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:19,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:19,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:19,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:19,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:19,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:19,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:20,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:43:21,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:43:21,030 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:43:21,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:21,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:21,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:21,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:21,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:21,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:21,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:21,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:21,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:21,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:21,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:21,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:21,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:21,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:21,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:21,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:22,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:43:24,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:43:26,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:43:27,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:27,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:27,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:27,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:27,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:27,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:27,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:27,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:27,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:27,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:27,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:27,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:27,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:27,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:27,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:27,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:28,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:43:30,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:43:31,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:31,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:31,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:31,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:31,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:31,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:31,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:31,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:31,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:31,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:31,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:31,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:31,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:31,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:31,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:31,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:32,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:43:34,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:34,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:34,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:34,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:34,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:34,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:34,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:34,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:34,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:34,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:34,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:34,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:34,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:34,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:34,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:34,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:34,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:43:36,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:43:36,338 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:43:36,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:36,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:36,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:36,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:36,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:36,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:36,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:36,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:36,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:36,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:36,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:36,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:36,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:36,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:36,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:36,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:36,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:43:38,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:43:40,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:40,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:40,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:40,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:40,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:40,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:40,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:40,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:40,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:40,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:40,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:40,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:40,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:40,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:40,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:40,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:40,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:43:42,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:43:44,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:43:45,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:45,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:45,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:45,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:45,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:45,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:45,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:45,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:45,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:45,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:45,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:45,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:45,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:45,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:45,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:45,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:46,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:43:47,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:47,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:47,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:47,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:47,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:47,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:47,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:47,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:47,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:47,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:47,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:47,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:47,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:47,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:47,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:47,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:47,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:47,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:47,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:47,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:47,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:47,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:47,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:47,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:47,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:47,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:47,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:47,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:47,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:47,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:47,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:47,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:47,912 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:43:48,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:43:50,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:50,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:50,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:50,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:50,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:50,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:50,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:50,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:50,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:50,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:50,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:50,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:50,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:50,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:50,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:50,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:50,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:43:51,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:43:51,564 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:43:52,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:52,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:52,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:52,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:52,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:52,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:52,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:52,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:52,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:52,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:52,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:52,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:52,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:52,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:52,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:52,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:52,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:43:53,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:53,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:53,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:53,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:53,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:53,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:53,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:53,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:53,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:53,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:53,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:53,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:53,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:53,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:53,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:53,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:53,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:53,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:53,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:53,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:53,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:53,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:53,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:53,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:53,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:53,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:53,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:53,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:53,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:53,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:53,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:53,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:43:54,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:54,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:55,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:55,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:55,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:55,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:55,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:55,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:55,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:55,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:55,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:55,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:55,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:55,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:55,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:55,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:55,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:55,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:56,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:56,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:56,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:56,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:56,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:56,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:56,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:56,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:56,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:56,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:56,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:56,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:43:56,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:44:04,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:04,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:04,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:04,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:04,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:04,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:04,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:04,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:04,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:04,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:04,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:04,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:04,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:04,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:04,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:04,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:04,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:04,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:04,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:04,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:04,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:04,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:04,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:04,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:04,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:04,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:04,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:04,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:04,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:04,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:04,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:04,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:06,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:44:06,869 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:44:06,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:44:08,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:08,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:08,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:08,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:08,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:08,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:08,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:08,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:08,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:08,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:08,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:08,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:08,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:08,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:08,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:08,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:12,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:44:17,986 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:44:18,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:44:22,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:44:22,093 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:44:23,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:44:24,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:24,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:24,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:24,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:24,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:24,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:24,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:24,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:24,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:24,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:24,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:24,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:24,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:24,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:24,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:24,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:27,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:44:28,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:28,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:28,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:28,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:28,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:28,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:28,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:28,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:28,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:28,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:28,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:28,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:28,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:28,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:28,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:28,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:29,894 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:44:30,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:30,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:30,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:30,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:30,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:30,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:30,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:30,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:30,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:30,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:30,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:30,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:30,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:30,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:30,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:30,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:33,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:44:34,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:34,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:34,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:34,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:34,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:34,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:34,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:34,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:34,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:34,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:34,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:34,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:34,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:34,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:34,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:34,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:37,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:44:37,321 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:44:37,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:44:41,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:44:43,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:43,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:43,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:43,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:43,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:43,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:43,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:43,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:43,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:43,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:43,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:43,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:43,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:43,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:43,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:43,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:43,900 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:44:45,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:45,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:45,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:45,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:45,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:45,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:45,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:45,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:45,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:45,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:45,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:45,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:45,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:45,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:45,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:45,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:46,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:46,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:46,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:46,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:46,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:46,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:46,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:46,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:46,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:46,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:46,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:46,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:46,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:46,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:46,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:46,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:46,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:46,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:46,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:46,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:46,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:46,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:46,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:46,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:46,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:46,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:46,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:46,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:46,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:46,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:46,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:46,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:47,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:47,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:47,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:47,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:47,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:47,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:47,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:47,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:47,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:47,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:47,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:47,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:47,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:47,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:47,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:47,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:47,902 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:44:48,062 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:44:48,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:48,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:48,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:48,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:48,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:48,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:48,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:48,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:48,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:48,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:48,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:48,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:48,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:48,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:48,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:48,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:49,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:44:52,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:44:52,707 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:44:52,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:52,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:44:53,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:44:55,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:44:59,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:45:01,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:45:03,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:45:07,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:07,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:07,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:07,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:07,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:07,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:07,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:07,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:07,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:07,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:07,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:07,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:07,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:07,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:07,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:07,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:07,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:45:08,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:45:08,058 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:45:08,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:08,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:08,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:08,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:08,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:08,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:08,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:08,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:08,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:08,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:08,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:08,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:08,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:08,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:08,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:08,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:09,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:09,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:09,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:09,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:09,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:09,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:09,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:09,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:09,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:09,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:09,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:09,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:09,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:09,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:09,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:09,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:09,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:45:11,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:45:13,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:13,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:13,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:13,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:13,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:13,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:13,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:13,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:13,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:13,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:13,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:13,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:13,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:13,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:13,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:13,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:13,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:45:14,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:14,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:14,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:14,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:14,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:14,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:14,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:14,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:14,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:14,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:14,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:14,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:14,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:14,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:14,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:14,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:15,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:45:18,138 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:45:18,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:18,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:18,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:18,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:18,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:18,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:18,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:18,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:18,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:18,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:18,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:18,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:18,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:18,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:18,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:18,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:18,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:18,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:18,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:18,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:18,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:18,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:18,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:18,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:18,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:18,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:18,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:18,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:18,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:18,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:18,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:18,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:19,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:19,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:19,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:19,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:19,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:19,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:19,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:19,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:19,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:19,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:19,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:19,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:19,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:19,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:19,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:19,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:19,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:19,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:19,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:19,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:19,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:19,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:19,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:19,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:19,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:19,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:19,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:19,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:19,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:19,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:19,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:19,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:19,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:45:21,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:21,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:21,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:21,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:21,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:21,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:21,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:21,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:21,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:21,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:21,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:21,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:21,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:21,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:21,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:21,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:21,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:21,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:21,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:21,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:21,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:21,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:21,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:21,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:21,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:21,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:21,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:21,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:21,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:21,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:21,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:21,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:21,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:45:22,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:22,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:22,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:22,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:22,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:22,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:22,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:22,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:22,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:22,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:22,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:22,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:22,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:22,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:22,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:22,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:23,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:45:23,283 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:45:23,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:23,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:23,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:23,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:23,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:23,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:23,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:23,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:23,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:23,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:23,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:23,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:23,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:23,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:23,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:23,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:23,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:23,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:23,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:23,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:23,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:23,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:23,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:23,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:23,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:23,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:23,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:23,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:23,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:23,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:23,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:23,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:23,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:45:25,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:25,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:25,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:25,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:25,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:25,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:25,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:25,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:25,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:25,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:25,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:25,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:25,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:25,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:25,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:25,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:25,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:45:27,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:45:28,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:28,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:28,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:28,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:28,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:28,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:28,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:28,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:28,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:28,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:28,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:28,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:28,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:28,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:28,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:28,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:29,921 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:45:30,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:30,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:30,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:30,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:30,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:30,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:30,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:30,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:30,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:30,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:30,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:30,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:30,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:30,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:30,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:30,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:31,922 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:45:33,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:45:35,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:45:37,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:37,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:37,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:37,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:37,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:37,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:37,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:37,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:37,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:37,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:37,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:37,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:37,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:37,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:37,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:37,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:37,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:45:38,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:45:38,506 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:45:38,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:38,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:38,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:38,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:38,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:38,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:38,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:38,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:38,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:38,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:38,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:38,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:38,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:38,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:38,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:38,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:39,925 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:45:41,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:41,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:41,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:41,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:41,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:41,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:41,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:41,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:41,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:41,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:41,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:41,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:41,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:41,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:41,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:41,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:41,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:45:43,927 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:45:45,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:45:47,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:47,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:47,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:47,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:47,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:47,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:47,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:47,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:47,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:47,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:47,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:47,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:47,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:47,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:47,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:47,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:47,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:45:48,213 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:45:49,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:45:50,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:50,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:50,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:50,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:50,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:50,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:50,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:50,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:50,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:50,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:50,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:50,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:50,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:50,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:50,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:50,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:51,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:51,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:51,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:51,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:51,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:51,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:51,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:51,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:51,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:51,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:51,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:51,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:51,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:51,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:51,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:51,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:51,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:45:52,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:52,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:52,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:52,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:52,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:52,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:52,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:52,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:52,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:52,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:52,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:52,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:52,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:52,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:52,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:52,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:53,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:45:53,771 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:45:53,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:45:55,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:55,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:55,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:55,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:55,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:55,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:55,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:55,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:55,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:55,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:55,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:55,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:55,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:55,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:55,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:55,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:55,932 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:45:56,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:56,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:56,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:56,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:56,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:56,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:56,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:56,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:56,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:56,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:56,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:56,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:56,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:56,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:56,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:56,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:56,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:56,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:56,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:56,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:56,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:56,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:56,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:56,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:56,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:56,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:56,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:56,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:56,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:56,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:56,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:56,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:57,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:45:58,005 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 07:45:58,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:45:58,228 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 07:45:58,302 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 07:45:58,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 07:45:59,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:46:02,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:02,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:02,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:02,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:02,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:02,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:02,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:02,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:02,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:02,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:02,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:02,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:02,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:02,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:02,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:02,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:02,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:02,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:02,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:02,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:02,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:02,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:02,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:02,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:02,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:02,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:02,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:02,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:02,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:02,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:02,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:02,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:07,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:46:09,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:46:09,070 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:46:12,001 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:46:15,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:15,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:15,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:15,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:15,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:15,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:15,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:15,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:15,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:15,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:15,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:15,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:15,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:15,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:15,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:15,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:18,354 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:46:19,004 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:46:19,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:19,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:19,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:19,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:19,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:19,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:19,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:19,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:19,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:19,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:19,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:19,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:19,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:19,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:19,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:19,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:19,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:19,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:19,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:19,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:19,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:19,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:19,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:19,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:19,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:19,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:19,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:19,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:19,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:19,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:19,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:19,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:21,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:46:24,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:46:24,501 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:46:25,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:46:29,008 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:46:30,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:30,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:30,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:30,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:30,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:30,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:30,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:30,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:30,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:30,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:30,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:30,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:30,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:30,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:30,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:30,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:32,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:32,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:32,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:32,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:32,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:32,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:32,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:32,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:32,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:32,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:32,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:32,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:32,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:32,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:32,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:32,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:33,009 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:46:36,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:36,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:36,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:36,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:36,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:36,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:36,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:36,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:36,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:36,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:36,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:36,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:36,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:36,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:36,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:36,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:37,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:46:37,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:37,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:37,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:37,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:37,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:37,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:37,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:37,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:37,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:37,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:37,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:37,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:37,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:37,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:37,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:37,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:39,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:39,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:39,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:39,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:39,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:39,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:39,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:39,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:39,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:39,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:39,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:39,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:39,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:39,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:39,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:39,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:39,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:46:39,855 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:46:41,012 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:46:43,013 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:46:47,015 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:46:48,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:48,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:48,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:48,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:48,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:48,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:48,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:48,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:48,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:48,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:48,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:48,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:48,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:48,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:48,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:48,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:48,429 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:46:49,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:46:49,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:49,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:49,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:49,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:49,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:49,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:49,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:49,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:49,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:49,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:49,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:49,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:49,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:49,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:49,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:49,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:49,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:49,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:49,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:49,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:49,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:49,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:49,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:49,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:49,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:49,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:49,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:49,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:49,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:49,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:49,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:49,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:51,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:51,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:51,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:51,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:51,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:51,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:51,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:51,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:51,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:51,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:51,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:51,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:51,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:51,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:51,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:51,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:51,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:51,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:51,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:51,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:51,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:51,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:51,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:51,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:51,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:51,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:51,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:51,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:51,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:51,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:51,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:51,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:53,017 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:46:55,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:46:55,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:46:55,146 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:46:57,019 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:46:57,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:57,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:59,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:59,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:59,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:59,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:59,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:59,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:59,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:59,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:59,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:59,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:59,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:59,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:59,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:59,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:59,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:46:59,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:01,021 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:47:03,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:47:05,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:47:08,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:08,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:08,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:08,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:08,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:08,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:08,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:08,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:08,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:08,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:08,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:08,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:08,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:08,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:08,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:08,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:09,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:47:10,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:47:10,537 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:47:11,025 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:47:12,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:12,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:12,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:12,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:12,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:12,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:12,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:12,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:12,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:12,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:12,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:12,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:12,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:12,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:12,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:12,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:13,025 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:47:15,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:47:16,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:16,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:16,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:16,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:16,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:16,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:16,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:16,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:16,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:16,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:16,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:16,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:16,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:16,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:16,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:16,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:17,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:47:17,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:17,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:17,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:17,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:17,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:17,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:17,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:17,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:17,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:17,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:17,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:17,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:17,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:17,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:17,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:17,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:18,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:18,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:18,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:18,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:18,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:18,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:18,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:18,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:18,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:18,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:18,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:18,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:18,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:18,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:18,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:18,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:18,505 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:47:19,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:47:20,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:20,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:20,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:20,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:20,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:20,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:20,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:20,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:20,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:20,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:20,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:20,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:20,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:20,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:20,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:20,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:20,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:20,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:20,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:20,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:20,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:20,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:20,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:20,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:20,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:20,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:20,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:20,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:20,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:20,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:20,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:20,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:21,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:21,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:21,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:21,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:21,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:21,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:21,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:21,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:21,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:21,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:21,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:21,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:21,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:21,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:21,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:21,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:21,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:21,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:21,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:21,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:21,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:21,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:21,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:21,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:21,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:21,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:21,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:21,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:21,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:21,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:21,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:21,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:23,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:47:23,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:23,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:23,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:23,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:23,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:23,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:23,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:23,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:23,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:23,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:23,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:23,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:23,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:23,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:23,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:23,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:25,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:25,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:25,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:25,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:25,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:25,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:25,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:25,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:25,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:25,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:25,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:25,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:25,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:25,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:25,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:25,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:25,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:47:25,770 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:47:26,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:47:27,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:27,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:27,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:27,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:27,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:27,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:27,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:27,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:27,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:27,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:27,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:27,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:27,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:27,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:27,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:27,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:27,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:27,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:27,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:27,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:27,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:27,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:27,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:27,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:27,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:27,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:27,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:27,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:27,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:27,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:27,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:27,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:28,031 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:47:28,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:28,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:28,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:28,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:28,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:28,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:28,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:28,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:28,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:28,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:28,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:28,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:28,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:28,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:28,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:28,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:29,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:29,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:29,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:29,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:29,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:29,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:29,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:29,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:29,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:29,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:29,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:29,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:29,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:29,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:29,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:29,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:30,031 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:47:31,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:31,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:31,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:31,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:31,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:31,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:31,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:31,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:31,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:31,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:31,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:31,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:31,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:31,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:31,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:31,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:32,032 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:47:34,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:47:36,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:36,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:36,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:36,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:36,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:36,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:36,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:36,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:36,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:36,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:36,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:36,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:36,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:36,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:36,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:36,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:36,034 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:47:38,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:47:40,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:47:40,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:40,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:40,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:40,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:40,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:40,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:40,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:40,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:40,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:40,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:40,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:40,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:40,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:40,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:40,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:40,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:40,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:47:40,996 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:47:41,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:41,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:41,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:41,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:41,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:41,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:41,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:41,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:41,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:41,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:41,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:41,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:41,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:41,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:41,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:41,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:42,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:47:43,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:43,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:43,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:43,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:43,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:43,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:43,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:43,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:43,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:43,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:43,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:43,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:43,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:43,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:43,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:43,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:44,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:47:46,038 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:47:48,038 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:47:48,580 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:47:50,039 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:47:52,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:47:52,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:52,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:52,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:52,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:52,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:52,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:52,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:52,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:52,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:52,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:52,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:52,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:52,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:52,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:52,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:52,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:52,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:52,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:52,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:52,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:52,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:52,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:52,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:52,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:52,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:52,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:52,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:52,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:52,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:52,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:52,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:52,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:53,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:53,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:53,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:53,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:53,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:53,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:53,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:53,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:53,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:53,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:53,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:53,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:53,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:53,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:53,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:53,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:54,041 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:47:55,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:55,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:55,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:55,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:55,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:55,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:55,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:55,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:55,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:55,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:55,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:55,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:55,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:55,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:55,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:55,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:56,042 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:47:56,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:47:56,231 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:47:57,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:57,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:57,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:57,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:57,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:57,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:57,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:57,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:57,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:57,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:57,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:57,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:57,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:57,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:57,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:57,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:57,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:57,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:57,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:57,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:57,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:57,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:57,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:57,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:57,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:57,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:57,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:57,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:47:58,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:48:00,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:48:03,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:03,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:03,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:03,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:03,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:03,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:03,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:03,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:03,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:03,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:03,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:03,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:03,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:03,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:03,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:03,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:08,047 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:48:09,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:09,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:09,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:09,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:09,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:09,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:09,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:09,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:09,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:09,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:09,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:09,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:09,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:09,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:09,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:09,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:11,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:48:11,454 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:48:13,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:13,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:13,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:13,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:13,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:13,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:13,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:13,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:13,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:13,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:13,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:13,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:13,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:13,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:13,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:13,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:14,049 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:48:16,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:16,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:16,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:16,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:16,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:16,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:16,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:16,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:16,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:16,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:16,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:16,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:16,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:16,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:16,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:16,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:16,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:16,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:16,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:16,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:16,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:16,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:16,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:16,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:16,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:16,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:16,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:16,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:16,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:16,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:16,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:16,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:18,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:48:18,655 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:48:20,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:20,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:20,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:20,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:20,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:20,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:20,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:20,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:20,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:20,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:20,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:20,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:20,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:20,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:20,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:20,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:22,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:48:22,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:22,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:22,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:22,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:22,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:22,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:22,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:22,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:22,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:22,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:22,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:22,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:22,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:22,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:22,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:22,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:26,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:48:26,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:48:26,708 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:48:27,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:27,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:27,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:27,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:27,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:27,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:27,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:27,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:27,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:27,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:27,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:27,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:27,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:27,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:27,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:27,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:30,056 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:48:31,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:31,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:31,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:31,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:31,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:31,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:31,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:31,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:31,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:31,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:31,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:31,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:31,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:31,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:31,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:31,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:34,059 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:48:36,060 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:48:36,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:36,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:36,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:36,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:36,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:36,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:36,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:36,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:36,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:36,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:36,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:36,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:36,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:36,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:36,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:36,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:39,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:39,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:39,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:39,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:39,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:39,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:39,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:39,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:39,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:39,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:39,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:39,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:39,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:39,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:39,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:39,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:39,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:39,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:39,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:39,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:39,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:39,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:39,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:39,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:39,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:39,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:39,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:39,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:39,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:39,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:39,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:39,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:40,061 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:48:42,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:48:42,013 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:48:42,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:42,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:42,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:42,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:42,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:42,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:42,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:42,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:42,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:42,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:42,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:42,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:42,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:42,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:42,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:42,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:44,063 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:48:46,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:48:48,728 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:48:50,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:48:52,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:48:52,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:52,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:52,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:52,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:52,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:52,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:52,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:52,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:52,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:52,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:52,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:52,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:52,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:52,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:52,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:52,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:52,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:52,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:52,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:52,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:52,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:52,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:52,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:52,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:53,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:53,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:53,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:53,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:53,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:53,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:53,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:53,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:54,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:48:54,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:54,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:54,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:54,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:54,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:54,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:54,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:54,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:54,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:54,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:54,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:54,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:54,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:54,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:54,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:54,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:54,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:54,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:54,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:54,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:54,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:54,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:54,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:54,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:54,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:54,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:54,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:54,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:54,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:54,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:54,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:54,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:56,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:56,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:56,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:56,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:56,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:56,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:56,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:56,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:56,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:56,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:56,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:56,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:56,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:56,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:56,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:56,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:57,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:48:57,268 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:48:58,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:48:59,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:59,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:59,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:59,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:59,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:59,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:59,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:59,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:59,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:59,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:59,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:59,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:59,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:59,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:59,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:48:59,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:00,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:49:01,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:01,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:01,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:01,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:01,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:01,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:01,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:01,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:01,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:01,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:01,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:01,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:01,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:01,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:01,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:01,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:02,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:49:03,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:03,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:03,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:03,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:03,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:03,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:03,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:03,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:03,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:03,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:03,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:03,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:03,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:03,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:03,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:03,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:04,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:04,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:04,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:04,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:04,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:04,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:04,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:04,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:04,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:04,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:04,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:04,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:04,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:04,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:04,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:04,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:06,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:06,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:06,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:06,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:06,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:06,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:06,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:06,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:06,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:06,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:06,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:06,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:06,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:06,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:06,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:06,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:06,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:49:08,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:49:10,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:49:12,074 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:49:12,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:49:12,588 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:49:14,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:49:14,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:14,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:14,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:14,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:14,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:14,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:14,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:14,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:14,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:14,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:14,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:14,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:14,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:14,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:14,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:14,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:16,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:49:17,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:17,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:17,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:17,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:17,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:17,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:17,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:17,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:17,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:17,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:17,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:17,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:17,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:17,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:17,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:17,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:18,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:18,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:18,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:18,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:18,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:18,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:18,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:18,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:18,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:18,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:18,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:18,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:18,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:18,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:18,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:18,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:18,803 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:49:20,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:49:20,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:20,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:20,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:20,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:20,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:20,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:20,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:20,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:20,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:20,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:20,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:20,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:20,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:20,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:20,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:20,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:22,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:49:22,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:22,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:22,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:22,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:22,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:22,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:22,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:22,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:22,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:22,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:22,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:22,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:22,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:22,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:22,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:22,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:23,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:23,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:23,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:23,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:23,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:23,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:23,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:23,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:23,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:23,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:23,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:23,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:23,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:23,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:23,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:23,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:24,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:49:25,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:25,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:25,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:25,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:25,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:25,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:25,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:25,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:25,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:25,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:25,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:25,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:25,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:25,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:25,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:25,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:25,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:25,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:25,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:25,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:25,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:25,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:25,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:25,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:25,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:25,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:25,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:25,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:25,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:25,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:25,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:25,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:26,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:49:27,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:49:27,815 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:49:28,081 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:49:29,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:29,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:29,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:29,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:29,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:29,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:29,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:29,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:29,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:29,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:29,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:29,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:29,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:29,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:29,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:29,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:29,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:29,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:29,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:29,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:29,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:29,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:29,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:29,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:29,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:29,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:29,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:29,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:29,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:29,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:29,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:29,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:30,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:49:30,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:30,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:30,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:30,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:30,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:30,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:30,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:30,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:30,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:30,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:30,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:30,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:30,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:30,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:30,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:30,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:31,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:31,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:31,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:31,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:31,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:31,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:31,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:31,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:31,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:31,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:31,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:31,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:31,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:31,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:31,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:31,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:32,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:32,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:32,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:32,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:32,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:32,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:32,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:32,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:32,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:32,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:32,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:32,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:32,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:32,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:32,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:32,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:32,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:32,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:32,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:32,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:32,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:32,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:32,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:32,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:32,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:32,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:32,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:32,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:32,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:32,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:32,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:32,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:33,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:49:34,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:34,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:34,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:34,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:34,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:34,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:34,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:34,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:34,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:34,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:34,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:34,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:34,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:34,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:34,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:34,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:35,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:49:35,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:35,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:35,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:35,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:35,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:35,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:35,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:35,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:35,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:35,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:35,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:35,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:35,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:35,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:35,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:35,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:37,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:49:38,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:38,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:38,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:38,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:38,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:38,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:38,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:38,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:38,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:38,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:38,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:38,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:38,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:38,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:38,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:38,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:39,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:49:41,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:49:42,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:42,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:42,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:42,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:42,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:42,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:42,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:42,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:42,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:42,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:42,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:42,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:42,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:42,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:42,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:42,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:43,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:49:43,042 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:49:43,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:49:43,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:43,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:43,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:43,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:43,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:43,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:43,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:43,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:43,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:43,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:43,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:43,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:43,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:43,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:43,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:43,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:44,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:44,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:44,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:44,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:44,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:44,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:44,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:44,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:44,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:44,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:44,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:44,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:44,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:44,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:44,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:44,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:45,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:49:47,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:49:48,879 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:49:49,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:49:51,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:49:52,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:52,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:53,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:49:55,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:49:55,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:55,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:55,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:55,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:55,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:55,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:55,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:55,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:55,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:55,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:55,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:55,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:55,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:55,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:55,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:55,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:55,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:55,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:55,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:55,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:56,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:56,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:56,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:56,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:56,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:56,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:56,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:56,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:56,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 07:49:56,392 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 07:49:56,607 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 07:49:56,684 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 07:49:57,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 07:49:57,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:49:58,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:49:58,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:49:58,318 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:49:59,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:50:01,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:50:03,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:50:05,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:50:07,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:50:09,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:50:11,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:50:13,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:50:13,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:50:13,698 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:50:15,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:50:17,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:50:19,041 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:50:19,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:50:21,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:50:23,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:50:25,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:50:27,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:50:28,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:50:28,921 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:50:29,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:50:31,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:50:33,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:50:35,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:50:37,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:50:39,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:50:41,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:50:43,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:50:44,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:50:44,138 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:50:45,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:50:47,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:50:49,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:50:49,117 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:50:51,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:50:53,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:50:55,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:50:57,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:50:59,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:50:59,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:50:59,372 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:51:01,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:51:03,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:51:05,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:51:07,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:51:09,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:51:11,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:51:13,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:51:14,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:51:14,595 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:51:15,121 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:51:17,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:51:19,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:51:19,179 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:51:21,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:51:23,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:51:25,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:51:27,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:51:29,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:51:29,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:51:29,908 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:51:31,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:51:33,128 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:51:35,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:51:37,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:51:39,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:51:41,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:51:44,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:51:45,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:51:45,128 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:51:46,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:51:48,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:51:49,252 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:51:50,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:51:52,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:51:54,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:51:56,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:51:58,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:52:00,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:52:00,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:52:00,354 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:52:02,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:52:04,140 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:52:06,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:52:08,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:52:10,142 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:52:12,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:52:14,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:52:15,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:52:15,702 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:52:16,145 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:52:18,146 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:52:19,325 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:52:20,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:52:22,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:52:24,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:52:26,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:52:28,150 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:52:30,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:52:30,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:52:30,927 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:52:32,152 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:52:34,153 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:52:36,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:52:38,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:52:41,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:52:43,157 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:52:45,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:52:46,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:52:46,159 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:52:47,164 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:52:49,165 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:52:49,393 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:52:51,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:52:53,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:52:55,168 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:52:57,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:52:59,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:53:01,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:53:01,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:53:01,488 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:53:03,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:53:05,172 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:53:07,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:53:09,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:53:11,175 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:53:13,176 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:53:15,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:53:16,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:53:16,737 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:53:17,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:53:19,179 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:53:19,470 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:53:21,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:53:23,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:53:25,182 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:53:27,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:53:29,184 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:53:31,185 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:53:32,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:53:32,082 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:53:33,186 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:53:35,187 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:53:37,188 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:53:39,189 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:53:41,189 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:53:43,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:53:45,191 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:53:47,192 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:53:47,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:53:47,402 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:53:49,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:53:49,545 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:53:51,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:53:53,194 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:53:55,195 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:53:57,196 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:53:59,196 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:54:01,197 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:54:02,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:54:02,744 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:54:03,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:54:05,199 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:54:07,200 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:54:09,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:54:11,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:54:13,202 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:54:15,203 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:54:18,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:54:18,055 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:54:18,204 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:54:19,617 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:54:20,205 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:54:22,206 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:54:24,207 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:54:26,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:54:28,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:54:30,209 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:54:32,210 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:54:33,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:54:33,360 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:54:34,211 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:54:36,212 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:54:38,213 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:54:40,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:54:42,215 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:54:44,216 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:54:46,217 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:54:48,218 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:54:48,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:54:48,584 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:54:49,697 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:54:50,219 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:54:52,220 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:54:54,221 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:54:56,222 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:54:58,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:55:00,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:55:02,224 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:55:03,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:55:03,917 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:55:04,225 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:55:06,226 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:55:08,227 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:55:10,228 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:55:12,229 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:55:14,229 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:55:16,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:55:18,231 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:55:19,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:55:19,157 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:55:19,753 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:55:20,232 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:55:22,233 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:55:24,233 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:55:26,234 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:55:28,235 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:55:30,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:55:32,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:55:34,237 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:55:34,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:55:34,395 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:55:36,238 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:55:38,239 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:55:40,239 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:55:42,240 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:55:44,240 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:55:47,241 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:55:49,242 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:55:49,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:55:49,783 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:55:50,009 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:55:51,243 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:55:53,244 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:55:55,245 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:55:57,246 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:55:59,247 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:56:01,247 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:56:03,248 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:56:05,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:56:05,011 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:56:05,249 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:56:07,249 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:56:09,250 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:56:11,251 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:56:13,252 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:56:15,252 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:56:17,253 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:56:19,254 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:56:19,895 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:56:20,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:56:20,240 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:56:21,255 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:56:23,255 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:56:25,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:56:27,257 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:56:29,258 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:56:31,259 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:56:33,260 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:56:35,260 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:56:35,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:56:35,460 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:56:37,261 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:56:39,262 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:56:41,263 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:56:43,264 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:56:45,264 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:56:47,265 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:56:49,969 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:56:50,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:56:50,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:56:50,779 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:56:52,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:56:54,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:56:56,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:56:58,270 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:57:00,271 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:57:02,272 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:57:04,273 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:57:06,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:57:06,007 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:57:06,274 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:57:08,275 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:57:10,275 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:57:12,276 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:57:14,277 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:57:16,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:57:18,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:57:20,053 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:57:20,279 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:57:21,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:57:21,308 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:57:22,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:57:24,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:57:26,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:57:28,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:57:30,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:57:32,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:57:34,285 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:57:36,286 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:57:36,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:57:36,705 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:57:38,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:57:40,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:57:42,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:57:44,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:57:46,290 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:57:48,290 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:57:50,127 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:57:50,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:57:51,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:57:51,990 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:57:52,292 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:57:54,292 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:57:56,293 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:57:58,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:58:00,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:58:02,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:58:04,296 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:58:06,297 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:58:07,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:58:07,226 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:58:08,298 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:58:10,299 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:58:12,299 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:58:14,300 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:58:16,301 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:58:18,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:58:20,205 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:58:20,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:58:22,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:58:22,578 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:58:23,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:58:25,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:58:27,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:58:29,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:58:31,306 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:58:33,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:58:35,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:58:37,308 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:58:37,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:58:37,802 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:58:39,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:58:41,310 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:58:43,310 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:58:45,311 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:58:47,311 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:58:49,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:58:50,279 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:58:51,313 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:58:53,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:58:53,026 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:58:53,313 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:58:55,314 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:58:57,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:58:59,316 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:59:01,316 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:59:03,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:59:05,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:59:07,318 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:59:08,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:59:08,366 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:59:09,319 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:59:11,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:59:13,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:59:15,321 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:59:17,322 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:59:19,322 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:59:20,352 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:59:21,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:59:23,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:59:23,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:59:23,626 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:59:25,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:59:27,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:59:29,326 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:59:31,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:59:33,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:59:35,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:59:37,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:59:38,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:59:38,854 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:59:39,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:59:41,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:59:44,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:59:46,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:59:48,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:59:50,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:59:50,427 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 07:59:52,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:59:54,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 07:59:54,127 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 07:59:54,335 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:59:56,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 07:59:58,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:00:00,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:00:02,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:00:04,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:00:06,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:00:08,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:00:09,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:00:09,350 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:00:10,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:00:12,342 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:00:14,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:00:16,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:00:18,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:00:20,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:00:20,512 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:00:22,346 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:00:24,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:00:24,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:00:24,578 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:00:26,348 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:00:28,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:00:30,350 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:00:32,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:00:34,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:00:36,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:00:38,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:00:39,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:00:39,806 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:00:40,354 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:00:42,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:00:44,356 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:00:46,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:00:48,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:00:50,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:00:50,582 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:00:52,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:00:54,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:00:55,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:00:55,033 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:00:56,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:00:58,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:01:00,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:01:02,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:01:04,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:01:06,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:01:08,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:01:10,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:01:10,262 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:01:10,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:01:13,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:01:15,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:01:17,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:01:19,371 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:01:20,657 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:01:21,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:01:23,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:01:25,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:01:25,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:01:25,546 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:01:27,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:01:29,376 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:01:31,377 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:01:33,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:01:35,379 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:01:37,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:01:39,381 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:01:40,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:01:40,848 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:01:41,382 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:01:43,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:01:45,384 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:01:47,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:01:49,386 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:01:50,731 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:01:51,387 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:01:53,388 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:01:55,389 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:01:56,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:01:56,077 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:01:57,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:01:59,391 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:02:01,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:02:03,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:02:05,393 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:02:07,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:02:09,395 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:02:11,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:02:11,393 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:02:11,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:02:13,399 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:02:15,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:02:17,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:02:19,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:02:20,804 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:02:21,402 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:02:23,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:02:25,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:02:26,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:02:26,696 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:02:27,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:02:29,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:02:31,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:02:33,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:02:35,406 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:02:37,407 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:02:39,407 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:02:41,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:02:41,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:02:41,924 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:02:43,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:02:45,409 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:02:47,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:02:49,411 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:02:50,879 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:02:52,412 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:02:54,413 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:02:56,414 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:02:57,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:02:57,193 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:02:58,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:03:00,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:03:02,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:03:04,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:03:06,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:03:08,419 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:03:10,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:03:12,421 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:03:12,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:03:12,437 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:03:14,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:03:16,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:03:18,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:03:20,425 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:03:20,947 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:03:22,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:03:24,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:03:26,427 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:03:27,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:03:27,827 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:03:28,428 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:03:30,429 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:03:32,430 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:03:34,431 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:03:36,431 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:03:38,432 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:03:40,433 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:03:42,434 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:03:43,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:03:43,071 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:03:44,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:03:46,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:03:48,436 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:03:50,437 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:03:51,023 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:03:52,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:03:54,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:03:56,439 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:03:58,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:03:58,428 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:03:58,440 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:04:00,441 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:04:02,441 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:04:04,442 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:04:06,443 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:04:08,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:04:10,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:04:12,445 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:04:13,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:04:13,738 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:04:14,446 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:04:17,447 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:04:19,448 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:04:21,097 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:04:21,449 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:04:23,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:04:25,451 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:04:27,452 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:04:29,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:04:29,014 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:04:29,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:04:31,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:04:33,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:04:35,455 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:04:37,456 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:04:39,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:04:41,458 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:04:43,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:04:44,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:04:44,334 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:04:45,460 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:04:47,461 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:04:49,462 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:04:51,175 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:04:51,463 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:04:53,463 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:04:55,464 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:04:57,465 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:04:59,466 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:04:59,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:04:59,644 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:05:01,467 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:05:03,468 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:05:05,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:05:07,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:05:09,470 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:05:11,471 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:05:13,472 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:05:14,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:05:14,870 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:05:15,473 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:05:17,474 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:05:19,474 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:05:21,250 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:05:21,475 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:05:23,476 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:05:25,477 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:05:27,478 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:05:29,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:05:30,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:05:30,328 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:05:31,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:05:33,480 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:05:36,481 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:05:38,482 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:05:40,483 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:05:42,484 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:05:44,485 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:05:45,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:05:45,555 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:05:46,485 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:05:48,486 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:05:50,487 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:05:51,325 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:05:52,488 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:05:54,489 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:05:56,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:05:58,491 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:06:00,492 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:06:00,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:06:00,952 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:06:02,492 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:06:04,494 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:06:06,494 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:06:08,496 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:06:10,496 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:06:12,497 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:06:14,498 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:06:16,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:06:16,174 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:06:16,499 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:06:18,500 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:06:20,501 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:06:21,398 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:06:22,502 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:06:24,503 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:06:26,504 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:06:28,505 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:06:30,505 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:06:31,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:06:31,529 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:06:32,506 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:06:34,507 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:06:36,508 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:06:38,508 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:06:40,509 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:06:42,510 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:06:44,511 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:06:46,512 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:06:46,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:06:46,811 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:06:48,513 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:06:50,513 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:06:51,467 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:06:52,514 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:06:54,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:06:56,516 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:06:58,517 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:07:01,518 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:07:02,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:07:02,180 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:07:03,519 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:07:05,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:07:07,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:07:09,521 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:07:11,521 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:07:13,522 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:07:15,523 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:07:17,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:07:17,490 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:07:17,524 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:07:19,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:07:21,526 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:07:21,539 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:07:23,526 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:07:25,527 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:07:27,528 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:07:29,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:07:31,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:07:33,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:07:33,223 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:07:33,530 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:07:35,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:07:37,532 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:07:39,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:07:41,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:07:43,534 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:07:45,535 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:07:47,536 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:07:48,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:07:48,521 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:07:49,537 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:07:51,537 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:07:51,612 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:07:53,538 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:07:55,539 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:07:57,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:07:59,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:08:01,541 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:08:03,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:08:03,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:08:03,853 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:08:05,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:08:07,543 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:08:09,544 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:08:11,544 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:08:13,545 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:08:15,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:08:17,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:08:19,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:08:19,078 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:08:20,547 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:08:21,683 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:08:22,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:08:24,549 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:08:26,550 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:08:28,550 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:08:30,551 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:08:32,552 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:08:34,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:08:34,303 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:08:34,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:08:36,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:08:38,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:08:40,555 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:08:42,555 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:08:44,556 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:08:46,557 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:08:48,558 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:08:49,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:08:49,687 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:08:50,559 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:08:51,759 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:08:52,559 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:08:54,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:08:56,561 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:08:58,562 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:09:00,563 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:09:02,564 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:09:04,565 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:09:04,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:09:04,947 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:09:06,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:09:08,567 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:09:10,568 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:09:12,569 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:09:14,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:09:16,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:09:18,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:09:20,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:09:20,205 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:09:20,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:09:21,835 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:09:22,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:09:24,574 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:09:26,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:09:28,576 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:09:30,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:09:32,578 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:09:34,579 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:09:35,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:09:35,542 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:09:37,580 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:09:39,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:09:41,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:09:43,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:09:45,583 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:09:47,583 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:09:49,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:09:50,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:09:50,765 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:09:51,585 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:09:51,911 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:09:53,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:09:55,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:09:57,587 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:09:59,588 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:10:01,589 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:10:03,590 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:10:05,591 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:10:06,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:10:06,069 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:10:07,591 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:10:09,592 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:10:11,593 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:10:13,594 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:10:15,595 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:10:17,596 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:10:19,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:10:21,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:10:21,409 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:10:21,598 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:10:21,977 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:10:23,599 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:10:25,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:10:27,601 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:10:29,601 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:10:31,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:10:33,603 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:10:35,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:10:36,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:10:36,738 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:10:37,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:10:39,605 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:10:41,606 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:10:43,606 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:10:45,607 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:10:47,608 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:10:49,609 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:10:51,609 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:10:52,051 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:10:52,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:10:52,154 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:10:53,610 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:10:55,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:10:57,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:10:59,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:11:01,613 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:11:03,613 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:11:05,614 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:11:07,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:11:07,380 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:11:07,615 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:11:09,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:11:11,617 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:11:13,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:11:15,619 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:11:17,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:11:19,621 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:11:22,128 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:11:22,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:11:22,605 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:11:22,622 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:11:24,623 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:11:26,624 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:11:28,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:11:30,626 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:11:32,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:11:34,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:11:36,629 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:11:37,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:11:37,827 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:11:38,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:11:40,631 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:11:42,632 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:11:44,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:11:46,634 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:11:48,635 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:11:50,636 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:11:52,205 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:11:52,637 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:11:53,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:11:53,152 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:11:54,638 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:11:56,638 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:11:58,639 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:12:00,640 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:12:02,640 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:12:04,641 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:12:06,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:12:08,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:12:08,378 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:12:08,643 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:12:10,644 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:12:12,645 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:12:14,645 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:12:16,646 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:12:18,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:12:20,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:12:22,278 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:12:22,648 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:12:23,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:12:23,729 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:12:24,649 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:12:26,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:12:28,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:12:30,651 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:12:32,652 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:12:34,652 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:12:36,653 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:12:38,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:12:38,980 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:12:39,654 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:12:41,655 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:12:43,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:12:45,657 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:12:47,658 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:12:49,658 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:12:51,659 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:12:52,355 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:12:53,660 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:12:54,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:12:54,277 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:12:55,661 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:12:57,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:12:59,663 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:13:01,664 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:13:03,665 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:13:05,666 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:13:07,667 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:13:09,668 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:13:09,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:13:09,770 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:13:11,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:13:13,670 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:13:15,671 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:13:17,672 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:13:19,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:13:21,674 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:13:22,430 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:13:23,674 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:13:25,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:13:25,062 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:13:25,675 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:13:27,676 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:13:29,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:13:31,678 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:13:33,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:13:35,680 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:13:37,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:13:39,682 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:13:40,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:13:40,379 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:13:41,683 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:13:43,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:13:45,685 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:13:47,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:13:49,687 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:13:51,687 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:13:52,506 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:13:53,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:13:55,689 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:13:55,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:13:55,714 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:13:57,690 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:13:59,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:14:01,692 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:14:03,693 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:14:05,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:14:07,695 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:14:09,696 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:14:11,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:14:11,295 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:14:11,697 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:14:14,698 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:14:16,699 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:14:18,700 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:14:20,701 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:14:22,582 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:14:22,702 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:14:24,703 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:14:26,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:14:26,516 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:14:26,704 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:14:28,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:14:30,706 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:14:32,707 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:14:34,708 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:14:36,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:14:38,710 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:14:40,711 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:14:41,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:14:41,743 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:14:42,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:14:44,713 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:14:46,713 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:14:48,714 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:14:50,715 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:14:52,658 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:14:52,716 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:14:54,717 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:14:56,717 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:14:57,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:14:57,110 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:14:58,718 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:15:00,719 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:15:02,720 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:15:04,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:15:06,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:15:08,722 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:15:10,723 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:15:12,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:15:12,429 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:15:12,724 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:15:14,725 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:15:16,726 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:15:18,726 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:15:20,727 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:15:22,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:15:22,732 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:15:24,729 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:15:27,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:15:27,655 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:15:27,730 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:15:29,731 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:15:31,731 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:15:33,732 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:15:35,733 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:15:37,734 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:15:39,735 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:15:41,735 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:15:42,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:15:42,969 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:15:43,736 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:15:45,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:15:47,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:15:49,738 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:15:51,739 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:15:52,808 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:15:53,740 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:15:55,740 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:15:57,741 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:15:58,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:15:58,269 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:15:59,742 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:16:01,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:16:03,744 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:16:05,745 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:16:07,745 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:16:09,746 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:16:11,747 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:16:13,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:16:13,568 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:16:13,748 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:16:15,749 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:16:17,749 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:16:19,750 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:16:21,751 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:16:22,883 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:16:23,752 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:16:25,753 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:16:27,754 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:16:28,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:16:28,872 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:16:29,754 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:16:31,755 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:16:33,756 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:16:35,757 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:16:37,758 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:16:39,758 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:16:41,759 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:16:43,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:16:44,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:16:44,112 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:16:45,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:16:47,761 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:16:49,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:16:51,763 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:16:52,957 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:16:53,764 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:16:55,764 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:16:57,765 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:16:59,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:16:59,357 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:16:59,766 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:17:01,767 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:17:03,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:17:05,769 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:17:07,770 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:17:10,771 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:17:12,772 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:17:14,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:17:14,591 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:17:14,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:17:16,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:17:18,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:17:20,775 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:17:22,776 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:17:23,032 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:17:24,776 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:17:26,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:17:28,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:17:29,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:17:29,814 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:17:30,779 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:17:32,780 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:17:34,781 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:17:36,782 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:17:38,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:17:40,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:17:42,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:17:44,785 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:17:45,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:17:45,109 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:17:46,786 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:17:48,787 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:17:50,788 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:17:52,789 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:17:53,106 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:17:54,789 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:17:56,790 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:17:58,791 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:18:00,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:18:00,333 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:18:00,792 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:18:02,793 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:18:04,794 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:18:06,795 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:18:08,796 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:18:10,797 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:18:12,797 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:18:14,798 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:18:15,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:18:15,610 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:18:16,799 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:18:18,800 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:18:20,801 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:18:23,180 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:18:23,802 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:18:25,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:18:27,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:18:29,804 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:18:30,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:18:30,922 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:18:31,805 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:18:33,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:18:35,807 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:18:37,808 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:18:39,809 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:18:41,810 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:18:43,811 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:18:45,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:18:46,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:18:46,146 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:18:47,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:18:49,813 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:18:51,814 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:18:53,251 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:18:53,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:18:55,816 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:18:57,817 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:18:59,817 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:19:01,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:19:01,422 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:19:01,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:19:03,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:19:05,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:19:07,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:19:09,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:19:11,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:19:13,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:19:15,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:19:16,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:19:16,739 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:19:17,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:19:20,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:19:22,826 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:19:23,313 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:19:24,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:19:26,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:19:28,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:19:30,829 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:19:32,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:19:32,089 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:19:32,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:19:34,831 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:19:36,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:19:38,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:19:40,833 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:19:42,834 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:19:44,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:19:46,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:19:47,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:19:47,444 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:19:48,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:19:50,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:19:52,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:19:53,389 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:19:54,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:19:56,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:19:58,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:20:00,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:20:02,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:20:02,697 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:20:02,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:20:04,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:20:06,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:20:08,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:20:10,846 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:20:12,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:20:14,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:20:16,849 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:20:18,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:20:18,336 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:20:18,850 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:20:20,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:20:22,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:20:23,463 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:20:24,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:20:26,854 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:20:28,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:20:31,856 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:20:33,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:20:33,661 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:20:33,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:20:35,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:20:37,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:20:39,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:20:41,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:20:43,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:20:45,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:20:47,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:20:49,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:20:49,056 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:20:49,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:20:51,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:20:53,538 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:20:53,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:20:55,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:20:57,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:20:59,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:21:01,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:21:03,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:21:04,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:21:04,324 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:21:05,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:21:07,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:21:09,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:21:11,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:21:13,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:21:15,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:21:17,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:21:19,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:21:19,548 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:21:19,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:21:21,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:21:23,612 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:21:23,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:21:25,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:21:27,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:21:29,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:21:31,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:21:33,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:21:34,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:21:34,847 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:21:35,882 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:21:37,883 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:21:39,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:21:41,885 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:21:43,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:21:45,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:21:48,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:21:50,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:21:50,149 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:21:50,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:21:52,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:21:53,688 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:21:54,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:21:56,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:21:58,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:22:00,894 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:22:02,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:22:04,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:22:05,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:22:05,396 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:22:06,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:22:08,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:22:10,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:22:12,900 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:22:14,901 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:22:16,902 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:22:18,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:22:20,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:22:20,627 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:22:20,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:22:22,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:22:23,764 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:22:24,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:22:26,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:22:28,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:22:30,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:22:33,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:22:35,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:22:35,852 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:22:35,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:22:37,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:22:39,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:22:41,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:22:43,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:22:45,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:22:47,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:22:49,916 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:22:51,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:22:52,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:22:52,222 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:22:53,845 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:22:53,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:22:55,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:22:57,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:22:59,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:23:01,921 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:23:03,922 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:23:05,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:23:07,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:23:07,449 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:23:07,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:23:09,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:23:11,925 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:23:13,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:23:15,927 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:23:17,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:23:19,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:23:21,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:23:22,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:23:22,746 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:23:23,920 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:23:23,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:23:25,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:23:27,932 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:23:29,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:23:31,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:23:33,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:23:35,935 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:23:37,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:23:38,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:23:38,043 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:23:39,937 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:23:41,938 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:23:43,938 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:23:45,939 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:23:47,940 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:23:49,941 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:23:51,942 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:23:53,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:23:53,269 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:23:53,943 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:23:53,994 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:23:55,944 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:23:57,945 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:23:59,946 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:24:01,947 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:24:04,948 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:24:06,949 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:24:08,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:24:08,599 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:24:08,950 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:24:10,951 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:24:12,952 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:24:14,953 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:24:16,954 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:24:18,955 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:24:20,956 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:24:22,957 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:24:23,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:24:23,829 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:24:24,068 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:24:24,958 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:24:26,959 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:24:28,960 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:24:30,961 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:24:32,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:24:34,963 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:24:36,964 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:24:38,965 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:24:39,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:24:39,207 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:24:40,966 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:24:42,967 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:24:44,968 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:24:46,969 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:24:48,970 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:24:50,971 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:24:52,972 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:24:54,143 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:24:54,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:24:54,504 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:24:54,973 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:24:56,974 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:24:58,975 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:25:00,976 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:25:02,977 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:25:04,978 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:25:06,978 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:25:08,979 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:25:09,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:25:09,720 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:25:10,980 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:25:12,982 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:25:14,983 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:25:16,984 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:25:18,984 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:25:20,985 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:25:22,986 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:25:24,220 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:25:24,987 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:25:25,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:25:25,048 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:25:26,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:25:28,989 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:25:30,990 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:25:33,992 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:25:35,992 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:25:37,993 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:25:39,994 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:25:40,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:25:40,412 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:25:41,995 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:25:43,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:25:45,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:25:47,997 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:25:49,998 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:25:51,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:25:54,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:25:54,296 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:25:55,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:25:55,647 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:25:56,001 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:25:58,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:26:00,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:26:02,003 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:26:04,004 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:26:06,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:26:08,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:26:10,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:26:10,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:26:10,947 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:26:12,007 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:26:14,008 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:26:16,009 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:26:18,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:26:20,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:26:22,012 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:26:24,013 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:26:24,377 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:26:26,014 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:26:26,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:26:26,167 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:26:28,014 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:26:30,015 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:26:32,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:26:34,017 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:26:36,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:26:39,019 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:26:41,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:26:41,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:26:41,436 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:26:43,021 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:26:45,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:26:47,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:26:49,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:26:51,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:26:53,025 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:26:54,450 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:26:55,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:26:56,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:26:56,832 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:26:57,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:26:59,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:27:01,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:27:03,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:27:05,031 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:27:07,031 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:27:09,032 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:27:11,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:27:12,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:27:12,061 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:27:13,034 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:27:15,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:27:17,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:27:19,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:27:21,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:27:23,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:27:24,518 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:27:25,041 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:27:27,042 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:27:27,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:27:27,294 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:27:29,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:27:31,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:27:33,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:27:35,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:27:37,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:27:39,047 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:27:41,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:27:42,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:27:42,664 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:27:43,049 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:27:45,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:27:47,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:27:49,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:27:51,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:27:53,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:27:54,591 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:27:55,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:27:57,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:27:57,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:27:57,914 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:27:59,056 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:28:01,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:28:03,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:28:05,059 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:28:07,060 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:28:09,061 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:28:11,061 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:28:13,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:28:13,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:28:13,402 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:28:15,063 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:28:17,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:28:19,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:28:21,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:28:24,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:28:24,666 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:28:26,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:28:28,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:28:28,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:28:28,691 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:28:30,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:28:32,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:28:34,071 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:28:36,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:28:38,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:28:40,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:28:42,074 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:28:43,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:28:43,912 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:28:44,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:28:46,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:28:48,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:28:50,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:28:52,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:28:54,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:28:54,742 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:28:56,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:28:58,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:28:59,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:28:59,161 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:29:00,081 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:29:02,081 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:29:04,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:29:06,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:29:08,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:29:10,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:29:12,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:29:14,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:29:14,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:29:14,438 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:29:16,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:29:18,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:29:20,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:29:22,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:29:24,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:29:24,818 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:29:26,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:29:28,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:29:29,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:29:29,662 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:29:30,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:29:32,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:29:34,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:29:36,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:29:38,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:29:40,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:29:42,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:29:44,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:29:44,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:29:44,998 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:29:46,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:29:49,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:29:51,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:29:53,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:29:54,891 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:29:55,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:29:57,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:29:59,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:30:00,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:30:00,350 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:30:01,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:30:03,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:30:05,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:30:07,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:30:09,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:30:11,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:30:13,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:30:15,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:30:15,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:30:15,673 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:30:17,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:30:19,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:30:21,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:30:23,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:30:24,964 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:30:25,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:30:27,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:30:29,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:30:30,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:30:30,942 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:30:31,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:30:33,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:30:35,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:30:37,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:30:39,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:30:41,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:30:43,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:30:45,121 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:30:46,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:30:46,165 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:30:47,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:30:49,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:30:51,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:30:54,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:30:55,037 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:30:56,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:30:58,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:31:00,128 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:31:01,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:31:01,442 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:31:02,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:31:04,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:31:06,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:31:08,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:31:10,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:31:12,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:31:14,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:31:16,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:31:16,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:31:16,674 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:31:18,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:31:20,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:31:22,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:31:24,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:31:25,112 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:31:26,140 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:31:28,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:31:30,142 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:31:32,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:31:32,005 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:31:32,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:31:34,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:31:36,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:31:38,145 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:31:40,146 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:31:42,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:31:44,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:31:46,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:31:47,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:31:47,225 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:31:48,150 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:31:50,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:31:52,152 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:31:54,153 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:31:55,188 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:31:57,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:31:59,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:32:01,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:32:02,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:32:02,530 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:32:03,157 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:32:05,157 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:32:07,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:32:09,159 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:32:11,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:32:13,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:32:15,162 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:32:17,163 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:32:17,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:32:17,808 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:32:19,163 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:32:21,164 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:32:23,165 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:32:25,165 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:32:25,260 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:32:27,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:32:29,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:32:31,168 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:32:33,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:32:33,084 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:32:33,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:32:35,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:32:37,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:32:39,172 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:32:41,172 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:32:43,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:32:45,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:32:47,175 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:32:48,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:32:48,408 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:32:49,176 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:32:51,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:32:53,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:32:55,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:32:55,331 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:32:57,179 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:32:59,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:33:01,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:33:03,182 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:33:03,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:33:03,772 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:33:05,182 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:33:07,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:33:09,184 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:33:11,185 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:33:13,186 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:33:15,187 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:33:17,188 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:33:19,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:33:19,133 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:33:19,189 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:33:21,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:33:23,191 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:33:25,192 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:33:25,404 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:33:27,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:33:29,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:33:31,194 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:33:34,196 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:33:34,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:33:34,369 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:33:36,197 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:33:38,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:33:40,199 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:33:42,200 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:33:44,200 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:33:46,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:33:48,202 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:33:49,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:33:49,830 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:33:50,203 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:33:52,204 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:33:54,205 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:33:55,480 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:33:56,206 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:33:58,207 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:34:00,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:34:02,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:34:05,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:34:05,051 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:34:20,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:34:20,275 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:34:25,557 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:34:35,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:34:35,515 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:34:50,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:34:50,778 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:34:55,632 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:35:05,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:35:05,139 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 08:35:05,190 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 08:35:05,270 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 08:35:06,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:35:06,045 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:35:06,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 08:35:06,270 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:35:14,273 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:35:21,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:35:21,329 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:35:25,727 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:35:36,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:35:36,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:35:36,551 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:35:51,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:35:51,786 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:35:55,808 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:36:07,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:36:07,009 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:36:22,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:36:22,233 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:36:25,886 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:36:37,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:36:37,457 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:36:52,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:36:52,738 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:36:55,963 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:37:07,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:37:07,961 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:37:23,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:37:23,188 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:37:26,044 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:37:38,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:37:38,411 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:37:53,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:37:53,644 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:37:56,124 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:38:08,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:38:08,862 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:38:26,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:38:26,105 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:38:26,332 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:38:41,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:38:41,337 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:38:56,283 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:38:56,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:38:56,571 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:39:11,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:39:11,796 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:39:26,360 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:39:27,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:39:27,022 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:39:29,386 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:39:33,387 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:39:35,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:35,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:35,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:35,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:35,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:35,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:35,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:35,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:35,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:35,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:35,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:35,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:35,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:35,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:35,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:35,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:42,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:39:42,332 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:39:43,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:39:47,393 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:39:50,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:50,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:50,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:50,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:50,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:50,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:50,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:50,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:50,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:50,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:50,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:50,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:50,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:50,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:50,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:50,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:52,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:52,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:52,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:52,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:52,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:52,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:52,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:52,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:52,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:52,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:52,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:52,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:52,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:52,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:52,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:52,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:53,396 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:39:56,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:56,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:56,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:56,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:56,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:56,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:56,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:56,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:56,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:56,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:56,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:56,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:56,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:56,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:56,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:56,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:56,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:56,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:56,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:56,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:56,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:56,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:56,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:56,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:56,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:56,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:56,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:56,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:56,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:56,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:56,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:56,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:56,436 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:39:57,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:39:57,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:39:57,569 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:39:59,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:39:59,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:59,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:59,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:59,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:59,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:59,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:59,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:59,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:59,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:59,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:59,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:59,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:59,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:59,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:59,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:39:59,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:00,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:00,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:00,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:00,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:00,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:00,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:00,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:00,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:00,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:00,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:00,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:00,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:00,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:00,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:00,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:00,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:03,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:03,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:03,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:03,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:03,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:03,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:03,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:03,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:03,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:03,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:03,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:03,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:03,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:03,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:03,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:03,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:03,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:40:07,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:07,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:07,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:07,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:07,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:07,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:07,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:07,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:07,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:07,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:07,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:07,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:07,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:07,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:07,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:07,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:07,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:40:11,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:40:12,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:40:12,976 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:40:15,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:15,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:15,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:15,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:15,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:15,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:15,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:15,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:15,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:15,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:15,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:15,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:15,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:15,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:15,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:15,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:15,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:40:17,406 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:40:18,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:18,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:18,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:18,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:18,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:18,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:18,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:18,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:18,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:18,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:18,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:18,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:18,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:18,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:18,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:18,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:20,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:20,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:20,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:20,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:20,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:20,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:20,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:20,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:20,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:20,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:20,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:20,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:20,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:20,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:20,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:20,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:21,407 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:40:23,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:40:23,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:23,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:23,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:23,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:23,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:23,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:23,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:23,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:23,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:23,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:23,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:23,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:23,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:23,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:23,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:23,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:26,504 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:40:27,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:40:28,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:40:28,365 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:40:29,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:40:30,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:30,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:30,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:30,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:30,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:30,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:30,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:30,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:30,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:30,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:30,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:30,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:30,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:30,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:30,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:30,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:31,411 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:40:33,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:33,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:33,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:33,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:33,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:33,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:33,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:33,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:33,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:33,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:33,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:33,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:33,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:33,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:33,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:33,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:34,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:34,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:34,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:34,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:34,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:34,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:34,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:34,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:34,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:34,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:34,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:34,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:34,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:34,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:34,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:34,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:35,413 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:40:37,414 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:40:38,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:38,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:38,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:38,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:38,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:38,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:38,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:38,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:38,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:38,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:38,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:38,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:38,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:38,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:38,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:38,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:39,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:40:40,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:40,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:40,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:40,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:40,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:40,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:40,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:40,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:40,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:40,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:40,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:40,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:40,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:40,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:40,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:40,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:40,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:40,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:40,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:40,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:40,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:40,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:40,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:40,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:40,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:40,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:40,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:40,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:40,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:40,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:40,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:40,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:41,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:42,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:42,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:42,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:42,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:42,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:42,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:42,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:42,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:42,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:42,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:42,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:42,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:42,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:42,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:42,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:42,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:43,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:40:43,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:43,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:43,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:43,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:43,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:43,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:43,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:43,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:43,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:43,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:43,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:43,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:43,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:43,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:43,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:43,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:43,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:40:43,625 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:40:45,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:40:47,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:40:50,419 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:40:52,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:40:54,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:54,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:54,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:54,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:54,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:54,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:54,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:54,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:54,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:54,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:54,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:54,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:54,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:54,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:54,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:54,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:56,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:40:56,582 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:40:56,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:56,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:56,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:56,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:56,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:56,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:56,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:56,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:56,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:56,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:56,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:56,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:56,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:56,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:56,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:56,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:57,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:57,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:57,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:57,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:57,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:57,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:57,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:57,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:57,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:57,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:57,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:57,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:57,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:57,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:57,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:57,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:58,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:40:58,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:40:58,860 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:40:59,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:59,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:59,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:59,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:59,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:59,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:59,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:59,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:59,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:59,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:59,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:59,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:59,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:59,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:59,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:40:59,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:00,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:41:02,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:02,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:02,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:02,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:02,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:02,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:02,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:02,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:02,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:02,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:02,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:02,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:02,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:02,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:02,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:02,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:02,425 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:41:02,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:02,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:02,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:02,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:02,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:02,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:02,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:02,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:02,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:02,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:02,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:02,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:02,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:02,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:02,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:02,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:03,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:03,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:03,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:03,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:03,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:03,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:03,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:03,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:03,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:03,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:03,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:03,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:03,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:03,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:03,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:03,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:04,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:41:06,427 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:41:06,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:06,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:06,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:06,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:06,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:06,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:06,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:06,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:06,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:06,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:06,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:06,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:06,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:06,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:06,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:06,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:06,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:06,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:06,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:06,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:06,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:06,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:06,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:06,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:06,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:06,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:06,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:06,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:06,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:06,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:06,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:06,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:08,428 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:41:08,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:08,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:08,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:08,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:08,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:08,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:08,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:08,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:08,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:08,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:08,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:08,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:08,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:08,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:08,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:08,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:09,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:09,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:09,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:09,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:09,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:09,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:09,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:09,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:09,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:09,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:09,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:09,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:09,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:09,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:09,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:09,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:10,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:10,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:10,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:10,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:10,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:10,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:10,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:10,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:10,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:10,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:10,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:10,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:10,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:10,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:10,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:10,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:10,429 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:41:10,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:10,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:10,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:10,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:10,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:10,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:10,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:10,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:10,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:10,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:10,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:10,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:10,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:10,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:10,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:10,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:11,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:11,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:11,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:11,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:11,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:11,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:11,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:11,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:11,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:11,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:11,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:11,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:11,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:11,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:11,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:11,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:11,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:11,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:11,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:11,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:11,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:11,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:11,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:11,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:11,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:11,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:11,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:11,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:11,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:11,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:11,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:11,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:12,431 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:41:13,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:13,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:13,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:13,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:13,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:13,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:13,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:13,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:13,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:13,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:13,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:13,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:13,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:13,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:13,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:13,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:14,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:41:14,139 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:41:14,432 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:41:15,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:15,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:15,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:15,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:15,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:15,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:15,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:15,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:15,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:15,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:15,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:15,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:15,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:15,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:15,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:15,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:16,433 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:41:18,433 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:41:20,434 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:41:21,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:21,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:21,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:21,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:21,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:21,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:21,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:21,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:21,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:21,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:21,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:21,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:21,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:21,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:21,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:21,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:22,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:41:22,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:22,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:22,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:22,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:22,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:22,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:22,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:22,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:22,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:22,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:22,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:22,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:22,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:22,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:22,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:22,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:22,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:22,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:22,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:22,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:22,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:22,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:22,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:22,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:22,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:22,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:22,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:22,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:22,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:22,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:22,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:22,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:24,436 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:41:26,437 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:41:26,651 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:41:28,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:28,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:28,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:28,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:28,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:28,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:28,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:28,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:28,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:28,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:28,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:28,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:28,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:28,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:28,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:28,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:28,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:41:29,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:41:29,379 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:41:30,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:30,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:30,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:30,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:30,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:30,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:30,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:30,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:30,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:30,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:30,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:30,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:30,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:30,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:30,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:30,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:30,439 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:41:30,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:30,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:30,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:30,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:30,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:30,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:30,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:30,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:30,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:30,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:30,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:30,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:30,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:30,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:30,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:30,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:31,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:31,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:31,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:31,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:31,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:31,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:31,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:31,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:31,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:31,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:31,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:31,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:32,440 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:41:34,441 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:41:42,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:41:44,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:41:44,606 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:41:45,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:45,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:45,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:45,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:45,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:45,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:45,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:45,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:45,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:45,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:45,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:45,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:45,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:45,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:45,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:45,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:48,446 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:41:52,448 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:41:52,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:52,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:52,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:52,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:52,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:52,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:52,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:52,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:52,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:52,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:52,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:52,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:52,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:52,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:52,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:52,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:41:56,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:41:56,727 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:41:59,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:41:59,876 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:42:00,451 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:42:00,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:00,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:00,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:00,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:00,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:00,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:00,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:00,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:00,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:00,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:00,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:00,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:00,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:00,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:00,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:00,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:02,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:02,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:02,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:02,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:02,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:02,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:02,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:02,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:02,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:02,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:02,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:02,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:02,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:02,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:02,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:02,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:04,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:42:06,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:06,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:06,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:06,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:06,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:06,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:06,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:06,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:06,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:06,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:06,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:06,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:06,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:06,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:06,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:06,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:08,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:08,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:08,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:08,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:08,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:08,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:08,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:08,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:08,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:08,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:08,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:08,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:08,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:08,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:08,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:08,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:08,455 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:42:11,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:11,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:12,456 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:42:12,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:12,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:12,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:12,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:12,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:12,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:12,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:12,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:12,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:12,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:12,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:12,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:12,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:12,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:12,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:12,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:14,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:42:15,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:42:15,351 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:42:18,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:42:20,460 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:42:22,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:22,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:22,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:22,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:22,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:22,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:22,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:22,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:22,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:22,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:22,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:22,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:22,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:22,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:22,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:22,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:24,461 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:42:25,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:25,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:25,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:25,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:25,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:25,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:25,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:25,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:25,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:25,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:25,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:25,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:25,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:25,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:25,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:25,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:26,462 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:42:26,799 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:42:28,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:28,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:28,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:28,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:28,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:28,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:28,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:28,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:28,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:28,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:28,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:28,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:28,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:28,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:28,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:28,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:30,464 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:42:30,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:42:30,739 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:42:31,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:31,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:31,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:31,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:31,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:31,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:31,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:31,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:31,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:31,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:31,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:31,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:31,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:31,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:31,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:31,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:32,464 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:42:36,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:36,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:36,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:36,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:36,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:36,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:36,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:36,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:36,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:36,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:36,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:36,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:36,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:36,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:36,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:36,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:37,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:37,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:37,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:37,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:37,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:37,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:37,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:37,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:37,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:37,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:37,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:37,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:37,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:37,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:37,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:37,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:37,466 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:42:37,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:37,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:37,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:37,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:37,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:37,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:37,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:37,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:37,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:37,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:37,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:37,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:37,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:37,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:37,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:37,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:39,467 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:42:41,468 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:42:41,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:41,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:41,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:41,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:41,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:41,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:41,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:41,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:41,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:41,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:41,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:41,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:41,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:41,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:41,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:41,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:43,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:42:44,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:44,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:44,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:44,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:44,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:44,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:44,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:44,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:44,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:44,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:44,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:44,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:44,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:44,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:44,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:44,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:45,470 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:42:45,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:45,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:45,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:45,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:45,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:45,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:45,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:45,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:45,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:45,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:45,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:45,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:45,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:45,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:45,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:45,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:45,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:42:45,989 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:42:46,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:46,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:46,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:46,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:46,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:46,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:46,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:46,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:46,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:46,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:46,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:46,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:46,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:46,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:46,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:46,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:46,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:46,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:46,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:46,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:46,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:46,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:46,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:46,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:46,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:46,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:46,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:46,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:46,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:46,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:46,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:46,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:47,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:47,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:47,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:47,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:47,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:47,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:47,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:47,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:47,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:47,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:47,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:47,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:47,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:47,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:47,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:47,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:49,471 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:42:49,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:49,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:49,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:49,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:49,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:49,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:49,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:49,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:49,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:49,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:49,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:49,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:49,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:49,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:49,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:49,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:51,472 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:42:53,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:53,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:53,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:53,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:53,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:53,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:53,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:53,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:53,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:53,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:53,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:53,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:53,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:53,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:53,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:53,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:53,473 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:42:55,473 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:42:56,874 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:42:57,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:57,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:57,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:57,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:57,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:57,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:57,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:57,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:57,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:57,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:57,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:57,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:57,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:57,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:57,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:57,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:42:57,474 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:42:59,475 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:43:00,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:00,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:00,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:00,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:00,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:00,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:00,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:00,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:00,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:00,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:00,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:00,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:00,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:00,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:00,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:00,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:01,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:43:01,333 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:43:01,476 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:43:02,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:02,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:02,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:02,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:02,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:02,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:02,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:02,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:02,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:02,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:02,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:02,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:02,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:02,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:02,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:02,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:02,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:02,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:02,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:02,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:02,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:02,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:02,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:02,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:02,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:02,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:02,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:02,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:02,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:02,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:02,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:02,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:03,476 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:43:04,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:04,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:04,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:04,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:04,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:04,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:04,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:04,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:04,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:04,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:04,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:04,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:04,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:04,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:04,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:04,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:05,477 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:43:05,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:05,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:05,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:05,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:05,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:05,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:05,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:05,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:05,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:05,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:05,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:05,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:05,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:05,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:05,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:05,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:05,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:05,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:05,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:05,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:05,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:05,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:05,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:05,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:05,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:05,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:05,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:05,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:05,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:05,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:05,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:05,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:07,478 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:43:09,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:43:11,480 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:43:11,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:11,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:11,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:11,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:11,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:11,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:11,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:11,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:11,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:11,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:11,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:11,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:11,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:11,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:11,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:11,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:12,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:12,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:12,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:12,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:12,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:12,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:12,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:12,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:12,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:12,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:12,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:12,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:12,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:12,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:12,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:12,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:12,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:12,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:12,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:12,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:12,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:12,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:12,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:12,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:12,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:12,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:12,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:12,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:12,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:12,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:12,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:12,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:13,481 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:43:14,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:14,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:15,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:15,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:15,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:15,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:15,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:15,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:15,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:15,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:15,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:15,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:15,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:15,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:15,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:15,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:15,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:15,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:15,482 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:43:16,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:43:16,621 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:43:17,483 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:43:17,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:17,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:17,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:17,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:17,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:17,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:17,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:17,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:17,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:17,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:17,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:17,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:17,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:17,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:17,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:17,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:18,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:18,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:18,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:18,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:18,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:18,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:18,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:18,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:18,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:18,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:18,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:18,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:18,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:18,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:18,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:18,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:19,484 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:43:19,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:19,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:19,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:19,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:19,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:19,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:19,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:19,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:19,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:19,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:19,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:19,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:19,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:19,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:19,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:19,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:21,485 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:43:23,486 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:43:24,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:24,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:24,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:24,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:24,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:24,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:24,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:24,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:24,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:24,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:24,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:24,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:24,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:24,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:24,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:24,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:24,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:24,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:24,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:24,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:24,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:24,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:24,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:24,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:24,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:24,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:24,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:24,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:24,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:24,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:24,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:24,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:25,487 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:43:25,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:25,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:25,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:25,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:25,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:25,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:25,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:25,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:25,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:25,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:25,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:25,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:25,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:25,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:25,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:25,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:26,946 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:43:27,488 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:43:29,489 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:43:31,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:31,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:31,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:31,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:31,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:31,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:31,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:31,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:31,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:31,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:31,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:31,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:31,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:31,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:31,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:31,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:31,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:31,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:31,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:31,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:31,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:43:31,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:31,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:31,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:31,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:31,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:31,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:31,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:31,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:31,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:31,898 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 08:43:32,122 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 08:43:32,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:43:32,190 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 08:43:32,191 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:43:32,491 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 08:43:33,491 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:43:34,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:34,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:34,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:34,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:34,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:34,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:34,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:34,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:34,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:34,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:34,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:34,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:34,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:34,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:34,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:34,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:43,495 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:43:44,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:44,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:44,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:44,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:44,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:44,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:44,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:44,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:44,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:44,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:44,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:44,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:44,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:44,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:44,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:44,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:43:47,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:43:47,920 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:43:49,497 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:43:53,499 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:43:57,054 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:43:57,500 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:44:01,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:01,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:01,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:01,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:01,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:01,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:01,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:01,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:01,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:01,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:01,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:01,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:01,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:01,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:01,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:01,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:01,501 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:44:02,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:02,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:02,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:02,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:02,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:02,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:02,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:02,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:02,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:02,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:02,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:02,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:02,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:02,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:02,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:02,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:03,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:44:03,144 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:44:05,503 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:44:06,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:06,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:06,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:06,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:06,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:06,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:06,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:06,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:06,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:06,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:06,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:06,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:06,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:06,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:06,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:06,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:08,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:08,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:08,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:08,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:08,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:08,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:08,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:08,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:08,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:08,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:08,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:08,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:08,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:08,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:08,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:08,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:09,505 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:44:11,506 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:44:13,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:13,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:13,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:13,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:13,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:13,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:13,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:13,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:13,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:13,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:13,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:13,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:13,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:13,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:13,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:13,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:15,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:15,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:15,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:15,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:15,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:15,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:15,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:15,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:15,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:15,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:15,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:15,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:15,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:15,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:15,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:15,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:15,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:15,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:15,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:15,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:15,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:15,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:15,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:15,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:15,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:15,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:15,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:15,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:15,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:15,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:15,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:15,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:15,508 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:44:16,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:16,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:16,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:16,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:16,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:16,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:16,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:16,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:16,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:16,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:16,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:16,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:16,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:16,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:16,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:16,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:18,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:44:18,371 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:44:19,509 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:44:19,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:19,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:19,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:19,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:19,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:19,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:19,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:19,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:19,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:19,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:19,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:19,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:19,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:19,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:19,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:19,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:19,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:19,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:19,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:19,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:19,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:19,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:19,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:19,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:19,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:19,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:19,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:19,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:19,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:19,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:19,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:19,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:21,510 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:44:24,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:24,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:24,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:24,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:24,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:24,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:24,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:24,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:24,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:24,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:24,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:24,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:24,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:24,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:24,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:24,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:25,511 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:44:27,132 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:44:27,512 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:44:31,513 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:44:33,514 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:44:33,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:44:33,650 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:44:34,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:34,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:34,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:34,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:34,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:34,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:34,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:34,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:34,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:34,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:34,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:34,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:34,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:34,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:34,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:34,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:35,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:35,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:35,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:35,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:35,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:35,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:35,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:35,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:35,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:35,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:35,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:35,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:35,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:35,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:35,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:35,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:36,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:44:37,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:37,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:37,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:37,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:37,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:37,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:37,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:37,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:37,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:37,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:37,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:37,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:37,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:37,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:37,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:37,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:38,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:38,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:38,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:38,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:38,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:38,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:38,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:38,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:38,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:38,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:38,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:38,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:38,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:38,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:38,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:38,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:38,516 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:44:42,518 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:44:43,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:43,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:43,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:43,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:43,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:43,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:43,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:43,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:43,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:43,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:43,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:43,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:43,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:43,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:43,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:43,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:44,518 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:44:46,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:44:46,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:46,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:46,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:46,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:46,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:46,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:46,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:46,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:46,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:46,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:46,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:46,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:46,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:46,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:46,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:46,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:47,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:47,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:47,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:47,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:47,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:47,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:47,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:47,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:47,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:47,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:47,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:47,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:47,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:47,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:47,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:47,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:48,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:48,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:48,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:48,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:48,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:48,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:48,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:48,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:48,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:48,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:48,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:48,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:48,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:48,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:48,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:48,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:48,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:44:49,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:44:49,002 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:44:49,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:49,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:49,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:49,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:49,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:49,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:49,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:49,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:49,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:49,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:49,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:49,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:49,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:49,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:49,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:49,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:49,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:49,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:49,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:49,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:49,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:49,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:49,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:49,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:49,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:49,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:49,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:49,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:49,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:49,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:49,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:49,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:52,522 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:44:52,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:52,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:52,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:52,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:52,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:52,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:52,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:52,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:52,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:52,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:52,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:52,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:52,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:52,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:52,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:52,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:53,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:53,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:53,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:53,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:53,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:53,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:53,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:53,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:53,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:53,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:53,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:53,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:53,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:53,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:53,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:53,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:54,523 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:44:55,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:55,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:55,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:55,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:55,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:55,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:55,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:55,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:55,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:55,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:55,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:55,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:55,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:55,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:55,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:55,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:44:56,524 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:44:57,204 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:44:58,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:45:00,526 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:45:02,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:02,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:02,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:02,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:02,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:02,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:02,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:02,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:02,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:02,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:02,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:02,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:02,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:02,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:02,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:02,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:02,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:02,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:02,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:02,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:02,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:02,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:02,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:02,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:02,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:02,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:02,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:02,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:02,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:02,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:02,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:02,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:02,526 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:45:04,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:04,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:04,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:04,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:04,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:04,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:04,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:04,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:04,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:04,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:04,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:04,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:04,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:04,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:04,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:04,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:04,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:45:04,227 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:45:04,527 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:45:06,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:06,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:06,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:06,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:06,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:06,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:06,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:06,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:06,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:06,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:06,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:06,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:06,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:06,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:06,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:06,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:06,528 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:45:07,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:07,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:07,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:07,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:07,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:07,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:07,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:07,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:07,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:07,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:07,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:07,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:07,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:07,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:07,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:07,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:07,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:07,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:07,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:07,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:07,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:07,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:07,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:07,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:07,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:07,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:07,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:07,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:07,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:07,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:07,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:07,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:08,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:08,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:08,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:08,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:08,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:08,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:08,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:08,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:08,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:08,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:08,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:08,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:08,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:08,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:08,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:08,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:08,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:45:10,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:10,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:10,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:10,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:10,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:10,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:10,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:10,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:10,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:10,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:10,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:10,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:10,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:10,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:10,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:10,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:10,530 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:45:12,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:45:14,532 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:45:14,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:14,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:14,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:14,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:14,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:14,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:14,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:14,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:14,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:14,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:14,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:14,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:15,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:15,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:15,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:15,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:15,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:15,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:15,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:15,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:15,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:15,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:15,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:15,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:15,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:15,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:15,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:15,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:15,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:15,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:15,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:15,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:15,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:15,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:15,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:15,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:15,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:15,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:15,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:15,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:15,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:15,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:15,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:15,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:15,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:15,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:15,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:15,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:16,534 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:45:17,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:17,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:17,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:17,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:17,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:17,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:17,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:17,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:17,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:17,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:17,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:17,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:17,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:17,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:17,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:17,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:18,534 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:45:18,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:18,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:18,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:18,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:18,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:18,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:18,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:18,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:18,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:18,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:18,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:18,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:18,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:18,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:18,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:18,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:19,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:45:19,487 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:45:19,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:19,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,535 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:45:20,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:20,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:21,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:21,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:21,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:21,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:21,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:21,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:21,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:21,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:21,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:21,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:21,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:21,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:21,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:21,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:21,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:21,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:22,536 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:45:23,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:23,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:23,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:23,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:23,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:23,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:23,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:23,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:23,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:23,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:23,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:23,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:23,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:23,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:23,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:23,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:24,537 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:45:26,538 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:45:27,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:27,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:27,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:27,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:27,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:27,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:27,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:27,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:27,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:27,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:27,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:27,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:27,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:27,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:27,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:27,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:27,279 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:45:28,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:28,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:28,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:28,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:28,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:28,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:28,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:28,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:28,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:28,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:28,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:28,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:28,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:28,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:28,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:28,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:28,539 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:45:29,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:29,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:29,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:29,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:29,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:29,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:29,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:29,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:29,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:29,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:29,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:29,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:29,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:29,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:29,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:29,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:30,539 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:45:32,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:45:32,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:32,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:32,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:32,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:32,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:32,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:32,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:32,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:32,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:32,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:32,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:32,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:34,541 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:45:34,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:45:34,712 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:45:39,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:39,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:39,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:39,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:39,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:39,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:39,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:39,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:39,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:39,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:39,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:39,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:39,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:39,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:39,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:39,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:42,544 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:45:43,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:43,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:43,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:43,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:43,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:43,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:43,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:43,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:43,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:43,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:43,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:43,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:43,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:43,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:43,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:43,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:45,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:45,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:45,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:45,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:45,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:45,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:45,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:45,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:45,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:45,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:45,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:45,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:45,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:45,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:45,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:45,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:45:48,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:45:49,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:45:49,937 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:45:52,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:45:56,550 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:45:57,356 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:46:00,551 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:46:04,552 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:46:05,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:05,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:05,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:05,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:05,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:05,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:05,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:05,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:05,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:05,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:05,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:05,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:05,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:05,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:05,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:05,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:05,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:46:05,162 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:46:06,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:46:10,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:10,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:10,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:10,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:10,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:10,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:10,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:10,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:10,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:10,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:10,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:10,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:10,555 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:46:10,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:10,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:10,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:10,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:10,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:10,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:10,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:10,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:10,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:10,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:10,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:10,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:10,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:10,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:10,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:10,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:10,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:10,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:10,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:10,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:12,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:12,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:12,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:12,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:12,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:12,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:12,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:12,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:12,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:12,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:12,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:12,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:12,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:12,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:12,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:12,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:14,557 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:46:15,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:15,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:15,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:15,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:15,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:15,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:15,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:15,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:15,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:15,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:15,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:15,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:15,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:15,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:15,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:15,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:17,558 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:46:18,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:18,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:18,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:18,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:18,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:18,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:18,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:18,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:18,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:18,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:18,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:18,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:18,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:18,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:18,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:18,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:20,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:46:20,389 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:46:21,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:46:23,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:46:24,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:24,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:24,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:24,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:24,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:24,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:24,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:24,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:24,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:24,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:24,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:24,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:24,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:24,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:24,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:24,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:27,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:27,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:27,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:27,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:27,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:27,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:27,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:27,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:27,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:27,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:27,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:27,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:27,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:27,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:27,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:27,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:27,428 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:46:27,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:27,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:27,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:27,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:27,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:27,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:27,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:27,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:27,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:27,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:27,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:27,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:27,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:27,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:27,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:27,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:27,562 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:46:28,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:28,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:28,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:28,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:28,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:28,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:28,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:28,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:28,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:28,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:28,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:28,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:28,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:28,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:28,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:28,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:29,563 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:46:29,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:29,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:29,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:29,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:29,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:29,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:29,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:29,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:29,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:29,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:29,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:29,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:29,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:29,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:29,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:29,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:33,564 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:46:35,565 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:46:35,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:46:35,784 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:46:36,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:36,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:36,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:36,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:36,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:36,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:36,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:36,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:36,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:36,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:36,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:36,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:36,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:36,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:36,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:36,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:37,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:46:37,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:37,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:37,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:37,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:37,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:37,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:37,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:37,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:37,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:37,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:37,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:37,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:37,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:37,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:37,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:37,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:39,567 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:46:40,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:40,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:40,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:40,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:40,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:40,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:40,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:40,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:40,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:40,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:40,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:40,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:40,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:40,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:40,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:40,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:43,568 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:46:45,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:45,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:45,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:45,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:45,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:45,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:45,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:45,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:45,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:45,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:45,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:45,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:45,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:45,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:45,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:45,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:45,569 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:46:46,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:46,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:46,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:46,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:46,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:46,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:46,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:46,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:46,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:46,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:46,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:46,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:46,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:46,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:46,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:46,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:47,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:46:47,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:47,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:47,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:47,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:47,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:47,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:47,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:47,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:47,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:47,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:47,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:47,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:47,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:47,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:47,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:47,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:49,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:49,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:49,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:49,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:49,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:49,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:49,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:49,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:49,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:49,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:49,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:49,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:49,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:49,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:49,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:49,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:49,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:46:50,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:50,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:50,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:50,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:50,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:50,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:50,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:50,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:50,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:50,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:50,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:50,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:50,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:50,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:50,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:50,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:51,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:46:51,140 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:46:51,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:46:54,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:54,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:54,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:54,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:54,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:54,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:54,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:54,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:54,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:54,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:54,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:54,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:54,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:54,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:54,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:54,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:54,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:54,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:54,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:54,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:54,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:54,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:54,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:54,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:54,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:54,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:54,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:54,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:54,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:54,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:54,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:54,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:55,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:46:57,503 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:46:57,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:46:58,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:58,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:46:59,574 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:47:01,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:47:03,576 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:47:05,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:47:05,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:05,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:05,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:05,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:05,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:05,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:05,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:05,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:05,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:05,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:05,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:05,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:05,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:05,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:05,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:05,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:06,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:47:06,430 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:47:06,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:06,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:06,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:06,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:06,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:06,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:06,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:06,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:06,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:06,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:06,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:06,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:06,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:06,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:06,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:06,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:07,578 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:47:07,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:07,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:07,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:07,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:07,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:07,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:07,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:07,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:07,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:07,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:07,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:07,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:07,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:07,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:07,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:07,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:08,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:08,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:08,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:08,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:08,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:08,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:08,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:08,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:08,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:08,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:08,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:08,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:08,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:08,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:08,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:08,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:09,578 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:47:11,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:11,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:11,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:11,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:11,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:11,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:11,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:11,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:11,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:11,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:11,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:11,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:11,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:11,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:11,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:11,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:11,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:11,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:11,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:11,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:11,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:11,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:11,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:11,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:11,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:11,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:11,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:11,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:11,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:11,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:11,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:11,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:11,579 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:47:12,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:12,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:12,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:12,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:12,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:12,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:12,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:12,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:13,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:13,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:13,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:13,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:13,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:13,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:13,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:13,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:13,580 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:47:14,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:14,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:14,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:14,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:14,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:14,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:14,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:14,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:14,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:14,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:14,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:14,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:14,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:14,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:14,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:14,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:14,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:14,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:14,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:14,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:14,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:14,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:14,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:14,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:14,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:14,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:14,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:14,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:14,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:14,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:14,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:14,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:15,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:47:16,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:16,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:16,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:16,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:16,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:16,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:16,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:16,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:16,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:16,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:16,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:16,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:16,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:16,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:16,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:16,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:17,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:17,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:17,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:17,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:17,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:17,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:17,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:17,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:17,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:17,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:17,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:17,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:17,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:17,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:17,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:47:17,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:17,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:19,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:19,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:19,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:19,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:19,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:19,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:19,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:19,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:19,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:19,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:19,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:19,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:19,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:19,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:19,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:19,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:19,583 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:47:20,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:20,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:20,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:20,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:20,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:20,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:20,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:20,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:20,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:20,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:20,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:20,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:20,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:20,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:20,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:20,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:20,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:20,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:20,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:20,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:20,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:20,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:20,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:20,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:20,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:20,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:20,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:20,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:20,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:20,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:20,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:20,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:21,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:21,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:21,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:21,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:21,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:21,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:21,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:21,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:21,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:21,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:21,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:21,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:21,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:21,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:21,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:21,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:21,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:47:21,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:47:21,666 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:47:22,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:22,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:22,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:22,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:22,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:22,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:22,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:22,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:22,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:22,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:22,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:22,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:22,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:22,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:22,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:22,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:22,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:22,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:22,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:22,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:22,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:22,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:22,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:22,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:22,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:22,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:22,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:22,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:22,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:22,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:22,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:22,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:23,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:47:25,585 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:47:25,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:25,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:25,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:25,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:25,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:25,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:25,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:25,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:25,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:25,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:25,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:25,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:25,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:25,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:25,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:25,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:27,574 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:47:27,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:47:27,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:27,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:27,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:27,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:27,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:27,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:27,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:27,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:27,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:27,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:27,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:27,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:27,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:27,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:27,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:27,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:27,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:27,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:27,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:27,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:27,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:27,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:27,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:27,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:27,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:27,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:27,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:27,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:27,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:27,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:27,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:27,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:29,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:47:30,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:30,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:30,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:30,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:30,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:30,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:30,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:30,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:30,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:30,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:30,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:30,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:30,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:30,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:30,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:30,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:31,587 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:47:31,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:31,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:31,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:31,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:31,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:31,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:31,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:31,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:31,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:31,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:31,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:31,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:31,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:32,011 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 08:47:32,230 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 08:47:32,304 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 08:47:32,587 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 08:47:33,588 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:47:36,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:47:36,904 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:47:43,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:43,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:43,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:43,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:43,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:43,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:43,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:43,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:43,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:43,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:43,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:43,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:43,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:43,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:43,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:43,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:43,592 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:47:47,593 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:47:51,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:51,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:51,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:51,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:51,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:51,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:51,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:51,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:51,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:51,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:51,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:51,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:51,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:51,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:51,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:51,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:52,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:47:52,290 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:47:53,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:53,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:53,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:53,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:53,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:53,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:53,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:53,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:53,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:53,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:53,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:53,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:53,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:53,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:53,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:53,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:47:53,595 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:47:57,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:47:57,664 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:48:01,599 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:48:05,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:48:07,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:48:07,636 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:48:08,601 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:48:11,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:11,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:11,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:11,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:11,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:11,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:11,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:11,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:11,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:11,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:11,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:11,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:11,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:11,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:11,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:11,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:12,603 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:48:16,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:48:18,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:18,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:18,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:18,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:18,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:18,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:18,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:18,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:18,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:18,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:18,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:18,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:18,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:18,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:18,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:18,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:18,605 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:48:20,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:20,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:20,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:20,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:20,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:20,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:20,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:20,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:20,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:20,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:20,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:20,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:20,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:20,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:20,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:20,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:21,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:21,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:21,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:21,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:21,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:21,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:21,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:21,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:21,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:21,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:21,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:21,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:21,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:21,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:21,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:21,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:21,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:21,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:21,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:21,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:21,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:21,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:21,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:21,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:21,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:21,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:21,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:21,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:21,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:21,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:21,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:21,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:22,607 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:48:22,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:48:22,873 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:48:24,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:24,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:24,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:24,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:24,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:24,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:24,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:24,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:24,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:24,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:24,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:24,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:24,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:24,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:24,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:24,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:24,608 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:48:27,739 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:48:28,609 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:48:30,610 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:48:31,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:31,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:31,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:31,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:31,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:31,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:31,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:31,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:31,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:31,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:31,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:31,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:31,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:31,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:31,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:31,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:31,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:31,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:31,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:31,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:31,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:31,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:31,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:31,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:31,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:31,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:31,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:31,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:31,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:31,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:31,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:31,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:32,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:32,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:32,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:32,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:32,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:32,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:32,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:32,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:32,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:32,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:32,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:32,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:32,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:32,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:32,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:32,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:32,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:48:33,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:33,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:33,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:33,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:33,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:33,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:33,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:33,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:33,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:33,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:33,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:33,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:33,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:33,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:33,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:33,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:36,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:36,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:36,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:36,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:36,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:36,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:36,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:36,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:36,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:36,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:36,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:36,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:36,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:36,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:36,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:36,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:36,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:48:38,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:48:38,201 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:48:38,613 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:48:40,614 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:48:41,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:41,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:41,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:41,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:41,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:41,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:41,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:41,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:41,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:41,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:41,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:41,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:41,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:41,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:41,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:41,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:41,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:41,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:41,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:41,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:41,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:41,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:41,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:41,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:41,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:41,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:41,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:41,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:41,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:41,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:41,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:41,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:44,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:48:46,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:46,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:46,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:46,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:46,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:46,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:46,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:46,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:46,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:46,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:46,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:46,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:46,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:46,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:46,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:46,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:46,617 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:48:48,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:48:50,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:48:50,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:50,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:52,619 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:48:53,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:48:53,518 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:48:54,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:48:55,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:55,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:55,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:55,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:55,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:55,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:55,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:55,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:55,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:55,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:55,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:55,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:55,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:55,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:55,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:55,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:55,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:55,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:55,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:55,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:55,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:55,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:55,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:55,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:55,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:55,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:55,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:55,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:55,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:55,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:55,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:55,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:56,621 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:48:57,808 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:48:58,622 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:48:59,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:59,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:59,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:59,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:59,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:59,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:59,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:59,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:59,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:59,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:59,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:59,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:48:59,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:00,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:00,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:00,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:00,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:00,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:00,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:00,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:00,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:00,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:00,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:00,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:00,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:00,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:00,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:00,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:00,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:00,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:00,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:00,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:00,623 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:49:00,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:00,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:00,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:00,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:00,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:00,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:00,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:00,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:00,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:00,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:00,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:00,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:00,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:00,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:00,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:01,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:02,623 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:49:04,624 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:49:04,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:04,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:04,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:04,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:04,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:04,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:04,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:04,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:04,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:04,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:04,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:04,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:04,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:04,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:04,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:04,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:04,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:04,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:04,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:04,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:04,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:04,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:04,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:04,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:04,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:04,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:04,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:04,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:04,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:04,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:04,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:04,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:06,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:49:08,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:08,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:08,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:08,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:08,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:08,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:08,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:08,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:08,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:08,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:08,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:08,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:08,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:08,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:08,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:08,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:08,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:08,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:08,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:08,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:08,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:08,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:08,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:08,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:08,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:08,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:08,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:08,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:08,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:08,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:08,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:08,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:08,626 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:49:08,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:49:08,744 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:49:10,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:49:11,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:11,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:11,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:11,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:11,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:11,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:11,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:11,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:11,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:11,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:11,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:11,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:11,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:11,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:11,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:11,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:11,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:11,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:11,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:11,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:11,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:11,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:11,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:11,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:11,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:11,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:11,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:11,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:11,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:11,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:11,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:11,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:12,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:12,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:12,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:12,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:12,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:12,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:12,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:12,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:12,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:12,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:12,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:12,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:12,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:12,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:12,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:12,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:12,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:49:12,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:12,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:12,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:12,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:12,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:12,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:12,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:12,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:12,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:12,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:12,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:12,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:12,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:12,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:12,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:12,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:14,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:49:15,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:15,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:15,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:15,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:15,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:15,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:15,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:15,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:15,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:15,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:15,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:15,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:15,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:15,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:15,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:15,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:16,629 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:49:17,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:17,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:17,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:17,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:17,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:17,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:17,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:17,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:17,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:17,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:17,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:17,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:17,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:17,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:17,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:17,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:18,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:49:18,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:18,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:18,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:18,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:18,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:18,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:18,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:18,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:18,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:18,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:18,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:18,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:18,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:18,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:18,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:18,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:19,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:19,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:19,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:19,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:19,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:19,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:19,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:19,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:19,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:19,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:19,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:19,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:19,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:19,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:19,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:19,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:19,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:19,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:19,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:19,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:19,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:19,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:19,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:19,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:19,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:19,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:19,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:19,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:19,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:19,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:19,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:19,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:20,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:20,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:20,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:20,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:20,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:20,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:20,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:20,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:20,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:20,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:20,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:20,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:20,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:20,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:20,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:20,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:20,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:49:21,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:21,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:21,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:21,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:21,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:21,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:21,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:21,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:21,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:21,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:21,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:21,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:21,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:21,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:21,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:21,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:22,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:22,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:22,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:22,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:22,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:22,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:22,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:22,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:22,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:22,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:22,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:22,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:22,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:22,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:22,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:22,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:22,631 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:49:24,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:49:24,085 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:49:24,632 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:49:24,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:24,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:24,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:24,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:24,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:24,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:24,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:24,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:24,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:24,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:24,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:24,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:24,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:24,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:24,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:24,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:25,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:25,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:25,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:25,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:25,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:25,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:25,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:25,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:25,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:25,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:25,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:25,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:25,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:25,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:25,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:25,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:25,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:25,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:25,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:25,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:25,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:25,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:25,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:25,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:25,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:25,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:25,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:25,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:25,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:25,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:25,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:25,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:26,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:49:27,881 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:49:27,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:27,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:27,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:27,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:27,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:27,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:27,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:27,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:27,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:27,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:27,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:27,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:27,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:27,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:27,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:27,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:28,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:28,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:28,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:28,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:28,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:28,635 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:49:28,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:28,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:28,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:28,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:28,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:28,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:28,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:28,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:28,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:28,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:28,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:30,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:30,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:30,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:30,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:30,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:30,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:30,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:30,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:30,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:30,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:30,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:30,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:30,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:30,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:30,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:30,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:30,635 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:49:30,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:30,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:30,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:30,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:30,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:30,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:30,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:30,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:30,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:30,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:30,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:30,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:32,636 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:49:39,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:49:39,311 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:49:42,640 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:49:46,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:49:52,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:52,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:52,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:52,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:52,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:52,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:52,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:52,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:52,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:52,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:52,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:52,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:52,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:52,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:52,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:52,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:52,644 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:49:54,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:49:54,541 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:49:55,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:55,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:55,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:55,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:55,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:55,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:55,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:55,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:55,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:55,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:55,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:55,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:55,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:55,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:55,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:55,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:56,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:56,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:56,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:56,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:56,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:56,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:56,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:56,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:56,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:56,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:56,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:56,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:56,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:56,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:56,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:56,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:56,646 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:49:57,955 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:49:58,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:58,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:58,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:58,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:58,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:58,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:58,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:58,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:58,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:58,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:58,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:58,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:58,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:58,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:58,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:49:58,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:00,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:50:04,649 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:50:06,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:50:09,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:50:09,947 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:50:11,652 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:50:15,654 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:50:17,655 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:50:18,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:18,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:18,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:18,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:18,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:18,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:18,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:18,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:18,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:18,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:18,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:18,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:18,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:18,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:18,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:18,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:21,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:50:23,657 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:50:23,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:23,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:23,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:23,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:23,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:23,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:23,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:23,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:23,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:23,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:23,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:23,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:23,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:23,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:23,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:23,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:25,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:50:25,259 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:50:26,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:26,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:26,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:26,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:26,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:26,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:26,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:26,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:26,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:26,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:26,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:26,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:26,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:26,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:26,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:26,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:26,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:26,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:26,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:26,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:26,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:26,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:26,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:26,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:26,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:26,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:26,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:26,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:26,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:26,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:26,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:26,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:27,659 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:50:27,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:27,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:27,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:27,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:27,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:27,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:27,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:27,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:27,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:27,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:27,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:27,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:27,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:27,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:27,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:27,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:28,031 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:50:29,660 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:50:30,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:30,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:30,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:30,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:30,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:30,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:30,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:30,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:30,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:30,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:30,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:30,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:30,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:30,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:30,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:30,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:33,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:50:35,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:35,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:35,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:35,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:35,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:35,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:35,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:35,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:35,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:35,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:35,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:35,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:35,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:35,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:35,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:35,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:35,663 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:50:37,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:37,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:37,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:37,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:37,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:37,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:37,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:37,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:37,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:37,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:37,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:37,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:37,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:37,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:37,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:37,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:37,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:37,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:37,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:37,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:37,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:37,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:37,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:37,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:37,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:37,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:37,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:37,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:37,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:37,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:37,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:37,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:37,664 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:50:39,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:39,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:39,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:39,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:39,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:39,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:39,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:39,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:39,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:39,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:39,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:39,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:39,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:39,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:39,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:39,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:40,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:50:40,535 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:50:41,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:41,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:41,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:41,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:41,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:41,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:41,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:41,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:41,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:41,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:41,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:41,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:41,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:41,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:41,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:41,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:41,666 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:50:43,667 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:50:44,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:44,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:44,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:44,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:44,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:44,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:44,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:44,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:44,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:44,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:44,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:44,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:44,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:44,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:44,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:44,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:45,668 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:50:47,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:47,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:47,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:47,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:47,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:47,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:47,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:47,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:47,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:47,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:47,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:47,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:47,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:47,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:47,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:47,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:47,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:50:48,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:48,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:48,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:48,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:48,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:48,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:48,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:48,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:48,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:48,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:48,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:48,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:48,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:48,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:48,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:48,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:51,670 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:50:52,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:52,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:52,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:52,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:52,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:52,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:52,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:52,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:52,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:52,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:52,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:52,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:52,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:52,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:52,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:52,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:53,671 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:50:55,672 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:50:55,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:50:55,760 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:50:56,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:56,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:56,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:56,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:56,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:56,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:56,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:56,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:56,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:56,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:56,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:56,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:56,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:56,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:56,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:56,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:56,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:56,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:56,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:56,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:56,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:56,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:56,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:56,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:56,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:56,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:56,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:56,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:56,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:56,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:56,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:56,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:57,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:57,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:57,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:57,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:57,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:57,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:57,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:57,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:57,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:57,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:57,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:57,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:57,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:57,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:57,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:57,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:50:57,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:50:58,107 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:50:59,674 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:51:00,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:00,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:00,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:00,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:00,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:00,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:00,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:00,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:00,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:00,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:00,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:00,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:00,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:00,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:00,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:00,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:00,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:00,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:00,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:00,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:00,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:00,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:00,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:00,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:00,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:00,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:00,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:00,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:00,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:00,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:00,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:00,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:01,675 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:51:03,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:03,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:03,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:03,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:03,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:03,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:03,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:03,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:03,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:03,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:03,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:03,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:03,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:03,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:03,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:03,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:03,676 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:51:05,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:51:07,678 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:51:07,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:07,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:07,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:07,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:07,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:07,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:07,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:07,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:07,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:07,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:07,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:07,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:07,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:07,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:07,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:07,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:08,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:09,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:51:11,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:51:11,005 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:51:11,680 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:51:12,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:12,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:12,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:12,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:12,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:12,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:12,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:12,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:12,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:12,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:12,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:12,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:12,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:12,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:12,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:12,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:13,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:51:15,682 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:51:15,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:15,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:15,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:15,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:15,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:15,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:15,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:15,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:15,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:15,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:15,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:15,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:15,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:15,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:15,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:15,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:16,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:17,682 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:51:18,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:18,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:18,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:18,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:18,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:18,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:18,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:18,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:18,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:18,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:18,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:18,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:18,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:18,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:18,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:18,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:19,683 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:51:20,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:20,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:20,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:20,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:20,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:20,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:20,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:20,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:20,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:20,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:20,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:20,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:20,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:20,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:20,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:20,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:21,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:51:22,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:22,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:22,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:22,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:22,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:22,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:22,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:22,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:22,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:22,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:22,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:22,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:22,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:22,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:22,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:22,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:22,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:22,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:22,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:22,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:22,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:22,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:22,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:22,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:22,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:22,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:22,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:22,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:22,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:22,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:22,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:22,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:23,685 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:51:24,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:24,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:24,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:24,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:24,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:24,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:24,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:24,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:24,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:24,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:24,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:24,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:24,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:24,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:24,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:24,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:25,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:51:26,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:51:26,276 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:51:27,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:27,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:27,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:27,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:27,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:27,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:27,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:27,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:27,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:27,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:27,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:27,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:27,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:27,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:27,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:27,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:27,687 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:51:28,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:28,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:28,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:28,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:28,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:28,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:28,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:28,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:28,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:28,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:28,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:28,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:28,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:28,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:28,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:28,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:28,183 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:51:29,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:29,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:29,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:29,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:29,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:29,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:29,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:29,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:29,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:29,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:29,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:29,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:29,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:29,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:29,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:29,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:29,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:29,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:29,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:29,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:29,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:29,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:29,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:29,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:29,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:29,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:29,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:29,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:29,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:29,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:29,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:29,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:29,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:51:30,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:30,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:30,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:30,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:30,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:30,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:30,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:30,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:30,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:30,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:30,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:30,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:30,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:30,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:30,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:30,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:31,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:31,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:31,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:31,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:31,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:31,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:31,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:31,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:31,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:31,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:31,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:31,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:31,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:31,626 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 08:51:31,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:51:31,855 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 08:51:31,919 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 08:51:32,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 08:51:33,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:51:41,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:51:41,502 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:51:43,831 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:51:47,833 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:51:49,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:49,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:49,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:49,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:49,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:49,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:49,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:49,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:49,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:49,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:49,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:49,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:49,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:49,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:49,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:49,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:51:53,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:51:57,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:51:57,030 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:51:57,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:51:58,283 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:52:01,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:01,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:01,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:01,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:01,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:01,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:01,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:01,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:01,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:01,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:01,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:01,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:01,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:01,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:01,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:01,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:01,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:52:01,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:01,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:01,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:01,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:01,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:01,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:01,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:01,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:01,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:01,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:01,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:01,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:01,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:01,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:01,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:01,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:05,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:52:09,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:09,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:09,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:09,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:09,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:09,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:09,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:09,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:09,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:09,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:09,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:09,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:09,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:09,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:09,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:09,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:09,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:09,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:09,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:09,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:09,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:09,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:09,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:09,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:09,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:09,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:09,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:09,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:09,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:09,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:09,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:09,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:09,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:52:11,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:52:12,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:52:12,246 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:52:15,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:52:19,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:52:21,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:52:25,849 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:52:27,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:52:27,473 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:52:27,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:27,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:27,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:27,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:27,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:27,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:27,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:27,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:27,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:27,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:27,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:27,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:27,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:27,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:27,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:27,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:27,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:27,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:27,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:27,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:27,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:27,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:27,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:27,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:27,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:27,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:27,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:27,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:27,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:27,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:27,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:27,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:27,850 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:52:28,353 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:52:31,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:52:33,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:33,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:52:36,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:52:36,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:36,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:36,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:36,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:36,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:36,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:36,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:36,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:36,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:36,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:36,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:36,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:36,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:36,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:36,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:36,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:40,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:52:41,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:41,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:41,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:41,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:41,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:41,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:41,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:41,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:41,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:41,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:41,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:41,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:41,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:41,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:41,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:41,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:42,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:52:43,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:52:43,022 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:52:43,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:43,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:43,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:43,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:43,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:43,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:43,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:43,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:43,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:43,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:43,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:43,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:43,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:43,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:43,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:43,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:44,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:44,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:44,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:44,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:44,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:44,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:44,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:44,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:44,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:44,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:44,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:44,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:44,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:44,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:44,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:44,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:44,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:52:45,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:45,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:45,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:45,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:45,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:45,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:45,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:45,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:45,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:45,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:45,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:45,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:45,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:45,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:45,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:45,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:46,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:52:48,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:48,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:48,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:48,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:48,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:48,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:48,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:48,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:48,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:48,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:48,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:48,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:48,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:48,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:48,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:48,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:48,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:48,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:48,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:48,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:48,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:48,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:48,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:48,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:48,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:48,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:48,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:48,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:48,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:48,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:48,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:48,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:48,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:52:51,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:51,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:51,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:51,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:51,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:51,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:51,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:51,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:51,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:51,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:51,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:51,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:51,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:51,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:51,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:51,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:52,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:52:53,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:53,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:53,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:53,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:53,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:53,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:53,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:53,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:53,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:53,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:53,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:53,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:53,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:53,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:53,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:53,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:54,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:52:56,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:52:58,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:52:58,287 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:52:58,515 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:52:58,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:52:59,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:59,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:59,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:59,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:59,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:59,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:59,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:59,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:59,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:59,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:59,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:59,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:59,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:59,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:59,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:52:59,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:00,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:00,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:00,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:00,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:00,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:00,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:00,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:00,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:00,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:00,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:00,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:00,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:00,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:00,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:00,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:00,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:00,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:00,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:00,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:00,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:00,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:00,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:00,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:00,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:00,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:00,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:00,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:00,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:00,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:00,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:00,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:00,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:00,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:53:02,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:02,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:02,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:02,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:02,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:02,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:02,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:02,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:02,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:02,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:02,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:02,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:02,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:02,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:02,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:02,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:02,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:02,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:02,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:02,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:02,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:02,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:02,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:02,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:02,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:02,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:02,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:02,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:02,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:02,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:02,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:02,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:02,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:53:04,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:53:05,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:05,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:05,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:05,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:05,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:05,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:05,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:05,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:05,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:05,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:05,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:05,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:05,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:05,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:05,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:05,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:06,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:53:08,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:53:10,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:53:11,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:11,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:11,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:11,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:11,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:11,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:11,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:11,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:11,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:11,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:11,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:11,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:11,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:11,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:11,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:11,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:12,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:53:13,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:13,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:13,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:13,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:13,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:13,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:13,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:13,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:13,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:13,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:13,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:13,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:13,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:13,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:13,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:13,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:13,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:13,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:13,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:13,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:13,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:13,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:13,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:13,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:13,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:13,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:13,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:13,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:13,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:13,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:13,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:13,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:13,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:53:13,516 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:53:14,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:14,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:14,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:14,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:14,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:14,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:14,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:14,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:14,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:14,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:14,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:14,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:14,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:14,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:14,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:14,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:14,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:14,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:14,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:14,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:14,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:14,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:14,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:14,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:14,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:14,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:14,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:14,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:14,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:14,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:14,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:14,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:14,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:53:16,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:53:18,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:18,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:18,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:18,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:18,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:18,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:18,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:18,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:18,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:18,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:18,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:18,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:18,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:18,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:18,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:18,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:18,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:18,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:18,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:18,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:18,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:18,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:18,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:18,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:18,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:18,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:18,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:18,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:18,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:18,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:18,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:18,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:18,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:53:19,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:19,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:19,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:19,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:19,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:19,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:19,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:19,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:19,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:19,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:19,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:19,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:19,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:19,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:19,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:19,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:20,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:20,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:20,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:20,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:20,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:20,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:20,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:20,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:20,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:20,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:20,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:20,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:20,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:20,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:20,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:20,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:20,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:20,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:20,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:20,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:20,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:20,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:20,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:20,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:20,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:20,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:20,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:20,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:20,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:20,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:20,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:20,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:20,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:53:21,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:21,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:21,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:21,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:21,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:21,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:21,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:21,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:21,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:21,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:21,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:21,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:21,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:21,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:21,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:21,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:22,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:53:24,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:53:25,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:25,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:25,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:25,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:25,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:25,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:25,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:25,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:25,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:25,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:25,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:25,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:25,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:25,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:25,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:25,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:25,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:25,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:25,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:25,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:25,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:25,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:25,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:25,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:25,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:25,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:25,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:25,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:25,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:25,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:25,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:25,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:26,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:26,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:26,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:26,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:26,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:26,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:26,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:26,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:26,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:26,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:26,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:26,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:26,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:26,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:26,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:26,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:26,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:53:27,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:27,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:28,504 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:53:28,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:53:28,803 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:53:28,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:53:29,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:29,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:29,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:29,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:29,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:29,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:29,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:29,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:29,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:29,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:29,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:29,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:29,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:29,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:29,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:29,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:30,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:30,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:30,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:30,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:30,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:30,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:30,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:30,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:30,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:30,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:30,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:30,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:30,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:30,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:30,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:30,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:30,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:53:31,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:31,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:31,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:31,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:31,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:31,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:31,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:31,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:31,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:31,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:31,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:31,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:31,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:31,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:31,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:31,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:32,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:53:34,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:53:42,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:53:44,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:53:44,099 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:53:46,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:46,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:46,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:46,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:46,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:46,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:46,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:46,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:46,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:46,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:46,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:46,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:46,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:46,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:46,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:46,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:48,882 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:53:52,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:53:53,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:53,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:53,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:53,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:53,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:53,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:53,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:53,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:53,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:53,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:53,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:53,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:53,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:53,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:53,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:53,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:53:56,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:53:58,582 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:53:59,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:53:59,524 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:54:00,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:54:04,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:54:06,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:54:06,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:06,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:06,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:06,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:06,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:06,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:06,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:06,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:06,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:06,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:06,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:06,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:06,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:06,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:06,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:06,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:07,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:07,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:07,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:07,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:07,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:07,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:07,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:07,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:07,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:07,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:07,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:07,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:07,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:07,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:07,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:07,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:10,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:54:13,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:13,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:13,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:13,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:13,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:13,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:13,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:13,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:13,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:13,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:13,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:13,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:13,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:13,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:13,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:13,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:14,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:54:14,745 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:54:14,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:54:16,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:16,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:16,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:16,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:16,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:16,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:16,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:16,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:16,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:16,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:16,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:16,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:16,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:16,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:16,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:16,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:16,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:54:20,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:54:22,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:54:24,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:54:28,657 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:54:28,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:54:30,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:54:30,045 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:54:30,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:54:32,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:32,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:32,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:32,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:32,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:32,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:32,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:32,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:32,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:32,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:32,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:32,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:32,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:32,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:32,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:32,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:32,900 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:54:33,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:33,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:33,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:33,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:33,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:33,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:33,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:33,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:33,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:33,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:33,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:33,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:33,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:33,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:33,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:33,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:34,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:34,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:34,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:34,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:34,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:34,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:34,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:34,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:34,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:34,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:34,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:34,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:34,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:34,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:34,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:34,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:35,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:35,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:35,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:35,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:35,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:35,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:35,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:35,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:35,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:35,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:35,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:35,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:35,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:35,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:35,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:35,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:36,902 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:54:38,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:38,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:38,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:38,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:38,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:38,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:38,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:38,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:38,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:38,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:38,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:38,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:38,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:38,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:38,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:38,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:38,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:54:40,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:40,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:40,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:40,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:40,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:40,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:40,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:40,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:40,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:40,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:40,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:40,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:40,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:40,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:40,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:40,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:40,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:40,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:40,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:40,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:40,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:40,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:40,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:40,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:40,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:40,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:40,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:40,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:40,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:40,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:40,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:40,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:40,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:54:42,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:54:45,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:45,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:45,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:45,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:45,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:45,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:45,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:45,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:45,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:45,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:45,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:45,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:45,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:54:45,297 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:54:45,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:45,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:45,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:45,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:45,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:45,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:45,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:45,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:45,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:45,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:45,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:45,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:45,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:45,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:45,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:45,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:45,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:45,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:45,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:45,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:46,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:46,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:46,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:46,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:46,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:46,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:46,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:46,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:46,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:46,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:46,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:46,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:46,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:46,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:46,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:46,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:46,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:54:47,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:47,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:47,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:47,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:47,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:47,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:47,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:47,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:47,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:47,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:47,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:47,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:47,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:47,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:47,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:47,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:48,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:54:49,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:49,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:49,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:49,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:49,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:49,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:49,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:49,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:49,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:49,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:49,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:49,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:49,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:49,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:49,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:49,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:49,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:49,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:49,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:49,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:49,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:49,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:49,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:49,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:49,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:49,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:49,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:49,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:49,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:49,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:49,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:49,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:50,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:54:52,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:54:54,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:54,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:54,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:54,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:54,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:54,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:54,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:54,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:54,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:54,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:54,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:54,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:54,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:54,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:54,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:54,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:54,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:54:56,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:54:58,733 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:54:58,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:54:59,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:59,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:59,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:59,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:59,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:59,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:59,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:59,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:59,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:59,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:59,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:59,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:59,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:59,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:59,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:54:59,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:00,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:00,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:00,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:00,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:00,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:00,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:00,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:00,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:00,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:00,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:00,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:00,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:00,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:00,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:00,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:00,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:00,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:55:00,606 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:55:00,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:55:01,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:01,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:01,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:01,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:01,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:01,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:01,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:01,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:01,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:01,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:01,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:01,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:01,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:01,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:01,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:01,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:02,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:55:03,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:03,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:03,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:03,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:03,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:03,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:03,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:03,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:03,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:03,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:03,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:03,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:03,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:03,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:03,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:03,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:03,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:03,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:03,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:03,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:03,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:03,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:03,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:03,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:03,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:03,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:03,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:03,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:03,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:03,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:03,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:03,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:04,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:55:05,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:05,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:05,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:05,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:05,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:05,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:05,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:05,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:05,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:05,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:05,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:05,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:05,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:05,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:05,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:05,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:06,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:55:08,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:55:09,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:09,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:09,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:09,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:09,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:09,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:09,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:09,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:09,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:09,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:09,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:09,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:09,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:09,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:09,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:09,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:10,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:10,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:10,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:10,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:10,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:10,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:10,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:10,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:10,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:10,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:10,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:10,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:10,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:10,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:10,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:10,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:11,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:11,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:11,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:11,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:11,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:11,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:11,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:11,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:11,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:11,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:11,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:11,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:11,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:11,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:11,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:11,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:11,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:55:13,916 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:55:14,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:14,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:14,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:14,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:14,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:14,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:14,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:14,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:14,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:14,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:14,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:14,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:14,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:14,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:14,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:14,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:14,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:14,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:14,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:14,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:14,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:14,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:14,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:14,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:14,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:14,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:14,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:14,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:14,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:14,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:14,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:14,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:15,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:55:15,858 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:55:15,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:55:16,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:16,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:16,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:16,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:16,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:16,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:16,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:16,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:16,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:16,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:16,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:16,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:16,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:16,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:16,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:16,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:17,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:55:18,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:18,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:19,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:19,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:19,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:19,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:19,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:19,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:19,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:19,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:19,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:19,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:19,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:19,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:19,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:19,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:19,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:19,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:19,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:55:20,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:20,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:20,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:20,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:20,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:20,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:20,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:20,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:20,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:20,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:20,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:20,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:20,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:20,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:20,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:20,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:21,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:55:22,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:22,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:22,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:22,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:22,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:22,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:22,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:22,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:22,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:22,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:22,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:22,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:22,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:22,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:22,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:22,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:23,921 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:55:23,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:23,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:23,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:23,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:23,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:23,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:23,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:23,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:23,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:23,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:23,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:23,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:23,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:23,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:23,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:23,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:24,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:24,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:24,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:24,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:24,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:24,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:24,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:24,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:24,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:24,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:24,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:24,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:24,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:24,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:24,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:24,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:24,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:24,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:24,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:24,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:24,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:24,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:24,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:24,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:24,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:24,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:24,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:24,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:24,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:24,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:24,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:24,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:25,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:25,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:25,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:25,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:25,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:25,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:25,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:25,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:25,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:25,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:25,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:25,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:25,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:25,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:25,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:25,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:25,922 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:55:26,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:26,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:26,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:26,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:26,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:26,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:26,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:26,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:26,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:26,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:26,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:26,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:26,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:26,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:26,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:26,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:27,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:27,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:27,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:27,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:27,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:27,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:27,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:27,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:27,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:27,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:27,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:27,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:27,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:27,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:27,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:27,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:27,922 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:55:28,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:28,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:28,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:28,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:28,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:28,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:28,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:28,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:28,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:28,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:28,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:28,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:28,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:28,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:28,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:28,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:28,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:28,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:28,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:28,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:28,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:28,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:28,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:28,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:28,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:28,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:28,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:28,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:28,807 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:55:28,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:29,038 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 08:55:29,274 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 08:55:29,355 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 08:55:29,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 08:55:29,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:55:30,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:55:31,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:55:31,186 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:55:31,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:55:36,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:36,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:36,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:36,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:36,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:36,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:36,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:36,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:36,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:36,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:36,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:36,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:36,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:36,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:36,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:36,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:39,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:39,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:39,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:39,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:39,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:39,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:39,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:39,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:39,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:39,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:39,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:39,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:39,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:39,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:39,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:39,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:39,927 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:55:43,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:55:46,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:55:46,411 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:55:49,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:55:50,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:50,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:50,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:50,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:50,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:50,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:50,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:50,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:50,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:50,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:50,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:50,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:50,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:50,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:50,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:50,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:53,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:55:55,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:55,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:55,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:55,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:55,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:55,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:55,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:55,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:55,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:55,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:55,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:55,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:55,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:55,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:55,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:55,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:56,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:56,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:56,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:56,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:56,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:56,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:56,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:56,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:56,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:56,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:56,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:56,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:56,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:56,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:56,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:56,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:55:57,935 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:55:58,930 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:55:59,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:56:01,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:56:01,645 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:56:03,937 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:56:07,939 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:56:10,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:10,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:10,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:10,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:10,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:10,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:10,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:10,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:10,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:10,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:10,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:10,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:10,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:10,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:10,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:10,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:10,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:10,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:10,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:10,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:10,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:10,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:10,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:10,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:10,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:10,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:10,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:10,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:10,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:10,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:10,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:10,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:11,941 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:56:13,942 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:56:15,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:15,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:15,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:15,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:15,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:15,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:15,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:15,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:15,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:15,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:15,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:15,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:15,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:15,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:15,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:15,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:16,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:56:16,873 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:56:17,944 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:56:18,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:18,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:18,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:18,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:18,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:18,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:18,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:18,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:18,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:18,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:18,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:18,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:18,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:18,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:18,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:18,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:19,945 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:56:23,947 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:56:25,948 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:56:27,949 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:56:29,011 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:56:29,950 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:56:32,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:56:32,229 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:56:32,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:32,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:32,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:32,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:32,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:32,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:32,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:32,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:32,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:32,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:32,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:32,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:32,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:32,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:32,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:32,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:33,952 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:56:35,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:35,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:35,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:35,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:35,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:35,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:35,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:35,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:35,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:35,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:35,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:35,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:35,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:35,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:35,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:35,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:35,952 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:56:37,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:37,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:37,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:37,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:37,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:37,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:37,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:37,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:37,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:37,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:37,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:37,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:37,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:37,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:37,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:37,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:37,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:37,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:37,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:37,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:37,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:37,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:37,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:37,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:37,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:37,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:37,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:37,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:37,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:37,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:37,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:37,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:37,953 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:56:38,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:38,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:38,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:38,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:38,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:38,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:38,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:38,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:38,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:38,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:38,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:38,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:38,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:38,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:38,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:38,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:39,954 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:56:41,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:41,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:41,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:41,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:41,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:41,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:41,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:41,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:41,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:41,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:41,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:41,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:41,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:41,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:41,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:41,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:41,955 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:56:43,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:43,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:43,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:43,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:43,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:43,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:43,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:43,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:43,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:43,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:43,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:43,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:43,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:43,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:43,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:43,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:45,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:45,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:45,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:45,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:45,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:45,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:45,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:45,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:45,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:45,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:45,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:45,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:45,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:45,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:45,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:45,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:45,957 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:56:46,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:46,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:46,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:46,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:46,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:46,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:46,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:46,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:46,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:46,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:46,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:46,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:46,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:46,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:46,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:46,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:47,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:56:47,449 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:56:47,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:47,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:47,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:47,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:47,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:47,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:47,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:47,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:47,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:47,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:47,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:47,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:47,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:47,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:47,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:47,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:47,958 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:56:48,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:48,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:48,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:48,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:48,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:48,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:48,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:48,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:48,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:48,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:48,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:48,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:48,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:48,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:48,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:48,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:49,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:49,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:49,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:49,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:49,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:49,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:49,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:49,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:49,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:49,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:49,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:49,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:49,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:49,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:49,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:49,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:50,959 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:56:52,960 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:56:53,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:53,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:53,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:53,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:53,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:53,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:53,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:53,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:53,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:53,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:53,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:53,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:53,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:53,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:53,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:53,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:54,961 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:56:56,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:56,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:56,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:56,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:56,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:56,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:56,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:56,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:56,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:56,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:56,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:56,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:56,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:56,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:56,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:56,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:56,961 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:56:58,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:56:59,082 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:56:59,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:59,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:59,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:59,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:59,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:59,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:59,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:59,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:59,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:59,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:59,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:59,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:59,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:59,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:59,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:59,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:59,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:59,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:59,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:59,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:59,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:59,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:59,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:59,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:59,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:59,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:59,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:59,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:59,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:59,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:59,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:56:59,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:00,963 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:57:02,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:57:02,727 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:57:02,964 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:57:03,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:03,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:03,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:03,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:03,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:03,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:03,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:03,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:03,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:03,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:03,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:03,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:03,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:03,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:03,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:03,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:04,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:04,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:04,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:04,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:04,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:04,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:04,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:04,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:04,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:04,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:04,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:04,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:04,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:04,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:04,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:04,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:04,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:04,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:04,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:04,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:04,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:04,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:04,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:04,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:04,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:04,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:04,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:04,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:04,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:04,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:04,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:04,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:04,965 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:57:05,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:05,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:05,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:05,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:05,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:05,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:05,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:05,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:05,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:05,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:05,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:05,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:05,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:05,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:05,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:05,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:06,966 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:57:08,967 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:57:09,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:09,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:09,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:09,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:09,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:09,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:09,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:09,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:09,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:09,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:09,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:09,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:09,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:09,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:09,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:09,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:10,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:10,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:10,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:10,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:10,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:10,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:10,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:10,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:10,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:10,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:10,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:10,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:10,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:10,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:10,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:10,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:10,968 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:57:11,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:11,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:11,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:11,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:11,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:11,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:11,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:11,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:11,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:11,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:11,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:11,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:11,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:11,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:11,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:11,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:12,970 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:57:14,971 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:57:15,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:15,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:15,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:15,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:15,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:15,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:15,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:15,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:15,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:15,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:15,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:15,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:15,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:15,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:15,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:15,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:15,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:15,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:15,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:15,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:15,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:15,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:15,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:15,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:15,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:15,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:15,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:15,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:15,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:15,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:15,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:15,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:16,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:16,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:16,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:16,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:16,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:16,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:16,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:16,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:16,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:16,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:16,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:16,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:16,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:16,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:16,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:16,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:16,972 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:57:17,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:17,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:17,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:17,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:17,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:17,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:17,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:17,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:17,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:17,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:17,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:17,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:17,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:17,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:17,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:17,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:17,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:57:17,997 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:57:18,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:18,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:18,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:18,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:18,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:18,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:18,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:18,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:18,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:18,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:18,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:18,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:18,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:18,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:18,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:18,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:18,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:18,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:18,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:18,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:18,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:18,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:18,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:18,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:18,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:18,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:18,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:18,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:18,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:18,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:18,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:18,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:18,972 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:57:20,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:20,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:20,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:20,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:20,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:20,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:20,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:20,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:20,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:20,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:20,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:20,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:20,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:20,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:20,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:20,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:20,973 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:57:21,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:21,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:21,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:21,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:21,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:21,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:21,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:21,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:21,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:21,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:21,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:21,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:21,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:21,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:21,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:21,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:22,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:22,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:22,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:22,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:22,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:22,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:22,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:22,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:22,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:22,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:22,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:22,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:22,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:22,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:22,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:22,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:22,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:22,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:22,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:22,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:22,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:22,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:22,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:22,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:22,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:22,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:22,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:22,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:22,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:22,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:22,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:22,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:22,974 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:57:24,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:24,976 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:57:25,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:25,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:25,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:25,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:25,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:25,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:25,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:25,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:25,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:25,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:25,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:25,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:25,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:25,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:25,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:25,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:25,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:25,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:25,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:25,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:25,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:25,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:25,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:25,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:25,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:25,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:25,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:25,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:26,977 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:57:28,977 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:57:29,151 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:57:33,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:57:33,492 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:57:38,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:38,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:38,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:38,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:38,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:38,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:38,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:38,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:38,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:38,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:38,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:38,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:38,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:38,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:38,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:38,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:38,980 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:57:42,982 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:57:47,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:47,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:47,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:47,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:47,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:47,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:47,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:47,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:47,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:47,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:47,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:47,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:47,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:47,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:47,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:47,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:48,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:57:48,953 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:57:48,984 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:57:51,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:51,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:51,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:51,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:51,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:51,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:51,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:51,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:51,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:51,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:51,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:51,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:51,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:51,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:51,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:51,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:52,986 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:57:55,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:55,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:55,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:55,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:55,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:55,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:55,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:55,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:55,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:55,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:55,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:55,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:55,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:55,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:55,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:55,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:56,987 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:57:58,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:57:59,223 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:57:59,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:59,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:59,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:59,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:59,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:59,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:59,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:59,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:59,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:59,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:59,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:59,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:59,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:59,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:59,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:57:59,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:01,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:01,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:01,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:01,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:01,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:01,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:01,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:01,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:01,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:01,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:01,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:01,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:01,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:01,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:01,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:01,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:02,989 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:58:04,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:58:04,171 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:58:06,991 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:58:08,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:08,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:08,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:08,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:08,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:08,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:08,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:08,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:08,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:08,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:08,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:08,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:08,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:08,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:08,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:08,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:10,992 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:58:12,993 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:58:16,995 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:58:17,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:17,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:17,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:17,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:17,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:17,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:17,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:17,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:17,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:17,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:17,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:17,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:17,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:17,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:17,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:17,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:18,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:18,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:18,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:18,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:18,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:18,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:18,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:18,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:18,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:18,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:18,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:18,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:18,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:18,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:18,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:18,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:18,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:58:19,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:19,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:19,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:19,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:19,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:19,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:19,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:19,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:19,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:19,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:19,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:19,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:19,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:19,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:19,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:19,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:19,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:58:19,397 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:58:22,998 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:58:24,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:58:28,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:28,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:28,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:28,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:28,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:28,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:28,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:28,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:28,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:28,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:28,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:28,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:28,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:28,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:28,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:28,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:29,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:58:29,298 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:58:31,001 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:58:33,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:58:34,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:58:34,754 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:58:35,003 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:58:36,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:36,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:36,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:36,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:36,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:36,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:36,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:36,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:36,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:36,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:36,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:36,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:36,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:36,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:36,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:36,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:37,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:37,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:37,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:37,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:37,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:37,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:37,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:37,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:37,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:37,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:37,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:37,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:37,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:37,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:37,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:37,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:37,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:37,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:37,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:37,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:37,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:37,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:37,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:37,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:37,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:37,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:37,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:37,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:37,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:37,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:37,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:37,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:40,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:58:42,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:58:44,008 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:58:45,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:45,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:45,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:45,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:45,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:45,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:45,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:45,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:45,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:45,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:45,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:45,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:45,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:45,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:45,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:45,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:46,008 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:58:47,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:47,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:47,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:47,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:47,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:47,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:47,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:47,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:47,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:47,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:47,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:47,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:47,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:47,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:47,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:47,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:47,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:47,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:47,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:47,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:47,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:47,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:47,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:47,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:47,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:47,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:47,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:47,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:47,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:47,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:47,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:47,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:48,009 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:58:48,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:48,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:48,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:48,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:48,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:48,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:48,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:48,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:48,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:48,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:48,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:48,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:48,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:48,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:48,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:48,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:50,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:58:50,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:58:50,034 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:58:51,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:51,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:51,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:51,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:51,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:51,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:51,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:51,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:51,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:51,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:51,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:51,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:51,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:51,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:51,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:51,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:51,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:51,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:51,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:51,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:51,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:51,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:51,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:51,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:51,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:51,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:51,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:51,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:51,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:51,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:51,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:51,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:52,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:58:52,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:52,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:52,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:52,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:52,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:52,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:52,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:52,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:52,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:52,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:52,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:52,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:52,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:52,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:52,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:52,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:52,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:52,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:52,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:52,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:52,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:52,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:52,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:52,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:52,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:52,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:52,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:52,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:52,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:52,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:52,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:52,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:54,012 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:58:55,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:55,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:55,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:55,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:55,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:55,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:55,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:55,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:55,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:55,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:55,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:55,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:55,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:55,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:55,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:55,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:55,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:55,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:55,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:55,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:55,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:55,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:55,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:55,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:55,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:55,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:55,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:55,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:55,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:55,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:55,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:55,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:58:56,013 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:58:58,014 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:58:59,372 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:59:00,015 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:59:02,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:59:02,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:02,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:02,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:02,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:02,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:02,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:02,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:02,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:02,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:02,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:02,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:02,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:02,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:02,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:02,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:02,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:04,017 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:59:05,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:59:05,325 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:59:06,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:59:06,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:06,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:06,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:06,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:06,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:06,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:06,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:06,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:06,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:06,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:06,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:06,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:06,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:06,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:06,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:06,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:06,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:06,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:06,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:06,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:06,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:06,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:06,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:06,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:06,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:06,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:06,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:06,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:06,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:06,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:06,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:06,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:07,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:07,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:07,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:07,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:07,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:07,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:07,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:07,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:07,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:07,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:07,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:07,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:07,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:07,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:07,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:07,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:08,019 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:59:08,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:08,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:08,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:08,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:08,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:08,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:08,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:08,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:08,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:08,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:08,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:08,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:08,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:08,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:08,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:08,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:10,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:59:10,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:10,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:10,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:10,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:10,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:10,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:10,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:10,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:10,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:10,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:10,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:10,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:10,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:10,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:10,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:10,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:12,021 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:59:12,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:12,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:12,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:12,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:12,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:12,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:12,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:12,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:12,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:12,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:12,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:12,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:12,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:12,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:12,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:12,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:59:14,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:14,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:16,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:59:17,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:17,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:17,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:17,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:17,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:17,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:17,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:17,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:17,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:17,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:17,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:17,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:17,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:17,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:17,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:17,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:18,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:59:18,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:18,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:18,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:18,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:18,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:18,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:18,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:18,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:18,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:18,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:18,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:18,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:18,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:18,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:18,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:18,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:20,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:59:20,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:59:20,550 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:59:22,025 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:59:22,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:22,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:23,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:23,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:23,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:23,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:23,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:23,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:23,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:23,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:23,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:23,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:23,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:23,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:23,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:23,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:23,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:23,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:24,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:59:24,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:24,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:24,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:24,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:24,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:24,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:24,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:24,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:24,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:24,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:24,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:24,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:24,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:24,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:24,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:24,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:25,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:25,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:25,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:25,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:25,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:25,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:25,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:25,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:25,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:25,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:25,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:25,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:25,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:25,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:25,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:25,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:25,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:25,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:25,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:25,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:25,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:25,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:25,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:25,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:25,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:25,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:25,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:25,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:25,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:25,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:25,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:25,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:26,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:59:26,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:26,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:26,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:26,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:26,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:26,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:26,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:26,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:26,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:26,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:26,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:26,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:26,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:26,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:26,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:26,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:26,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:26,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:26,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:26,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:27,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:27,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:27,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:27,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:27,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:27,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:27,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:27,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:27,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 08:59:27,276 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 08:59:27,502 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 08:59:27,567 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 08:59:28,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 08:59:28,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:59:29,572 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 08:59:30,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:59:32,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:59:34,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:59:35,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:59:35,801 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:59:36,031 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:59:38,031 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:59:40,032 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:59:42,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:59:44,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:59:46,034 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:59:48,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:59:50,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:59:51,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 08:59:51,053 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 08:59:52,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:59:54,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:59:56,038 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:59:58,039 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 08:59:59,648 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:00:00,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:00:02,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:00:04,041 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:00:06,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:00:06,278 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:00:07,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:00:09,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:00:11,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:00:13,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:00:15,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:00:17,047 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:00:19,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:00:21,049 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:00:21,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:00:21,507 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:00:23,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:00:25,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:00:27,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:00:29,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:00:29,722 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:00:31,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:00:33,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:00:35,056 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:00:36,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:00:36,851 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:00:37,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:00:39,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:00:41,059 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:00:43,059 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:00:45,060 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:00:47,061 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:00:49,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:00:51,063 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:00:52,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:00:52,104 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:00:53,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:00:55,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:00:57,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:00:59,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:00:59,796 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:01:01,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:01:03,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:01:05,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:01:07,071 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:01:07,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:01:07,332 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:01:09,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:01:11,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:01:13,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:01:15,074 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:01:17,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:01:19,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:01:21,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:01:22,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:01:22,604 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:01:23,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:01:25,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:01:27,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:01:29,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:01:29,870 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:01:31,081 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:01:33,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:01:35,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:01:37,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:01:37,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:01:37,829 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:01:39,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:01:41,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:01:44,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:01:46,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:01:48,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:01:50,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:01:52,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:01:53,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:01:53,163 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:01:54,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:01:56,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:01:58,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:01:59,946 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:02:00,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:02:02,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:02:04,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:02:06,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:02:08,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:02:08,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:02:08,398 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:02:10,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:02:12,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:02:14,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:02:16,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:02:18,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:02:20,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:02:22,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:02:23,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:02:23,631 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:02:24,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:02:26,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:02:28,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:02:30,021 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:02:30,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:02:32,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:02:34,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:02:36,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:02:38,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:02:38,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:02:38,851 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:02:40,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:02:42,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:02:44,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:02:46,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:02:48,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:02:50,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:02:52,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:02:54,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:02:54,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:02:54,214 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:02:56,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:02:58,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:03:00,095 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:03:00,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:03:02,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:03:04,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:03:06,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:03:08,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:03:09,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:03:09,449 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:03:10,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:03:12,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:03:14,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:03:16,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:03:18,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:03:20,121 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:03:22,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:03:24,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:03:24,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:03:24,757 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:03:27,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:03:29,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:03:30,170 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:03:31,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:03:33,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:03:35,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:03:37,128 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:03:39,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:03:39,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:03:39,979 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:03:41,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:03:43,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:03:45,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:03:47,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:03:49,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:03:51,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:03:53,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:03:55,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:03:55,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:03:55,203 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:03:57,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:03:59,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:04:00,243 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:04:01,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:04:03,140 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:04:05,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:04:07,142 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:04:09,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:04:10,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:04:10,439 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:04:11,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:04:13,145 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:04:15,146 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:04:17,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:04:19,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:04:21,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:04:23,150 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:04:25,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:04:25,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:04:25,708 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:04:27,152 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:04:29,152 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:04:30,319 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:04:31,153 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:04:33,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:04:35,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:04:37,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:04:39,157 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:04:40,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:04:40,967 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:04:41,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:04:43,159 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:04:45,160 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:04:47,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:04:49,162 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:04:51,163 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:04:54,164 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:04:56,165 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:04:56,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:04:56,209 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:04:58,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:05:00,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:05:00,396 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:05:02,168 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:05:04,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:05:06,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:05:08,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:05:10,172 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:05:11,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:05:11,449 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:05:12,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:05:14,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:05:16,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:05:18,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:05:20,175 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:05:22,176 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:05:24,176 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:05:26,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:05:26,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:05:26,672 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:05:28,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:05:30,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:05:30,470 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:05:32,179 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:05:34,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:05:36,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:05:38,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:05:40,182 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:05:41,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:05:41,998 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:05:42,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:05:44,184 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:05:46,185 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:05:48,186 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:05:50,187 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:05:52,188 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:05:54,189 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:05:56,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:05:57,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:05:57,345 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:05:58,191 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:06:00,191 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:06:00,539 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:06:02,192 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:06:04,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:06:06,194 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:06:08,195 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:06:10,196 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:06:12,196 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:06:12,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:06:12,636 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:06:14,197 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:06:16,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:06:18,199 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:06:21,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:06:23,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:06:25,202 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:06:27,203 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:06:27,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:06:27,970 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:06:29,204 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:06:30,615 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:06:31,205 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:06:33,206 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:06:35,207 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:06:37,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:06:39,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:06:41,209 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:06:43,210 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:06:43,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:06:43,353 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:06:45,211 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:06:47,211 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:06:49,212 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:06:51,213 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:06:53,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:06:55,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:06:57,215 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:06:58,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:06:58,709 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:06:59,216 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:07:00,693 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:07:01,217 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:07:03,218 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:07:05,219 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:07:07,220 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:07:09,221 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:07:11,222 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:07:13,222 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:07:14,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:07:14,074 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:07:15,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:07:17,224 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:07:19,225 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:07:21,226 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:07:23,227 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:07:25,228 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:07:27,229 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:07:29,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:07:29,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:07:29,302 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:07:30,768 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:07:31,231 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:07:33,232 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:07:35,233 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:07:37,234 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:07:39,235 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:07:41,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:07:43,237 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:07:44,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:07:44,681 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:07:45,238 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:07:47,239 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:07:49,240 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:07:51,241 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:07:53,242 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:07:56,243 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:07:58,245 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:07:59,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:07:59,911 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:08:00,245 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:08:00,843 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:08:02,246 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:08:04,247 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:08:06,248 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:08:08,249 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:08:10,250 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:08:12,250 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:08:14,251 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:08:15,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:08:15,138 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:08:16,253 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:08:18,253 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:08:20,254 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:08:22,255 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:08:24,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:08:26,257 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:08:28,258 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:08:30,258 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:08:30,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:08:30,518 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:08:30,919 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:08:32,259 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:08:34,260 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:08:36,261 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:08:38,262 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:08:40,263 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:08:42,264 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:08:44,264 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:08:45,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:08:45,740 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:08:46,265 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:08:48,266 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:08:50,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:08:52,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:08:54,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:08:56,270 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:08:58,270 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:09:00,271 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:09:00,994 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:09:01,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:09:01,184 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:09:02,272 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:09:04,273 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:09:06,274 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:09:09,275 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:09:11,276 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:09:13,277 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:09:15,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:09:16,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:09:16,445 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:09:17,279 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:09:19,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:09:21,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:09:23,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:09:25,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:09:27,283 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:09:29,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:09:31,070 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:09:31,285 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:09:31,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:09:31,703 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:09:33,286 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:09:35,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:09:37,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:09:39,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:09:41,290 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:09:43,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:09:45,292 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:09:46,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:09:46,976 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:09:47,292 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:09:49,293 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:09:51,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:09:53,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:09:55,296 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:09:57,297 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:09:59,298 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:10:01,146 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:10:01,299 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:10:02,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:10:02,816 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:10:03,300 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:10:05,301 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:10:07,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:10:09,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:10:11,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:10:13,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:10:15,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:10:17,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:10:18,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:10:18,041 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:10:19,306 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:10:21,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:10:23,308 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:10:25,308 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:10:27,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:10:29,310 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:10:31,219 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:10:31,311 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:10:33,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:10:33,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:10:33,495 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:10:35,313 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:10:37,314 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:10:39,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:10:41,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:10:43,316 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:10:45,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:10:47,318 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:10:48,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:10:48,912 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:10:50,319 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:10:52,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:10:54,321 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:10:56,322 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:10:58,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:11:00,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:11:01,295 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:11:02,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:11:04,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:11:04,182 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:11:04,326 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:11:06,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:11:08,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:11:10,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:11:12,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:11:14,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:11:16,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:11:18,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:11:19,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:11:19,449 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:11:20,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:11:22,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:11:24,335 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:11:26,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:11:28,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:11:30,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:11:31,368 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:11:32,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:11:34,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:11:34,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:11:34,678 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:11:36,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:11:38,342 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:11:40,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:11:42,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:11:44,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:11:46,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:11:48,346 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:11:50,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:11:50,152 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:11:50,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:11:52,348 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:11:54,350 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:11:56,350 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:11:58,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:12:00,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:12:01,443 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:12:02,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:12:04,354 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:12:05,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:12:05,386 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:12:06,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:12:08,356 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:12:10,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:12:12,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:12:14,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:12:17,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:12:19,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:12:20,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:12:20,662 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:12:21,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:12:23,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:12:25,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:12:27,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:12:29,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:12:31,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:12:31,518 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:12:33,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:12:35,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:12:35,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:12:35,882 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:12:37,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:12:39,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:12:41,371 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:12:43,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:12:45,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:12:47,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:12:49,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:12:51,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:12:51,254 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:12:51,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:12:53,376 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:12:55,377 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:12:57,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:12:59,379 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:13:01,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:13:01,594 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:13:03,381 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:13:05,382 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:13:06,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:13:06,712 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:13:07,382 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:13:09,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:13:11,384 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:13:13,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:13:15,386 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:13:17,387 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:13:19,388 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:13:21,389 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:13:22,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:13:22,031 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:13:23,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:13:25,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:13:27,391 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:13:29,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:13:31,393 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:13:31,668 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:13:33,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:13:35,395 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:13:37,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:13:37,256 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:13:37,396 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:13:39,396 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:13:41,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:13:43,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:13:46,399 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:13:48,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:13:50,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:13:52,402 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:13:52,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:13:52,564 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:13:54,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:13:56,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:13:58,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:14:00,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:14:01,743 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:14:02,406 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:14:04,407 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:14:06,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:14:07,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:14:07,895 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:14:08,409 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:14:10,409 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:14:12,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:14:14,411 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:14:16,411 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:14:18,412 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:14:20,413 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:14:22,414 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:14:23,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:14:23,117 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:14:24,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:14:26,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:14:28,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:14:30,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:14:31,817 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:14:32,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:14:34,419 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:14:36,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:14:38,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:14:38,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:14:38,523 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:14:40,421 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:14:42,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:14:44,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:14:46,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:14:48,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:14:50,425 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:14:52,425 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:14:53,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:14:53,816 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:14:54,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:14:56,427 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:14:58,428 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:15:00,429 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:15:01,893 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:15:02,430 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:15:05,431 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:15:07,432 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:15:09,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:15:09,053 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:15:09,433 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:15:11,434 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:15:13,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:15:15,436 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:15:17,437 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:15:19,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:15:21,439 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:15:23,440 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:15:24,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:15:24,287 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:15:25,441 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:15:27,442 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:15:29,443 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:15:31,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:15:31,969 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:15:33,445 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:15:35,445 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:15:37,446 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:15:39,447 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:15:39,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:15:39,576 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:15:41,448 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:15:43,449 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:15:45,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:15:47,451 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:15:49,452 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:15:51,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:15:53,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:15:54,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:15:54,800 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:15:55,455 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:15:57,456 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:15:59,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:16:01,458 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:16:02,042 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:16:03,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:16:05,460 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:16:07,461 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:16:09,462 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:16:10,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:16:10,023 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:16:11,463 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:16:13,464 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:16:15,464 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:16:17,465 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:16:19,466 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:16:21,467 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:16:23,467 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:16:25,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:16:25,369 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:16:25,468 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:16:27,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:16:29,470 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:16:31,470 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:16:32,114 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:16:33,471 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:16:35,472 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:16:37,473 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:16:39,473 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:16:40,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:16:40,662 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:16:41,474 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:16:43,475 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:16:46,476 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:16:48,477 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:16:50,478 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:16:52,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:16:54,480 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:16:55,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:16:55,923 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:16:56,481 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:16:58,482 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:17:00,482 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:17:02,188 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:17:02,483 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:17:04,484 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:17:06,485 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:17:08,486 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:17:10,486 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:17:11,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:17:11,336 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:17:12,487 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:17:14,488 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:17:16,489 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:17:18,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:17:20,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:17:22,491 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:17:24,492 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:17:26,493 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:17:26,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:17:26,590 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:17:28,494 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:17:30,495 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:17:32,262 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:17:32,496 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:17:34,497 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:17:36,498 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:17:38,499 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:17:40,500 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:17:41,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:17:41,855 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:17:42,500 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:17:44,501 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:17:46,502 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:17:48,503 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:17:50,504 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:17:52,505 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:17:54,506 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:17:56,506 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:17:57,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:17:57,078 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:17:58,507 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:18:00,508 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:18:02,329 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:18:02,509 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:18:04,510 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:18:07,511 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:18:09,512 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:18:11,513 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:18:12,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:18:12,559 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:18:13,514 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:18:15,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:18:17,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:18:19,516 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:18:21,517 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:18:23,518 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:18:25,519 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:18:27,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:18:27,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:18:27,798 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:18:29,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:18:31,521 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:18:32,387 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:18:33,522 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:18:35,523 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:18:37,523 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:18:39,524 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:18:41,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:18:43,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:18:43,089 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:18:43,526 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:18:45,527 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:18:47,528 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:18:49,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:18:51,530 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:18:53,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:18:55,532 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:18:57,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:18:58,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:18:58,382 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:18:59,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:19:01,534 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:19:02,457 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:19:03,535 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:19:05,536 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:19:07,537 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:19:09,538 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:19:11,539 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:19:13,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:19:13,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:19:13,633 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:19:15,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:19:17,541 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:19:19,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:19:21,543 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:19:23,544 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:19:25,545 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:19:27,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:19:28,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:19:28,957 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:19:29,547 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:19:31,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:19:32,532 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:19:33,549 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:19:35,549 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:19:37,550 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:19:39,551 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:19:41,551 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:19:43,552 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:19:44,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:19:44,194 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:19:46,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:19:48,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:19:50,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:19:52,555 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:19:54,556 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:19:56,556 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:19:58,557 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:19:59,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:19:59,549 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:20:00,558 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:20:02,559 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:20:02,607 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:20:04,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:20:06,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:20:08,561 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:20:10,562 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:20:12,562 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:20:14,563 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:20:14,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:20:14,876 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:20:16,564 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:20:18,564 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:20:20,565 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:20:22,565 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:20:24,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:20:26,567 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:20:28,568 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:20:30,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:20:30,191 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:20:30,568 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:20:32,569 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:20:32,660 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:20:34,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:20:36,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:20:38,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:20:40,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:20:42,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:20:44,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:20:45,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:20:45,415 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:20:46,574 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:20:48,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:20:50,576 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:20:52,576 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:20:54,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:20:56,578 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:20:58,579 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:21:00,580 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:21:00,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:21:00,752 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:21:02,580 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:21:02,723 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:21:05,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:21:07,583 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:21:09,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:21:11,585 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:21:13,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:21:15,587 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:21:15,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:21:15,977 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:21:17,588 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:21:19,589 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:21:21,590 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:21:23,591 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:21:25,592 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:21:27,593 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:21:29,593 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:21:31,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:21:31,346 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:21:31,594 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:21:32,795 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:21:33,595 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:21:35,596 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:21:37,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:21:39,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:21:41,598 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:21:43,599 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:21:45,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:21:46,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:21:46,599 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:21:47,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:21:49,603 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:21:51,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:21:53,605 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:21:55,606 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:21:57,607 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:21:59,608 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:22:01,608 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:22:01,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:22:01,855 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:22:02,869 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:22:03,609 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:22:05,610 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:22:07,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:22:09,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:22:11,613 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:22:13,613 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:22:15,614 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:22:17,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:22:17,216 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:22:17,615 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:22:19,615 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:22:22,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:22:24,617 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:22:26,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:22:28,619 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:22:30,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:22:32,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:22:32,441 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:22:32,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:22:32,944 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:22:34,621 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:22:36,622 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:22:38,623 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:22:40,624 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:22:42,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:22:44,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:22:46,626 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:22:47,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:22:47,749 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:22:48,626 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:22:50,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:22:52,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:22:54,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:22:56,629 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:22:58,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:23:00,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:23:02,631 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:23:03,015 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:23:03,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:23:03,028 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:23:04,631 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:23:06,632 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:23:08,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:23:10,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:23:12,634 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:23:14,635 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:23:16,635 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:23:18,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:23:18,316 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:23:18,636 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:23:20,637 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:23:22,638 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:23:24,639 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:23:26,640 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:23:28,641 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:23:30,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:23:32,643 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:23:33,085 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:23:33,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:23:33,541 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:23:34,644 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:23:36,644 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:23:38,645 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:23:40,646 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:23:42,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:23:44,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:23:46,648 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:23:48,649 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:23:48,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:23:48,864 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:23:50,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:23:52,651 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:23:54,652 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:23:56,652 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:23:58,653 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:24:00,654 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:24:02,655 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:24:03,160 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:24:04,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:24:04,211 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:24:04,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:24:06,657 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:24:08,658 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:24:10,658 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:24:12,659 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:24:14,660 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:24:16,661 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:24:18,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:24:19,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:24:19,596 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:24:20,663 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:24:22,664 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:24:24,665 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:24:26,666 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:24:28,667 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:24:30,667 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:24:33,236 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:24:33,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:24:34,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:24:34,859 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:24:35,670 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:24:37,670 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:24:39,671 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:24:41,672 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:24:43,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:24:45,674 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:24:47,675 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:24:49,676 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:24:50,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:24:50,086 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:24:51,676 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:24:53,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:24:55,678 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:24:57,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:24:59,680 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:25:01,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:25:03,300 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:25:03,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:25:05,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:25:05,465 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:25:05,682 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:25:07,683 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:25:09,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:25:11,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:25:13,685 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:25:15,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:25:17,687 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:25:19,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:25:20,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:25:20,692 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:25:21,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:25:23,689 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:25:25,690 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:25:27,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:25:29,692 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:25:31,693 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:25:33,366 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:25:33,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:25:35,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:25:35,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:25:35,918 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:25:37,695 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:25:39,696 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:25:41,696 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:25:43,697 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:25:45,698 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:25:47,699 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:25:49,700 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:25:51,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:25:51,140 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:25:52,701 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:25:54,701 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:25:56,702 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:25:58,703 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:26:00,704 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:26:02,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:26:03,438 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:26:04,706 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:26:06,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:26:06,365 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:26:06,706 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:26:08,707 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:26:10,708 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:26:12,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:26:14,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:26:16,710 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:26:18,711 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:26:20,711 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:26:21,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:26:21,654 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:26:22,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:26:24,713 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:26:26,714 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:26:28,715 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:26:30,716 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:26:32,717 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:26:33,497 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:26:34,718 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:26:36,719 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:26:36,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:26:36,956 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:26:38,720 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:26:40,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:26:42,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:26:44,722 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:26:46,723 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:26:48,724 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:26:50,725 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:26:52,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:26:52,292 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:26:52,726 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:26:54,727 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:26:56,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:26:58,729 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:27:00,730 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:27:02,731 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:27:03,576 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:27:04,731 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:27:06,732 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:27:07,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:27:07,571 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:27:08,733 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:27:10,734 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:27:12,735 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:27:14,736 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:27:16,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:27:18,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:27:20,738 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:27:23,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:27:23,027 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:27:23,740 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:27:25,741 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:27:27,742 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:27:29,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:27:31,744 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:27:33,650 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:27:33,745 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:27:35,746 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:27:37,747 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:27:38,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:27:38,252 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:27:39,748 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:27:41,749 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:27:43,750 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:27:45,752 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:27:47,752 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:27:49,753 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:27:51,754 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:27:53,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:27:53,586 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:27:53,755 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:27:55,756 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:27:57,757 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:27:59,757 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:28:01,758 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:28:03,725 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:28:03,759 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:28:05,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:28:07,761 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:28:09,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:28:09,026 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:28:09,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:28:11,763 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:28:13,764 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:28:15,765 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:28:17,765 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:28:19,766 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:28:21,767 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:28:23,767 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:28:24,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:28:24,312 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:28:25,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:28:27,769 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:28:29,770 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:28:31,770 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:28:33,771 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:28:33,800 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:28:35,772 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:28:37,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:28:39,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:28:39,645 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:28:39,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:28:41,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:28:43,775 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:28:45,776 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:28:47,777 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:28:49,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:28:51,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:28:53,779 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:28:54,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:28:54,902 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:28:55,780 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:28:57,780 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:28:59,781 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:29:01,782 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:29:03,782 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:29:03,875 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:29:05,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:29:08,785 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:29:10,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:29:10,217 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:29:10,786 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:29:12,786 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:29:14,787 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:29:16,788 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:29:18,789 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:29:20,790 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:29:22,791 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:29:24,791 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:29:25,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:29:25,442 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:29:26,792 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:29:28,793 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:29:30,794 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:29:32,794 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:29:33,948 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:29:34,795 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:29:36,796 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:29:38,797 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:29:40,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:29:40,723 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:29:40,797 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:29:42,798 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:29:44,799 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:29:46,800 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:29:48,800 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:29:50,801 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:29:52,802 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:29:54,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:29:55,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:29:55,952 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:29:56,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:29:58,804 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:30:00,805 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:30:02,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:30:04,018 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:30:04,807 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:30:06,807 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:30:08,808 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:30:10,809 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:30:11,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:30:11,437 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:30:12,810 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:30:14,811 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:30:16,811 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:30:18,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:30:20,813 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:30:22,813 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:30:25,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:30:26,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:30:26,670 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:30:27,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:30:29,816 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:30:31,817 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:30:33,817 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:30:34,093 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:30:35,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:30:37,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:30:39,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:30:41,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:30:41,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:30:41,922 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:30:43,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:30:45,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:30:47,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:30:49,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:30:51,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:30:53,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:30:55,826 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:30:57,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:30:57,178 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:30:57,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:30:59,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:31:01,829 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:31:03,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:31:04,167 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:31:05,831 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:31:07,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:31:09,833 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:31:11,834 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:31:12,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:31:12,410 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:31:13,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:31:15,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:31:17,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:31:19,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:31:21,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:31:23,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:31:25,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:31:27,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:31:27,641 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:31:27,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:31:29,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:31:31,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:31:33,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:31:34,240 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:31:35,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:31:37,846 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:31:39,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:31:42,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:31:42,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:31:42,997 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:31:44,849 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:31:46,850 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:31:48,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:31:50,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:31:52,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:31:54,854 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:31:56,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:31:58,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:31:58,308 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:31:58,856 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:32:00,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:32:02,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:32:04,314 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:32:04,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:32:06,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:32:08,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:32:10,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:32:12,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:32:13,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:32:13,730 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:32:14,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:32:16,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:32:18,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:32:20,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:32:22,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:32:24,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:32:26,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:32:28,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:32:28,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:32:28,974 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:32:30,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:32:32,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:32:34,389 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:32:34,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:32:36,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:32:38,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:32:40,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:32:42,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:32:44,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:32:44,286 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:32:44,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:32:46,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:32:48,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:32:50,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:32:53,882 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:32:55,883 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:32:57,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:32:59,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:32:59,512 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:32:59,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:33:01,885 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:33:03,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:33:04,466 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:33:05,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:33:07,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:33:09,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:33:11,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:33:13,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:33:14,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:33:14,855 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:33:15,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:33:17,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:33:19,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:33:21,894 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:33:23,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:33:25,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:33:27,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:33:29,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:33:30,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:33:30,129 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:33:31,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:33:33,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:33:34,540 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:33:35,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:33:37,900 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:33:39,901 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:33:41,902 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:33:43,902 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:33:45,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:33:45,394 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:33:45,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:33:47,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:33:49,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:33:51,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:33:53,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:33:55,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:33:57,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:34:00,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:34:00,713 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:34:00,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:34:02,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:34:04,613 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:34:04,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:34:06,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:34:08,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:34:10,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:34:12,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:34:14,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:34:15,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:34:15,936 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:34:16,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:34:18,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:34:20,916 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:34:22,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:34:24,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:34:26,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:34:28,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:34:30,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:34:31,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:34:31,257 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:34:32,921 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:34:34,685 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:34:34,922 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:34:36,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:34:38,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:34:40,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:34:42,925 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:34:44,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:34:46,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:34:46,494 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:34:46,927 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:34:48,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:34:50,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:34:52,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:34:54,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:34:56,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:34:58,932 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:35:00,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:35:01,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:35:01,715 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:35:02,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:35:04,761 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:35:04,935 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:35:06,935 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:35:08,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:35:10,937 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:35:12,938 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:35:14,939 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:35:16,940 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:35:16,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:35:16,987 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:35:18,941 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:35:20,942 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:35:22,943 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:35:24,944 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:35:26,945 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:35:28,945 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:35:30,946 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:35:32,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:35:32,299 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:35:32,947 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:35:34,837 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:35:34,948 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:35:37,950 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:35:39,950 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:35:41,951 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:35:43,952 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:35:45,953 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:35:47,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:35:47,522 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:35:47,953 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:35:49,954 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:35:51,955 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:35:53,956 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:35:55,957 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:35:57,958 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:35:59,959 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:36:01,959 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:36:02,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:36:02,822 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:36:03,960 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:36:04,913 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:36:05,961 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:36:07,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:36:09,963 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:36:11,964 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:36:13,964 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:36:15,965 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:36:17,966 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:36:18,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:36:18,106 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:36:19,967 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:36:21,967 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:36:23,968 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:36:25,969 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:36:27,970 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:36:29,970 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:36:31,971 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:36:33,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:36:33,348 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:36:33,972 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:36:34,981 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:36:35,972 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:36:37,973 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:36:39,974 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:36:41,975 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:36:43,976 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:36:45,977 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:36:47,978 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:36:48,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:36:48,570 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:36:49,979 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:36:51,979 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:36:53,980 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:36:55,981 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:36:57,982 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:36:59,982 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:37:01,983 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:37:03,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:37:03,789 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:37:04,984 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:37:05,051 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:37:06,984 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:37:08,985 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:37:10,985 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:37:12,986 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:37:14,987 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:37:16,987 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:37:18,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:37:19,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:37:19,127 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:37:20,989 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:37:22,990 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:37:24,991 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:37:26,992 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:37:28,993 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:37:30,993 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:37:32,994 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:37:34,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:37:34,453 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:37:34,995 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:37:35,117 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:37:36,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:37:38,997 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:37:40,998 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:37:42,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:37:45,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:37:47,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:37:49,001 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:37:49,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:37:49,773 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:37:51,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:37:53,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:37:55,007 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:37:57,007 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:37:59,008 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:38:01,009 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:38:03,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:38:05,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:38:05,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:38:05,019 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:38:05,242 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:38:07,012 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:38:09,013 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:38:11,013 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:38:13,014 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:38:15,015 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:38:17,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:38:20,017 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:38:20,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:38:20,349 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:38:22,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:38:24,019 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:38:26,019 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:38:28,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:38:30,021 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:38:32,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:38:34,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:38:35,266 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:38:35,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:38:35,633 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:38:36,025 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:38:38,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:38:40,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:38:42,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:38:44,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:38:46,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:38:48,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:38:50,031 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:38:50,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:38:50,957 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:38:52,032 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:38:54,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:38:56,034 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:38:58,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:39:00,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:39:02,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:39:04,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:39:05,340 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:39:06,038 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:39:06,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:39:06,307 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:39:08,039 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:39:10,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:39:12,041 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:39:14,042 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:39:16,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:39:18,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:39:20,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:39:21,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:39:21,532 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:39:22,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:39:24,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:39:26,047 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:39:28,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:39:30,049 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:39:32,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:39:34,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:39:35,413 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:39:36,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:39:36,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:39:36,862 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:39:38,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:39:40,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:39:42,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:39:44,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:39:46,056 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:39:48,056 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:39:50,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:39:52,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:39:52,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:39:52,153 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:39:55,060 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:39:57,060 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:39:59,061 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:40:01,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:40:03,063 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:40:05,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:40:05,489 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:40:07,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:40:07,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:40:07,473 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:40:09,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:40:11,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:40:13,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:40:15,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:40:17,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:40:19,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:40:21,071 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:40:22,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:40:22,837 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:40:23,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:40:25,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:40:27,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:40:29,074 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:40:31,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:40:33,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:40:35,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:40:35,566 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:40:37,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:40:38,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:40:38,158 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:40:39,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:40:41,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:40:43,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:40:45,081 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:40:47,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:40:49,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:40:51,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:40:53,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:40:53,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:40:53,538 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:40:55,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:40:57,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:40:59,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:41:02,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:41:04,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:41:05,642 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:41:06,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:41:08,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:41:10,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:41:12,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:41:13,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:41:13,616 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:41:14,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:41:16,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:41:18,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:41:20,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:41:22,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:41:24,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:41:26,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:41:28,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:41:28,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:41:28,961 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:41:30,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:41:32,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:41:34,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:41:35,715 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:41:36,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:41:38,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:41:40,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:41:42,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:41:44,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:41:45,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:41:45,603 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:41:46,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:41:48,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:41:50,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:41:52,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:41:54,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:41:56,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:41:58,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:42:00,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:42:00,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:42:00,972 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:42:02,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:42:05,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:42:05,791 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:42:07,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:42:09,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:42:11,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:42:13,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:42:15,121 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:42:16,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:42:16,240 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:42:17,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:42:19,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:42:21,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:42:23,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:42:25,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:42:27,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:42:29,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:42:31,128 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:42:31,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:42:31,465 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:42:33,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:42:35,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:42:35,865 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:42:37,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:42:39,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:42:41,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:42:43,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:42:45,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:42:46,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:42:46,763 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:42:47,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:42:49,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:42:51,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:42:53,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:42:55,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:42:57,140 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:42:59,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:43:01,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:43:02,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:43:02,037 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:43:03,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:43:05,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:43:05,941 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:43:07,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:43:09,145 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:43:11,146 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:43:13,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:43:15,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:43:17,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:43:17,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:43:17,348 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:43:19,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:43:21,150 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:43:23,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:43:25,152 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:43:27,153 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:43:32,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:43:32,600 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:43:36,015 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:43:47,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:43:47,856 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:44:03,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:44:03,105 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:44:06,090 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:44:18,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:44:18,384 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:44:27,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:44:27,548 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 09:44:27,602 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 09:44:27,685 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 09:44:28,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 09:44:29,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:44:30,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:44:33,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:44:33,635 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:44:36,173 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:44:36,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:44:48,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:44:48,904 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:44:58,187 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:45:04,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:45:04,148 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:45:06,255 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:45:19,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:45:19,375 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:45:34,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:45:34,601 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:45:36,335 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:45:49,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:45:49,827 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:46:05,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:46:05,058 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:46:06,439 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:46:20,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:46:20,291 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:46:35,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:46:35,522 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:46:36,520 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:46:50,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:46:50,758 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:47:05,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:47:05,994 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:47:06,603 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:47:21,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:47:21,219 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:47:36,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:47:36,444 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:47:36,677 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:47:51,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:47:51,666 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:48:06,755 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:48:06,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:48:06,891 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:48:22,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:48:22,114 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:48:36,835 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:48:37,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:48:37,346 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:48:52,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:48:52,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:48:52,579 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:48:53,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:48:56,296 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:49:02,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:02,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:02,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:02,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:02,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:02,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:02,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:02,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:02,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:02,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:02,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:02,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:02,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:02,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:02,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:02,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:03,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:03,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:03,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:03,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:03,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:03,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:03,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:03,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:03,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:03,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:03,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:03,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:03,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:03,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:03,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:03,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:06,300 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:49:06,910 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:49:08,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:49:08,278 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:49:08,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:08,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:08,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:08,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:08,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:08,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:08,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:08,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:08,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:08,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:08,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:08,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:08,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:08,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:08,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:08,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:12,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:49:16,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:49:20,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:20,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:20,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:20,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:20,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:20,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:20,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:20,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:20,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:20,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:20,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:20,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:20,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:20,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:20,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:20,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:20,306 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:49:23,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:49:23,508 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:49:23,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:23,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:23,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:23,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:23,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:23,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:23,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:23,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:23,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:23,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:23,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:23,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:23,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:23,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:23,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:23,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:24,308 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:49:28,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:49:29,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:29,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:29,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:29,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:29,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:29,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:29,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:29,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:29,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:29,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:29,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:29,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:29,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:29,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:29,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:29,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:29,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:29,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:29,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:29,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:29,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:29,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:29,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:29,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:29,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:29,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:29,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:29,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:29,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:29,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:29,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:29,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:32,311 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:49:34,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:49:34,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:34,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:34,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:34,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:34,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:34,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:34,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:34,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:34,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:34,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:34,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:34,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:34,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:34,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:34,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:34,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:36,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:36,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:36,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:36,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:36,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:36,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:36,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:36,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:36,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:36,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:36,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:36,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:36,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:36,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:36,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:36,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:36,982 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:49:38,313 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:49:38,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:49:38,862 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:49:40,314 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:49:42,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:42,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:42,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:42,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:42,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:42,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:42,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:42,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:42,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:42,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:42,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:42,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:42,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:42,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:42,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:42,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:44,316 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:49:48,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:49:48,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:48,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:48,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:48,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:48,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:48,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:48,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:48,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:48,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:48,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:48,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:48,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:48,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:48,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:48,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:48,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:50,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:50,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:50,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:50,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:50,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:50,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:50,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:50,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:50,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:50,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:50,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:50,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:50,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:50,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:50,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:50,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:50,318 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:49:54,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:49:54,090 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:49:54,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:54,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:54,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:54,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:54,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:54,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:54,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:54,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:54,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:54,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:54,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:54,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:54,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:54,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:54,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:54,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:54,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:49:56,321 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:49:58,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:58,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:58,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:58,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:58,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:58,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:58,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:58,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:58,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:58,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:58,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:58,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:58,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:58,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:58,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:58,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:49:59,322 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:50:03,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:50:05,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:50:07,052 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:50:07,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:50:07,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:07,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:07,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:07,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:07,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:07,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:07,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:07,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:07,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:07,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:07,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:07,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:07,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:07,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:07,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:07,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:08,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:08,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:08,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:08,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:08,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:08,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:08,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:08,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:08,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:08,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:08,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:08,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:08,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:08,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:08,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:08,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:09,326 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:50:09,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:50:09,337 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:50:09,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:09,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:09,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:09,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:09,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:09,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:09,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:09,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:09,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:09,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:09,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:09,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:09,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:09,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:09,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:09,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:13,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:50:15,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:50:15,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:15,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:15,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:15,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:15,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:15,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:15,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:15,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:15,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:15,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:15,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:15,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:15,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:15,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:15,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:15,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:17,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:50:18,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:18,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:18,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:18,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:18,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:18,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:18,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:18,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:18,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:18,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:18,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:18,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:18,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:18,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:18,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:18,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:18,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:18,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:18,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:18,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:18,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:18,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:18,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:18,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:19,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:19,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:19,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:19,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:19,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:19,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:19,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:19,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:19,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:50:20,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:20,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:20,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:20,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:20,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:20,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:20,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:20,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:20,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:20,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:20,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:20,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:20,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:20,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:20,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:20,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:21,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:50:22,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:22,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:22,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:22,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:22,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:22,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:22,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:22,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:22,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:22,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:22,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:22,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:22,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:22,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:22,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:22,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:22,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:22,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:22,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:22,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:22,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:22,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:22,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:22,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:22,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:22,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:22,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:22,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:22,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:22,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:22,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:22,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:23,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:23,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:23,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:23,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:23,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:23,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:23,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:23,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:23,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:23,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:23,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:23,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:23,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:23,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:23,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:23,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:23,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:50:24,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:50:24,587 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:50:24,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:24,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:24,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:24,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:24,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:24,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:24,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:24,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:24,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:24,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:24,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:24,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:24,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:24,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:24,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:24,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:25,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:50:26,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:26,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:26,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:26,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:26,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:26,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:26,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:26,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:26,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:26,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:26,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:26,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:26,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:26,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:26,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:26,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:27,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:50:28,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:28,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:28,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:28,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:28,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:28,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:28,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:28,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:28,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:28,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:28,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:28,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:28,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:28,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:28,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:28,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:29,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:50:31,335 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:50:31,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:31,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:31,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:31,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:31,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:31,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:31,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:31,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:31,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:31,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:31,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:31,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:31,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:31,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:31,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:31,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:33,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:50:35,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:50:37,126 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:50:37,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:50:38,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:38,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:38,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:38,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:38,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:38,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:38,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:38,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:38,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:38,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:38,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:38,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:38,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:38,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:38,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:38,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:39,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:50:39,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:39,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:39,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:39,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:39,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:39,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:39,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:39,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:39,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:39,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:39,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:39,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:39,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:39,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:39,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:39,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:40,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:40,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:40,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:40,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:40,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:40,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:40,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:40,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:40,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:40,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:40,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:40,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:40,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:40,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:40,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:40,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:40,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:50:40,131 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:50:40,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:40,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:40,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:40,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:40,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:40,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:40,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:40,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:40,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:40,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:40,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:40,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:40,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:40,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:40,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:40,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:41,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:50:41,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:41,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:41,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:41,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:41,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:41,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:41,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:41,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:41,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:41,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:41,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:41,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:41,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:41,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:41,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:41,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:42,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:42,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:42,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:42,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:42,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:42,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:42,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:42,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:42,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:42,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:42,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:42,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:42,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:42,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:42,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:42,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:43,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:50:44,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:44,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:44,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:44,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:44,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:44,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:44,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:44,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:44,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:44,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:44,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:44,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:44,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:44,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:44,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:44,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:45,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:50:46,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:46,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:46,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:46,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:46,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:46,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:46,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:46,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:46,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:46,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:46,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:46,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:46,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:46,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:46,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:46,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:46,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:46,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:46,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:46,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:46,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:46,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:46,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:46,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:46,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:46,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:46,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:46,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:46,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:46,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:46,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:46,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:47,342 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:50:47,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:47,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:47,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:47,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:47,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:47,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:47,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:47,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:47,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:47,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:47,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:47,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:47,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:47,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:47,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:47,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:49,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:50:49,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:49,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:49,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:49,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:49,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:49,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:49,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:49,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:49,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:49,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:49,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:49,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:49,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:49,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:49,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:49,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:51,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:50:51,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:51,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:51,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:51,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:51,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:51,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:51,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:51,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:51,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:51,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:51,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:51,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:51,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:51,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:51,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:51,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:52,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:52,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:52,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:52,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:52,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:52,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:52,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:52,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:52,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:52,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:52,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:52,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:52,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:52,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:52,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:52,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:52,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:52,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:52,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:52,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:52,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:52,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:52,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:52,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:52,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:52,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:52,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:52,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:52,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:52,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:52,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:52,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:53,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:50:54,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:54,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:55,346 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:50:55,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:50:55,379 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:50:55,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:55,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:55,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:55,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:55,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:55,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:55,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:55,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:55,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:55,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:55,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:55,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:57,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:50:59,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:59,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:59,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:59,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:59,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:59,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:59,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:59,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:59,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:59,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:59,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:59,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:59,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:59,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:59,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:50:59,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:02,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:02,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:02,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:02,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:02,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:02,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:02,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:02,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:02,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:02,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:02,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:02,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:02,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:02,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:02,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:02,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:07,202 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:51:07,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:51:10,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:51:10,603 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:51:13,354 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:51:13,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:13,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:13,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:13,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:13,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:13,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:13,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:13,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:13,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:13,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:13,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:13,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:13,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:13,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:13,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:13,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:15,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:15,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:15,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:15,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:15,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:15,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:15,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:15,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:15,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:15,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:15,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:15,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:15,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:15,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:15,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:15,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:17,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:51:18,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:18,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:18,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:18,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:18,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:18,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:18,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:18,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:18,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:18,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:18,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:18,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:18,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:18,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:18,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:18,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:20,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:20,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:20,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:20,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:20,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:20,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:20,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:20,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:20,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:20,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:20,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:20,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:20,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:20,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:20,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:20,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:23,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:51:25,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:51:26,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:51:26,146 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:51:29,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:51:31,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:31,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:31,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:31,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:31,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:31,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:31,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:31,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:31,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:31,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:31,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:31,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:31,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:31,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:31,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:31,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:33,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:51:33,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:33,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:33,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:33,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:33,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:33,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:33,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:33,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:33,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:33,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:33,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:33,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:33,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:33,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:33,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:33,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:33,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:33,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:33,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:33,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:33,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:33,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:33,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:33,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:33,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:33,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:33,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:33,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:33,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:33,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:33,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:33,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:37,275 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:51:37,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:51:40,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:51:40,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:40,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:40,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:40,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:40,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:40,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:40,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:40,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:40,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:40,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:40,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:40,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:40,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:40,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:40,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:40,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:41,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:51:41,372 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:51:41,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:41,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:41,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:41,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:41,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:41,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:41,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:41,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:41,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:41,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:41,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:41,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:41,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:41,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:41,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:41,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:44,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:51:46,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:51:47,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:47,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:47,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:47,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:47,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:47,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:47,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:47,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:47,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:47,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:47,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:47,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:47,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:47,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:47,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:47,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:47,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:47,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:47,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:47,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:47,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:47,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:47,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:47,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:47,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:47,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:47,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:47,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:47,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:47,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:47,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:47,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:50,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:51:52,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:51:54,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:54,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:54,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:54,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:54,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:54,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:54,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:54,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:54,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:54,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:54,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:54,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:54,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:54,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:54,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:54,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:56,371 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:51:56,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:51:56,755 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:51:58,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:51:58,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:58,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:58,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:58,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:58,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:58,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:58,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:58,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:58,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:58,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:58,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:58,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:58,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:58,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:58,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:58,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:59,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:51:59,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:00,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:00,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:00,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:00,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:00,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:00,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:00,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:00,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:00,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:00,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:00,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:00,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:00,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:00,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:00,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:52:04,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:52:05,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:05,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:05,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:05,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:05,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:05,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:05,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:05,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:05,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:05,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:05,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:05,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:05,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:05,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:05,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:05,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:06,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:52:07,346 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:52:08,376 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:52:10,377 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:52:12,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:52:12,001 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:52:12,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:52:15,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:15,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:16,379 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:52:17,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:17,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:17,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:17,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:17,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:17,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:17,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:17,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:17,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:17,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:17,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:17,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:17,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:17,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:17,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:17,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:18,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:52:20,381 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:52:21,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:21,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:21,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:21,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:21,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:21,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:21,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:21,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:21,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:21,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:21,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:21,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:21,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:21,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:21,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:21,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:22,382 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:52:24,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:52:24,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:24,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:26,384 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:52:27,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:52:27,247 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:52:27,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:27,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:27,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:27,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:27,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:27,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:27,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:27,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:27,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:27,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:27,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:27,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:27,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:27,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:27,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:27,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:27,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:27,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:27,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:27,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:27,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:27,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:27,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:27,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:27,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:27,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:27,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:27,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:27,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:27,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:27,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:27,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:28,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:52:30,386 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:52:31,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:31,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:31,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:31,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:31,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:31,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:31,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:31,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:31,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:31,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:31,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:31,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:31,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:31,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:31,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:31,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:32,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:32,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:32,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:32,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:32,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:32,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:32,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:32,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:32,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:32,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:32,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:32,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:32,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:32,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:32,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:32,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:32,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:32,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:32,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:32,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:32,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:32,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:32,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:32,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:32,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:32,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:32,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:32,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:32,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:32,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:32,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:32,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:32,386 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:52:34,387 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:52:35,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:35,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:35,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:35,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:35,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:35,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:35,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:35,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:35,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:35,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:35,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:35,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:35,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:35,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:35,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:35,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:36,388 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:52:37,416 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:52:38,389 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:52:40,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:52:41,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:41,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:42,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:52:42,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:52:42,471 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:52:43,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:43,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:43,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:43,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:43,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:43,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:43,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:43,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:43,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:43,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:43,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:43,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:43,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:43,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:43,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:43,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:44,391 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:52:45,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:45,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:45,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:45,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:45,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:45,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:45,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:45,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:45,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:45,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:45,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:45,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:45,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:45,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:45,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:45,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:46,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:52:46,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:46,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:46,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:46,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:46,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:46,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:46,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:46,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:46,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:46,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:46,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:46,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:46,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:46,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:46,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:46,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:47,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:48,393 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:52:49,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:49,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:49,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:49,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:49,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:49,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:49,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:49,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:49,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:49,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:49,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:49,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:49,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:49,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:49,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:49,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:50,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:52:51,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:51,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:51,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:51,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:51,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:51,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:51,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:51,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:51,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:51,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:51,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:51,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:51,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:51,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:51,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:51,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:51,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:51,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:51,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:51,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:51,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:51,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:51,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:51,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:51,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:51,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:51,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:51,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:51,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:51,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:51,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:51,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:52,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:52:52,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:52,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:52,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:52,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:52,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:52,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:52,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:52,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:52,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:52,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:52,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:52,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:52,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:52,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:52,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:52,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:53,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:53,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:53,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:53,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:53,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:53,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:53,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:53,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:53,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:53,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:53,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:53,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:53,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:53,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:53,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:53,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:54,395 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:52:54,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:54,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:54,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:54,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:54,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:54,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:54,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:54,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:54,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:54,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:54,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:54,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:54,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:54,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:54,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:54,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:54,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:54,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:54,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:54,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:54,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:54,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:54,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:54,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:54,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:54,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:54,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:54,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:54,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:54,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:55,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:55,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:55,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:55,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:55,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:55,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:55,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:55,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:55,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:55,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:55,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:55,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:55,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:55,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:55,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:55,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:55,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:55,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:55,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:55,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:55,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:55,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:55,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:55,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:55,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:55,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:55,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:55,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:55,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:55,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:55,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:52:55,336 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 09:52:55,535 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 09:52:55,615 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 09:52:56,487 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 09:52:56,488 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:52:57,488 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:52:57,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:52:57,687 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:53:04,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:53:07,644 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:53:10,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:10,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:10,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:10,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:10,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:10,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:10,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:10,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:10,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:10,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:10,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:10,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:10,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:10,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:10,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:10,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:11,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:11,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:11,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:11,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:11,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:11,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:11,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:11,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:11,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:11,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:11,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:11,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:11,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:11,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:11,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:11,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:11,493 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:53:12,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:53:12,914 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:53:15,494 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:53:18,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:18,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:18,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:18,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:18,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:18,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:18,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:18,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:18,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:18,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:18,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:18,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:18,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:18,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:18,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:18,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:18,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:18,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:18,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:18,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:18,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:18,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:18,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:18,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:18,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:18,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:18,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:18,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:18,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:18,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:18,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:18,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:19,496 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:53:22,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:22,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:22,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:22,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:22,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:22,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:22,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:22,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:22,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:22,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:22,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:22,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:22,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:22,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:22,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:22,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:23,498 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:53:26,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:26,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:26,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:26,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:26,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:26,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:26,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:26,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:26,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:26,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:26,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:26,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:26,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:26,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:26,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:26,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:27,499 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:53:28,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:53:28,128 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:53:31,501 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:53:33,502 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:53:35,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:35,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:35,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:35,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:35,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:35,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:35,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:35,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:35,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:35,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:35,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:35,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:35,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:35,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:35,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:35,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:36,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:36,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:36,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:36,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:36,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:36,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:36,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:36,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:36,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:36,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:36,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:36,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:36,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:36,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:36,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:36,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:37,503 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:53:37,714 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:53:41,505 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:53:42,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:42,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:42,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:42,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:42,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:42,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:42,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:42,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:42,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:42,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:42,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:42,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:42,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:42,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:42,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:42,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:43,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:53:43,444 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:53:43,505 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:53:44,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:44,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:44,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:44,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:44,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:44,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:44,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:44,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:44,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:44,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:44,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:44,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:44,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:44,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:44,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:44,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:44,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:44,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:44,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:44,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:44,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:44,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:44,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:44,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:44,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:44,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:44,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:44,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:44,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:44,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:44,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:44,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:47,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:47,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:47,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:47,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:47,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:47,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:47,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:47,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:47,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:47,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:47,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:47,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:47,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:47,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:47,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:47,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:47,507 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:53:49,508 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:53:53,509 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:53:55,510 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:53:55,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:55,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:55,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:55,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:55,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:55,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:55,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:55,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:55,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:55,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:55,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:55,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:55,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:55,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:55,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:55,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:53:57,511 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:53:58,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:53:58,714 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:54:00,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:00,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:00,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:00,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:00,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:00,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:00,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:00,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:00,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:00,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:00,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:00,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:00,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:00,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:00,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:00,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:01,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:01,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:01,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:01,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:01,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:01,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:01,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:01,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:01,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:01,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:01,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:01,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:01,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:01,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:01,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:01,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:01,512 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:54:03,513 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:54:03,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:03,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:03,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:03,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:03,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:03,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:03,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:03,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:03,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:03,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:03,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:03,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:03,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:03,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:03,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:03,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:05,514 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:54:06,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:06,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:06,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:06,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:06,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:06,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:06,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:06,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:06,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:06,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:06,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:06,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:06,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:06,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:06,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:06,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:07,791 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:54:09,516 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:54:11,516 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:54:13,517 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:54:13,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:54:13,986 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:54:15,518 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:54:16,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:16,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:16,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:16,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:16,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:16,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:16,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:16,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:16,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:16,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:16,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:16,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:16,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:16,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:16,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:16,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:17,518 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:54:17,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:17,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:17,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:17,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:17,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:17,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:17,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:17,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:17,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:17,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:17,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:17,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:17,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:17,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:17,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:17,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:19,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:19,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:19,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:19,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:19,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:19,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:19,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:19,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:19,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:19,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:19,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:19,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:19,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:19,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:19,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:19,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:19,519 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:54:19,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:19,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:19,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:19,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:19,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:19,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:19,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:19,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:19,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:19,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:19,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:19,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:19,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:19,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:19,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:19,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:21,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:54:23,521 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:54:24,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:24,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:24,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:24,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:24,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:24,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:24,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:24,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:24,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:24,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:24,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:24,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:24,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:24,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:24,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:24,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:24,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:24,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:24,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:24,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:24,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:24,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:24,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:24,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:24,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:24,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:24,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:24,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:24,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:24,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:24,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:24,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:25,521 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:54:27,522 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:54:27,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:27,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:27,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:27,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:27,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:27,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:27,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:27,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:27,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:27,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:27,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:27,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:27,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:27,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:27,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:27,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:28,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:28,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:28,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:28,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:28,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:28,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:28,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:28,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:28,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:28,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:28,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:28,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:28,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:28,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:28,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:28,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:29,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:54:29,215 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:54:29,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:29,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:29,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:29,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:29,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:29,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:29,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:29,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:29,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:29,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:29,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:29,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:29,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:29,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:29,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:29,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:29,523 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:54:29,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:29,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:29,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:29,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:29,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:29,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:29,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:29,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:29,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:29,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:29,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:29,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:29,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:29,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:29,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:29,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:31,524 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:54:32,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:32,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:32,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:32,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:32,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:32,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:32,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:32,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:32,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:32,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:32,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:32,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:32,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:32,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:32,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:32,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:32,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:32,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:32,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:32,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:32,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:32,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:32,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:32,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:32,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:32,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:32,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:32,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:32,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:32,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:32,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:32,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:33,524 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:54:35,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:54:36,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:36,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:36,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:36,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:36,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:36,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:36,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:36,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:36,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:36,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:36,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:36,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:36,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:36,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:36,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:36,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:37,526 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:54:37,865 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:54:39,527 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:54:41,528 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:54:43,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:43,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:43,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:43,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:43,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:43,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:43,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:43,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:43,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:43,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:43,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:43,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:43,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:43,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:43,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:43,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:43,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:54:44,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:54:44,476 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:54:44,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:44,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:45,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:45,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:45,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:45,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:45,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:45,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:45,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:45,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:45,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:45,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:45,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:45,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:45,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:45,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:45,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:45,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:45,530 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:54:47,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:47,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:47,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:47,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:47,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:47,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:47,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:47,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:47,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:47,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:47,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:47,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:47,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:47,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:47,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:47,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:47,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:54:48,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:48,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:48,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:48,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:48,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:48,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:48,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:48,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:48,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:48,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:48,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:48,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:48,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:48,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:48,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:48,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:49,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:49,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:49,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:49,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:49,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:49,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:49,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:49,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:49,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:49,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:49,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:49,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:49,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:49,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:49,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:49,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:49,532 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:54:49,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:49,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:49,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:49,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:49,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:49,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:49,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:49,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:49,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:49,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:49,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:49,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:49,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:49,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:49,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:49,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:50,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:50,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:50,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:50,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:50,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:50,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:50,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:50,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:50,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:50,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:50,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:50,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:50,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:50,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:50,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:50,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:50,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:50,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:50,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:50,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:50,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:50,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:50,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:50,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:50,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:50,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:50,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:50,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:50,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:50,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:50,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:50,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:51,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:51,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:51,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:51,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:51,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:51,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:51,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:51,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:51,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:51,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:51,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:51,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:51,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:51,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:51,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:51,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:51,532 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:54:53,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:54:53,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:53,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:53,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:53,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:53,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:53,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:53,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:53,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:53,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:53,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:53,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:53,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:53,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:53,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:53,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:53,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:54,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:54,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:54,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:54,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:54,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:54,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:54,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:54,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:54,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:54,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:54,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:54,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:54,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:54,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:54,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:54,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:54,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:54,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:54,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:54,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:54,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:54,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:54,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:54,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:54,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:54,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:54,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:54,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:54:55,534 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:54:59,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:54:59,959 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:55:04,536 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:55:07,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:07,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:07,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:07,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:07,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:07,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:07,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:07,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:07,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:07,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:07,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:07,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:07,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:07,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:07,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:07,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:07,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:07,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:07,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:07,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:07,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:07,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:07,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:07,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:07,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:07,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:07,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:07,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:07,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:07,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:07,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:07,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:07,931 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:55:10,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:10,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:10,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:10,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:10,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:10,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:10,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:10,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:10,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:10,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:10,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:10,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:10,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:10,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:10,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:10,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:10,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:10,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:10,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:10,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:10,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:55:10,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:10,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:10,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:10,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:10,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:10,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:10,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:10,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:10,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:10,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:10,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:10,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:14,541 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:55:15,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:55:15,448 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:55:18,543 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:55:21,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:21,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:21,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:21,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:21,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:21,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:21,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:21,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:22,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:22,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:22,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:22,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:22,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:22,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:22,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:22,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:22,545 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:55:22,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:22,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:22,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:22,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:22,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:22,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:22,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:22,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:22,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:22,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:22,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:22,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:22,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:22,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:22,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:22,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:26,547 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:55:27,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:27,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:27,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:27,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:27,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:27,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:27,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:27,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:27,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:27,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:27,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:27,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:27,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:27,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:27,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:27,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:27,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:27,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:27,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:27,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:27,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:27,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:27,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:27,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:27,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:27,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:27,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:27,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:27,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:27,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:27,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:27,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:30,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:55:30,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:55:30,671 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:55:32,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:32,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:32,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:32,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:32,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:32,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:32,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:32,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:32,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:32,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:32,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:32,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:32,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:32,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:32,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:32,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:34,550 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:55:36,551 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:55:38,006 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:55:38,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:38,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:38,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:38,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:38,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:38,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:38,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:38,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:38,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:38,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:38,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:38,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:38,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:38,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:38,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:38,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:38,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:38,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:38,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:38,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:38,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:38,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:38,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:38,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:38,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:38,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:38,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:38,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:39,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:39,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:39,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:39,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:40,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:40,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:40,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:40,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:40,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:40,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:40,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:40,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:40,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:40,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:40,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:40,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:40,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:40,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:40,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:40,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:40,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:55:42,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:55:45,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:55:45,944 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:55:46,555 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:55:47,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:47,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:47,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:47,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:47,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:47,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:47,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:47,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:47,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:47,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:47,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:47,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:47,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:47,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:47,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:47,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:47,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:47,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:47,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:47,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:47,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:47,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:47,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:47,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:47,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:47,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:47,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:47,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:47,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:47,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:47,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:47,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:48,556 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:55:49,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:49,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:49,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:49,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:49,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:49,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:49,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:49,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:49,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:49,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:49,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:49,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:49,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:49,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:49,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:49,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:50,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:50,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:50,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:50,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:50,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:50,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:50,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:50,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:50,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:50,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:50,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:50,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:50,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:50,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:50,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:50,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:55:52,558 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:55:54,559 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:55:56,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:56:00,561 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:56:01,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:56:01,289 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:56:01,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:01,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:01,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:01,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:01,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:01,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:01,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:01,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:01,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:01,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:01,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:01,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:01,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:01,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:01,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:01,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:01,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:01,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:01,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:01,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:01,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:01,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:01,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:01,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:01,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:01,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:01,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:01,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:01,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:01,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:01,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:01,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:02,562 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:56:04,563 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:56:06,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:06,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:06,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:06,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:06,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:06,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:06,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:06,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:06,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:06,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:06,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:06,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:06,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:06,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:06,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:06,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:06,563 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:56:08,081 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:56:08,564 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:56:10,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:10,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:10,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:10,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:10,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:10,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:10,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:10,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:10,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:10,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:10,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:10,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:10,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:10,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:10,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:10,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:10,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:10,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:10,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:10,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:10,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:10,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:10,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:10,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:10,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:10,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:10,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:10,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:10,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:10,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:10,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:10,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:10,565 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:56:12,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:56:14,567 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:56:16,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:56:16,535 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:56:16,568 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:56:18,569 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:56:19,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:19,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:19,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:19,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:19,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:19,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:19,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:19,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:19,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:19,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:19,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:19,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:19,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:19,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:19,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:19,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:19,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:19,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:19,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:19,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:19,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:19,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:19,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:19,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:19,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:19,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:19,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:19,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:19,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:19,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:19,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:19,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:20,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:20,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:20,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:20,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:20,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:20,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:20,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:20,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:20,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:20,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:20,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:20,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:20,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:20,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:20,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:20,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:20,569 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:56:21,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:21,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:21,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:21,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:21,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:21,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:21,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:21,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:21,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:21,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:21,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:21,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:21,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:21,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:21,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:21,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:22,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:56:24,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:56:26,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:26,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:26,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:26,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:26,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:26,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:26,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:26,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:26,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:26,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:26,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:26,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:26,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:26,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:26,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:26,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:26,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:56:27,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:27,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:27,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:27,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:27,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:27,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:27,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:27,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:27,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:27,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:27,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:27,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:27,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:27,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:27,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:27,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:28,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:56:29,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:29,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:29,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:29,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:29,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:29,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:29,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:29,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:29,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:29,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:29,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:29,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:29,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:29,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:29,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:29,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:29,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:29,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:29,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:29,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:29,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:29,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:29,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:29,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:29,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:29,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:29,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:29,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:29,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:29,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:29,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:29,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:56:30,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:30,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:31,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:56:31,853 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:56:32,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:32,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:32,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:32,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:32,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:32,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:32,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:32,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:32,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:32,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:32,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:32,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:32,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:32,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:32,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:32,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:32,574 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:56:34,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:56:36,576 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:56:37,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:37,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:37,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:37,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:37,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:37,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:37,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:37,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:37,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:37,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:37,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:37,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:37,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:37,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:37,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:37,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:38,149 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:56:38,576 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:56:40,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:56:41,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:41,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:41,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:41,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:41,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:41,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:41,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:41,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:41,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:41,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:41,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:41,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:41,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:41,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:41,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:41,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:42,578 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:56:43,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:43,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:44,579 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:56:46,580 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:56:46,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:46,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:46,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:46,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:46,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:46,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:46,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:46,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:46,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:46,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:46,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:46,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:46,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:46,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:46,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:46,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:46,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:46,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:46,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:46,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:46,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:46,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:46,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:46,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:46,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:46,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:46,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:46,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:46,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:46,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:46,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:46,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:56:47,143 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:56:47,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:47,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:48,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:48,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:48,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:48,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:48,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:48,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:48,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:48,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:48,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:48,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:48,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:48,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:48,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:48,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:48,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:48,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:48,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:56:49,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:49,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:49,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:49,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:49,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:49,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:49,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:49,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:49,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:49,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:49,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:49,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:49,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:49,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:49,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:49,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:50,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:56:50,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:50,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:50,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:50,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:50,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:50,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:50,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:50,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:50,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:50,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:50,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:50,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:50,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:56:51,032 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 09:56:51,237 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 09:56:51,365 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 09:56:51,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 09:56:51,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:56:52,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:57:02,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:57:02,370 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:57:02,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:57:05,804 WARNING FileStreamThread:1049978 [file_stream.py:request_with_retry():593] requests_with_retry encountered retryable exception: HTTPSConnectionPool(host='api.wandb.ai', port=443): Read timed out. (read timeout=None). func: >, args: ('https://api.wandb.ai/files/nbailab/wav2vec2/3dybzmyz/file_stream',), kwargs: {'json': {'files': {'wandb-events.jsonl': {'offset': 2611, 'content': ['{"system.cpu": 6.6, "system.memory": 7.2, "system.disk": 68.5, "system.proc.memory.availableMB": 208197.2, "system.proc.memory.rssMB": 108.22, "system.proc.memory.percent": 0.05, "system.proc.cpu.threads": 12.0, "system.network.sent": 109193544546, "system.network.recv": 1475218367, "_wandb": true, "_timestamp": 1653378065, "_runtime": 78560}']}, 'output.log': {'offset': 17084, 'content': ["ERROR 2022-05-24T07:40:36.725874 Batch size = 12 | 9500/499680 [21:07:40<130:15:10, 1.05it/s]The following columns in the evaluation set don't have a corresponding argument in `Wav2Vec2ForCTC.forward` and have been ignored: input_length. If input_length are not expected by `Wav2Vec2ForCTC.forward`, you can safely ignore this message.\n", "ERROR 2022-05-24T07:40:38.731967 Batch size = 12 | 9500/499680 [21:07:40<130:15:10, 1.05it/s]The following columns in the evaluation set don't have a corresponding argument in `Wav2Vec2ForCTC.forward` and have been ignored: input_length. If input_length are not expected by `Wav2Vec2ForCTC.forward`, you can safely ignore this message.\n", "ERROR 2022-05-24T07:40:40.778489 Batch size = 12 | 9500/499680 [21:07:40<130:15:10, 1.05it/s]The following columns in the evaluation set don't have a corresponding argument in `Wav2Vec2ForCTC.forward` and have been ignored: input_length. If input_length are not expected by `Wav2Vec2ForCTC.forward`, you can safely ignore this message.\n", "ERROR 2022-05-24T07:40:42.785458 Batch size = 12 | 9500/499680 [21:07:40<130:15:10, 1.05it/s]The following columns in the evaluation set don't have a corresponding argument in `Wav2Vec2ForCTC.forward` and have been ignored: input_length. If input_length are not expected by `Wav2Vec2ForCTC.forward`, you can safely ignore this message.\n", "ERROR 2022-05-24T07:40:44.792624 Batch size = 12 | 9500/499680 [21:07:40<130:15:10, 1.05it/s]The following columns in the evaluation set don't have a corresponding argument in `Wav2Vec2ForCTC.forward` and have been ignored: input_length. If input_length are not expected by `Wav2Vec2ForCTC.forward`, you can safely ignore this message.\n", "ERROR 2022-05-24T07:40:46.799920 Batch size = 12 | 9500/499680 [21:07:40<130:15:10, 1.05it/s]The following columns in the evaluation set don't have a corresponding argument in `Wav2Vec2ForCTC.forward` and have been ignored: input_length. If input_length are not expected by `Wav2Vec2ForCTC.forward`, you can safely ignore this message.\n", "ERROR 2022-05-24T07:40:48.807329 Batch size = 12 | 9500/499680 [21:07:40<130:15:10, 1.05it/s]The following columns in the evaluation set don't have a corresponding argument in `Wav2Vec2ForCTC.forward` and have been ignored: input_length. If input_length are not expected by `Wav2Vec2ForCTC.forward`, you can safely ignore this message.\n", "ERROR 2022-05-24T07:40:50.863575 Batch size = 12 | 9500/499680 [21:07:40<130:15:10, 1.05it/s]The following columns in the evaluation set don't have a corresponding argument in `Wav2Vec2ForCTC.forward` and have been ignored: input_length. If input_length are not expected by `Wav2Vec2ForCTC.forward`, you can safely ignore this message.\n", "ERROR 2022-05-24T07:40:52.933019 Batch size = 12 | 9500/499680 [21:07:40<130:15:10, 1.05it/s]The following columns in the evaluation set don't have a corresponding argument in `Wav2Vec2ForCTC.forward` and have been ignored: input_length. If input_length are not expected by `Wav2Vec2ForCTC.forward`, you can safely ignore this message.\n", "ERROR 2022-05-24T07:40:58.764534 Batch size = 12 | 9500/499680 [21:07:40<130:15:10, 1.05it/s]The following columns in the evaluation set don't have a corresponding argument in `Wav2Vec2ForCTC.forward` and have been ignored: input_length. If input_length are not expected by `Wav2Vec2ForCTC.forward`, you can safely ignore this message.\n", "ERROR 2022-05-24T07:40:58.764710 Batch size = 12 | 9500/499680 [21:07:40<130:15:10, 1.05it/s]The following columns in the evaluation set don't have a corresponding argument in `Wav2Vec2ForCTC.forward` and have been ignored: input_length. If input_length are not expected by `Wav2Vec2ForCTC.forward`, you can safely ignore this message.\n", "ERROR 2022-05-24T07:40:59.058340 Batch size = 12 | 9500/499680 [21:07:40<130:15:10, 1.05it/s]The following columns in the evaluation set don't have a corresponding argument in `Wav2Vec2ForCTC.forward` and have been ignored: input_length. If input_length are not expected by `Wav2Vec2ForCTC.forward`, you can safely ignore this message.\n", "ERROR 2022-05-24T07:41:01.129282 Batch size = 12 | 9500/499680 [21:07:40<130:15:10, 1.05it/s]The following columns in the evaluation set don't have a corresponding argument in `Wav2Vec2ForCTC.forward` and have been ignored: input_length. If input_length are not expected by `Wav2Vec2ForCTC.forward`, you can safely ignore this message.\n", "ERROR 2022-05-24T07:41:03.156672 Batch size = 12 | 9500/499680 [21:07:40<130:15:10, 1.05it/s]The following columns in the evaluation set don't have a corresponding argument in `Wav2Vec2ForCTC.forward` and have been ignored: input_length. If input_length are not expected by `Wav2Vec2ForCTC.forward`, you can safely ignore this message.\n", "ERROR 2022-05-24T07:41:05.163871 Batch size = 12 | 9500/499680 [21:07:40<130:15:10, 1.05it/s]The following columns in the evaluation set don't have a corresponding argument in `Wav2Vec2ForCTC.forward` and have been ignored: input_length. If input_length are not expected by `Wav2Vec2ForCTC.forward`, you can safely ignore this message.\n"]}}, 'dropped': 0}} 2022-05-24 09:57:06,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:06,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:06,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:06,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:06,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:06,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:06,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:06,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:06,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:06,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:06,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:06,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:06,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:06,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:06,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:06,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:08,261 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:57:08,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:08,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:08,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:08,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:08,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:08,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:08,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:08,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:08,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:08,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:08,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:08,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:08,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:08,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:08,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:08,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:08,589 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:57:12,590 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:57:12,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:12,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:12,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:12,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:12,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:12,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:12,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:12,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:12,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:12,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:12,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:12,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:12,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:12,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:12,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:12,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:13,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:13,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:13,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:13,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:13,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:13,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:13,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:13,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:13,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:13,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:13,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:13,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:13,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:13,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:13,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:13,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:14,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:14,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:14,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:14,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:14,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:14,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:14,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:14,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:14,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:14,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:14,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:14,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:14,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:14,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:14,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:14,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:16,592 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:57:17,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:57:17,595 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:57:20,594 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:57:23,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:23,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:23,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:23,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:23,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:23,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:23,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:23,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:23,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:23,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:23,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:23,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:23,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:23,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:23,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:23,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:24,595 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:57:24,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:24,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:24,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:24,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:24,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:24,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:24,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:24,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:24,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:24,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:24,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:24,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:24,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:24,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:24,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:24,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:25,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:25,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:25,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:25,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:25,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:25,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:25,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:25,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:25,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:25,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:25,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:25,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:25,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:25,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:25,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:25,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:26,596 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:57:29,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:29,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:29,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:29,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:29,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:29,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:29,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:29,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:30,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:30,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:30,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:30,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:30,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:30,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:30,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:30,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:30,598 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:57:32,599 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:57:32,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:57:32,902 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:57:33,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:33,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:33,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:33,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:33,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:33,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:33,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:33,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:33,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:33,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:33,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:33,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:33,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:33,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:33,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:33,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:36,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:57:38,332 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:57:40,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:57:40,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:40,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:40,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:40,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:40,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:40,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:40,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:40,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:40,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:40,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:40,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:40,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:40,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:40,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:40,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:40,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:40,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:40,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:40,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:40,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:40,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:40,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:40,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:40,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:40,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:40,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:40,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:40,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:40,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:40,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:40,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:40,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:42,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:42,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:42,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:42,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:42,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:42,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:42,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:42,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:42,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:42,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:42,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:42,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:42,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:42,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:42,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:42,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:42,603 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:57:43,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:43,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:43,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:43,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:43,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:43,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:43,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:43,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:43,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:43,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:43,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:43,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:43,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:43,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:43,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:43,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:45,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:57:48,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:57:48,130 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:57:49,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:49,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:49,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:49,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:49,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:49,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:49,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:49,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:49,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:49,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:49,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:49,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:49,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:49,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:49,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:49,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:49,606 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:57:51,607 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:57:51,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:51,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:51,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:51,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:51,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:51,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:51,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:51,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:51,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:51,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:51,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:51,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:51,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:51,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:51,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:51,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:51,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:51,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:51,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:51,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:51,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:51,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:51,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:51,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:51,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:51,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:51,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:51,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:51,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:51,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:51,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:51,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:53,607 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:57:56,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:56,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:56,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:56,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:56,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:56,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:56,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:56,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:56,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:56,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:56,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:56,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:56,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:56,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:56,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:56,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:57:57,609 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:57:59,610 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:58:01,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:58:03,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:03,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:03,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:03,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:03,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:03,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:03,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:03,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:03,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:03,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:03,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:03,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:03,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:03,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:03,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:03,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:03,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:58:03,554 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:58:03,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:58:05,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:05,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:05,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:05,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:05,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:05,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:05,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:05,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:05,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:05,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:05,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:05,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:05,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:05,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:05,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:05,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:05,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:58:08,399 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:58:08,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:08,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:08,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:08,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:08,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:08,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:08,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:08,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:08,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:08,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:08,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:08,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:08,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:08,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:08,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:08,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:09,614 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:58:09,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:09,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:09,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:09,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:09,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:09,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:09,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:09,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:09,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:09,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:09,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:09,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:09,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:09,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:09,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:09,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:11,615 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:58:13,615 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:58:14,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:14,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:14,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:14,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:14,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:14,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:14,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:14,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:14,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:14,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:14,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:14,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:14,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:14,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:14,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:14,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:15,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:58:17,617 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:58:18,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:18,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:18,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:18,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:18,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:18,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:18,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:18,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:18,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:18,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:18,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:18,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:18,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:18,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:18,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:18,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:18,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:58:18,784 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:58:19,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:58:21,619 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:58:22,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:22,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:22,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:22,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:22,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:22,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:22,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:22,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:22,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:22,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:22,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:22,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:22,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:22,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:22,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:22,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:23,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:23,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:23,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:23,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:23,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:23,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:23,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:23,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:23,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:23,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:23,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:23,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:23,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:23,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:23,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:23,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:23,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:58:24,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:24,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:24,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:24,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:24,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:24,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:24,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:24,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:24,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:24,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:24,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:24,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:24,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:24,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:24,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:24,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:25,621 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:58:26,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:26,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:26,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:26,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:26,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:26,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:26,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:26,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:26,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:26,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:26,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:26,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:26,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:26,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:26,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:26,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:27,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:27,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:27,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:27,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:27,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:27,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:27,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:27,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:27,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:27,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:27,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:27,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:27,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:27,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:27,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:27,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:27,622 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:58:29,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:29,623 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:58:31,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:31,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:31,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:31,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:31,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:31,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:31,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:31,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:31,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:31,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:31,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:31,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:31,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:31,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:31,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:31,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:31,626 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:58:31,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:31,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:31,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:31,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:31,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:31,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:31,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:31,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:31,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:31,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:31,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:31,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:31,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:31,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:31,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:31,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:32,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:32,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:32,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:32,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:32,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:32,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:32,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:32,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:32,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:32,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:32,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:32,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:32,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:32,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:32,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:32,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:33,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:58:34,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:58:34,002 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:58:35,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:58:37,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:37,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:37,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:37,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:37,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:37,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:37,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:37,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:37,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:37,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:37,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:37,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:37,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:37,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:37,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:37,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:37,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:58:38,469 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:58:39,629 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:58:41,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:41,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:41,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:41,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:41,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:41,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:41,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:41,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:41,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:41,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:41,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:41,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:41,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:41,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:41,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:41,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:41,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:58:42,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:42,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:42,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:42,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:42,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:42,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:42,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:42,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:42,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:42,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:42,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:42,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:42,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:42,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:42,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:42,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:43,631 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:58:43,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:43,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:43,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:43,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:43,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:43,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:43,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:43,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:43,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:43,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:43,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:43,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:43,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:43,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:43,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:43,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:44,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:44,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:44,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:44,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:44,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:44,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:44,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:44,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:44,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:44,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:44,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:44,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:44,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:44,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:44,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:44,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:45,632 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:58:47,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:58:47,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:47,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:48,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:48,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:48,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:48,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:48,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:48,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:48,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:48,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:48,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:48,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:48,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:48,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:49,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:58:49,346 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:58:49,635 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:58:51,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:51,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:51,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:51,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:51,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:51,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:51,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:51,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:51,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:51,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:51,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:51,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:51,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:51,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:51,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:51,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:53,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:53,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:53,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:53,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:53,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:53,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:53,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:53,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:53,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:53,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:53,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:53,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:53,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:53,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:53,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:53,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:54,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:54,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:54,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:54,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:54,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:54,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:54,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:54,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:54,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:54,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:54,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:54,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:54,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:54,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:54,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:54,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:58:59,639 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:59:03,640 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:59:04,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:59:04,981 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:59:07,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:59:08,532 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:59:11,644 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:59:13,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:13,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:13,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:13,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:13,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:13,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:13,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:13,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:13,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:13,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:13,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:13,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:13,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:13,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:13,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:13,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:14,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:15,645 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:59:19,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:59:20,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:20,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:20,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:20,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:20,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:20,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:20,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:20,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:20,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:20,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:20,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:20,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:20,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:20,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:20,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:20,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:20,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:59:20,355 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:59:23,649 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:59:27,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:59:28,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:28,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:28,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:28,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:28,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:28,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:28,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:28,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:28,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:28,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:28,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:28,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:28,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:28,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:28,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:28,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:28,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:28,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:28,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:28,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:28,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:28,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:28,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:28,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:28,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:28,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:28,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:28,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:28,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:28,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:28,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:28,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:29,651 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:59:29,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:29,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:29,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:29,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:29,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:29,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:29,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:29,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:29,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:29,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:29,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:29,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:29,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:29,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:29,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:29,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:31,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:31,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:31,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:31,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:31,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:31,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:31,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:31,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:31,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:31,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:31,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:31,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:31,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:31,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:31,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:31,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:33,653 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:59:35,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:59:35,642 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:59:35,653 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:59:37,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:37,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:37,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:37,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:37,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:37,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:37,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:37,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:37,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:37,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:37,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:37,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:37,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:37,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:37,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:37,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:38,604 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 09:59:40,655 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:59:42,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:59:42,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:42,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:44,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:44,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:44,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:44,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:44,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:44,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:44,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:44,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:44,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:44,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:44,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:44,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:44,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:44,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:44,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:44,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:46,658 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:59:48,659 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:59:50,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:50,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:50,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:50,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:50,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:50,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:50,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:50,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:50,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:50,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:50,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:50,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:50,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:50,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:50,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:50,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:50,660 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:59:50,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 09:59:50,867 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 09:59:51,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:51,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:51,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:51,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:51,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:51,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:51,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:51,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:51,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:51,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:51,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:51,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:52,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:52,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:52,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:52,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:52,660 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:59:55,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:55,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:55,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:55,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:55,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:55,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:55,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:55,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:55,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:55,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:55,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:55,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:55,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:55,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:55,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:55,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:56,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:59:58,663 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 09:59:59,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:59,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:59,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:59,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:59,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:59,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:59,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:59,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:59,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:59,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:59,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:59,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:59,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:59,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:59,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 09:59:59,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:00,664 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:00:02,665 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:00:04,665 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:00:04,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:04,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:04,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:04,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:04,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:04,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:04,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:04,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:04,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:04,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:04,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:04,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:04,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:04,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:04,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:04,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:05,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:05,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:05,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:05,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:05,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:05,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:05,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:05,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:05,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:05,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:05,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:05,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:05,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:05,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:05,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:05,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:06,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:00:06,099 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:00:06,666 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:00:08,679 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:00:10,668 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:00:11,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:11,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:11,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:11,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:11,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:11,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:11,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:11,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:11,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:11,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:11,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:11,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:11,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:11,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:11,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:11,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:11,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:11,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:11,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:11,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:11,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:11,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:11,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:11,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:11,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:11,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:11,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:11,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:11,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:11,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:11,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:11,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:12,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:12,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:12,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:12,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:12,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:12,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:12,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:12,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:12,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:12,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:12,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:12,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:12,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:12,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:12,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:12,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:12,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:00:14,670 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:00:16,671 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:00:18,672 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:00:19,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:19,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:19,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:19,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:19,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:19,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:19,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:19,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:19,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:19,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:19,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:19,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:19,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:19,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:19,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:19,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:20,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:00:21,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:00:21,337 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:00:22,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:22,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:22,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:22,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:22,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:22,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:22,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:22,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:22,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:22,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:22,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:22,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:22,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:22,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:22,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:22,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:22,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:00:23,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:23,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:23,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:23,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:23,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:23,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:23,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:23,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:23,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:23,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:23,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:23,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:23,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:23,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:23,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:23,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:24,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:24,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:24,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:24,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:24,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:24,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:24,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:24,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:24,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:24,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:24,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:24,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:24,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:24,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:24,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:24,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:24,674 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:00:26,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:26,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:26,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:26,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:26,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:26,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:26,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:26,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:26,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:26,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:26,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:26,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:26,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:26,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:26,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:26,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:26,675 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:00:28,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,676 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:00:28,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:28,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:29,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:29,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:29,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:29,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:29,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:29,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:29,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:29,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:29,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:29,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:29,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:29,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:29,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:29,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:29,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:29,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:29,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:29,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:29,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:29,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:29,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:29,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:29,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:29,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:29,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:29,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:29,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:29,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:29,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:29,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:30,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:00:32,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:32,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:32,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:32,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:32,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:32,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:32,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:32,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:32,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:32,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:32,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:32,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:32,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:32,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:32,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:32,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:32,678 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:00:33,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:33,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:33,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:33,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:33,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:33,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:33,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:33,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:33,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:33,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:33,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:33,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:33,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:33,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:33,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:33,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:34,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:34,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:34,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:34,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:34,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:34,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:34,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:34,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:34,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:34,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:34,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:34,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:34,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:34,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:34,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:34,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:34,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:00:36,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:00:36,678 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:00:36,680 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:00:38,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:00:38,748 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:00:39,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:39,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:39,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:39,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:39,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:39,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:39,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:39,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:39,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:39,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:39,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:39,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:39,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:39,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:39,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:39,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:40,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:00:40,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:40,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:40,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:40,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:40,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:40,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:40,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:40,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:40,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:40,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:40,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:40,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:40,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:40,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:40,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:40,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:41,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:41,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:41,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:41,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:41,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:41,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:41,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:41,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:41,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:41,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:41,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:41,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:41,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:41,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:41,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:41,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:42,682 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:00:43,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:43,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:43,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:43,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:43,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:43,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:43,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:43,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:43,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:43,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:43,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:43,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:43,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:43,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:43,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:43,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:44,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:44,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:44,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:44,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:44,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:44,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:44,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:44,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:44,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:44,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:44,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:44,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:44,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:44,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:44,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:44,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:44,683 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:00:44,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:44,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:44,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:44,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:45,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:45,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:45,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:45,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:45,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:45,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:45,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:45,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:45,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:45,312 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 10:00:45,549 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 10:00:45,616 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 10:00:45,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 10:00:46,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:00:48,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:48,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:48,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:48,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:48,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:48,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:48,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:48,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:48,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:48,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:48,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:48,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:48,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:48,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:48,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:48,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:49,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:49,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:49,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:49,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:49,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:49,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:49,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:49,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:49,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:49,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:49,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:49,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:49,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:49,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:49,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:49,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:51,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:00:51,925 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:00:53,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:53,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:53,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:53,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:53,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:53,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:53,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:53,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:53,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:53,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:53,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:53,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:53,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:53,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:53,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:53,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:53,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:53,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:53,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:53,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:53,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:53,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:53,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:53,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:53,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:53,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:53,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:53,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:53,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:53,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:53,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:53,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:55,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:55,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:55,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:55,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:55,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:55,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:55,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:55,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:55,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:55,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:55,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:55,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:55,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:55,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:55,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:55,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:56,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:00:58,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:58,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:59,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:59,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:59,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:59,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:59,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:59,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:59,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:59,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:59,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:59,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:59,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:59,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:59,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:00:59,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:00,689 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:01:04,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:01:07,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:01:07,150 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:01:08,693 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:01:08,873 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:01:09,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:09,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:09,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:09,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:09,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:09,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:09,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:09,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:09,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:09,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:09,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:09,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:09,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:09,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:09,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:09,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:12,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:01:15,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:15,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:15,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:15,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:15,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:15,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:15,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:15,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:16,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:16,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:16,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:16,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:16,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:16,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:16,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:16,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:16,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:16,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:16,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:16,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:16,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:16,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:16,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:16,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:16,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:16,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:16,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:16,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:16,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:16,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:16,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:16,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:16,696 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:01:20,698 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:01:21,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:21,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:21,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:21,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:21,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:21,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:21,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:21,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:21,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:21,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:21,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:21,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:21,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:21,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:21,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:21,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:21,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:21,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:21,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:21,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:21,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:21,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:21,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:21,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:21,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:21,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:21,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:21,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:21,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:21,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:21,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:21,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:22,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:01:22,511 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:01:23,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:23,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:23,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:23,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:23,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:23,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:23,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:23,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:23,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:23,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:23,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:23,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:23,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:23,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:23,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:23,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:24,699 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:01:26,700 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:01:28,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:28,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:28,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:28,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:28,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:28,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:28,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:28,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:28,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:28,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:28,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:28,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:28,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:28,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:28,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:28,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:29,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:29,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:29,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:29,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:29,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:29,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:29,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:29,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:29,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:29,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:29,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:29,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:29,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:29,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:29,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:29,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:30,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:30,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:30,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:30,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:30,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:30,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:30,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:30,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:30,702 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:01:30,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:30,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:30,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:30,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:30,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:30,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:30,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:30,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:32,703 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:01:33,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:33,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:33,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:33,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:33,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:33,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:33,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:33,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:33,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:33,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:33,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:33,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:33,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:33,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:33,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:33,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:36,704 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:01:37,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:01:37,764 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:01:38,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:01:38,950 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:01:39,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:39,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:39,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:39,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:39,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:39,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:39,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:39,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:39,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:39,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:39,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:39,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:39,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:39,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:39,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:39,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:40,706 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:01:43,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:43,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:43,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:43,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:43,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:43,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:43,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:43,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:43,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:43,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:43,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:43,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:43,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:43,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:43,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:43,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:43,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:43,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:43,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:43,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:43,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:43,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:43,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:43,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:43,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:43,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:43,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:43,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:43,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:43,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:43,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:43,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:44,707 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:01:44,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:44,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:44,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:44,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:44,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:44,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:44,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:44,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:44,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:44,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:44,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:44,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:44,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:44,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:44,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:44,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:46,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:46,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:46,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:46,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:46,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:46,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:46,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:46,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:46,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:46,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:46,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:46,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:46,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:46,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:46,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:46,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:46,708 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:01:48,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:01:52,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:52,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:52,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:52,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:52,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:52,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:52,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:52,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:52,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:52,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:52,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:52,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:52,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:52,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:52,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:52,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:52,711 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:01:53,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:01:53,013 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:01:54,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:01:56,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:56,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:56,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:56,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:56,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:56,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:56,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:56,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:56,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:56,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:56,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:56,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:56,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:56,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:56,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:56,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:56,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:01:58,713 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:01:59,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:59,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:59,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:59,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:59,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:59,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:59,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:59,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:59,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:59,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:59,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:59,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:59,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:59,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:59,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:59,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:59,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:59,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:59,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:59,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:59,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:59,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:59,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:59,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:59,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:59,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:59,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:59,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:59,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:59,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:59,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:01:59,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:00,714 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:02:02,715 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:02:06,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:06,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:06,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:06,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:06,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:06,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:06,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:06,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:06,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:06,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:06,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:06,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:06,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:06,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:06,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:06,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:07,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:07,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:07,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:07,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:07,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:07,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:07,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:07,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:07,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:07,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:07,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:07,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:07,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:07,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:07,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:07,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:07,717 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:02:08,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:02:08,354 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:02:09,026 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:02:09,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:09,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:09,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:09,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:09,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:09,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:09,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:09,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:09,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:09,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:09,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:09,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:09,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:09,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:09,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:09,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:09,718 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:02:11,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:11,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:11,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:11,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:11,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:11,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:11,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:11,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:11,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:11,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:11,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:11,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:11,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:11,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:11,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:11,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:11,719 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:02:13,720 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:02:14,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:14,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:14,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:14,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:14,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:14,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:14,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:14,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:14,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:14,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:14,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:14,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:14,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:14,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:14,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:14,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:15,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:02:17,722 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:02:19,723 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:02:20,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:20,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:20,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:20,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:20,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:20,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:20,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:20,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:20,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:20,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:20,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:20,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:20,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:20,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:20,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:20,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:20,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:20,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:20,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:20,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:20,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:20,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:20,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:20,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:20,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:20,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:20,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:20,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:20,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:20,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:20,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:20,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:21,723 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:02:23,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:23,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:23,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:23,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:23,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:23,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:23,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:23,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:23,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:23,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:23,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:23,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:23,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:23,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:23,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:23,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:23,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:02:23,578 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:02:23,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:23,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:23,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:23,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:23,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:23,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:23,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:23,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:23,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:23,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:23,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:23,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:23,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:23,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:23,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:23,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:23,724 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:02:25,725 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:02:26,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:26,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:26,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:26,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:26,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:26,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:26,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:26,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:26,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:26,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:26,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:26,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:26,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:26,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:26,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:26,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:27,726 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:02:28,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:28,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:28,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:28,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:28,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:28,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:28,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:28,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:28,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:28,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:28,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:28,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:28,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:28,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:28,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:28,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:28,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:28,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:28,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:28,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:28,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:28,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:28,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:28,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:28,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:28,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:28,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:28,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:28,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:28,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:28,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:28,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,727 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:02:29,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:29,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:30,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:30,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:30,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:30,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:30,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:30,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:30,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:30,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:30,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:30,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:30,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:30,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:30,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:30,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:30,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:30,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:31,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:02:33,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:33,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:33,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:33,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:33,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:33,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:33,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:33,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:33,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:33,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:33,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:33,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:33,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:33,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:33,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:33,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:33,729 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:02:33,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:33,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:33,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:33,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:33,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:33,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:33,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:33,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:33,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:33,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:33,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:33,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:33,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:33,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:33,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:33,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:35,730 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:02:37,730 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:02:38,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:38,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:38,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:38,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:38,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:38,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:38,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:38,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:38,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:38,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:38,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:38,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:38,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:38,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:38,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:38,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:38,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:02:38,943 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:02:39,172 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:02:39,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:39,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:39,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:39,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:39,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:39,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:39,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:39,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:39,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:39,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:39,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:39,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:39,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:39,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:39,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:39,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:39,731 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:02:41,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:41,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:41,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:41,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:41,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:41,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:41,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:41,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:41,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:41,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:41,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:41,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:41,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:41,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:41,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:41,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:41,732 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:02:41,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:41,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:41,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:41,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:42,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:42,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:42,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:42,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:42,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:42,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:42,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:42,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:43,733 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:02:47,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:47,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:47,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:47,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:47,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:47,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:47,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:47,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:47,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:47,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:47,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:47,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:47,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:47,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:47,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:47,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:54,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:02:54,174 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:02:54,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:54,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:54,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:54,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:54,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:54,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:54,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:54,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:54,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:54,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:54,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:54,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:54,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:54,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:54,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:54,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:55,738 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:02:57,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:57,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:02:59,739 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:03:01,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:02,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:02,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:02,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:02,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:02,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:02,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:02,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:02,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:02,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:02,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:02,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:02,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:02,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:02,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:02,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:02,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:02,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:02,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:02,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:02,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:02,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:02,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:02,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:02,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:02,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:02,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:02,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:02,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:02,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:02,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:02,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:05,741 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:03:06,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:06,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:06,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:06,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:06,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:06,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:06,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:06,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:06,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:06,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:06,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:06,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:06,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:06,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:06,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:06,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:09,171 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:03:09,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:03:09,538 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:03:09,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:03:11,744 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:03:15,746 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:03:18,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:18,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:18,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:18,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:18,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:18,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:18,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:18,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:18,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:18,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:18,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:18,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:18,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:18,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:18,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:18,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:19,747 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:03:21,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:21,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:21,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:21,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:21,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:21,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:21,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:21,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:21,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:21,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:21,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:21,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:21,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:21,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:21,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:21,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:22,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:22,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:22,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:22,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:22,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:22,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:22,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:22,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:22,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:22,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:22,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:22,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:22,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:22,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:22,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:22,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:23,749 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:03:24,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:03:24,764 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:03:26,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:26,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:26,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:26,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:26,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:26,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:26,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:26,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:26,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:26,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:26,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:26,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:26,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:26,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:26,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:26,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:26,750 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:03:28,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:28,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:28,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:28,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:28,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:28,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:28,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:28,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:28,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:28,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:28,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:28,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:28,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:28,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:28,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:28,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:29,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:29,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:29,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:29,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:29,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:29,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:29,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:29,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:29,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:29,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:29,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:29,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:29,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:29,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:29,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:29,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:30,752 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:03:31,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:31,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:31,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:31,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:31,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:31,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:31,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:31,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:31,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:31,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:31,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:31,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:31,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:31,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:31,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:31,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:34,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:34,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:34,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:34,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:34,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:34,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:34,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:34,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:34,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:34,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:34,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:34,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:34,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:34,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:34,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:34,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:34,753 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:03:36,754 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:03:38,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:38,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:38,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:38,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:38,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:38,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:38,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:38,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:38,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:38,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:38,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:38,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:38,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:38,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:38,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:38,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:38,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:38,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:38,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:38,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:38,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:38,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:38,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:38,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:38,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:38,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:38,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:38,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:38,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:38,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:38,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:38,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:39,244 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:03:39,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:03:39,983 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:03:40,756 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:03:42,757 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:03:44,758 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:03:46,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:46,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:46,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:46,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:46,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:46,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:46,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:46,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:46,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:46,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:46,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:46,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:46,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:46,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:46,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:46,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:48,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:48,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:48,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:48,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:48,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:48,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:48,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:48,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:48,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:48,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:48,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:48,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:48,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:48,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:48,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:48,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:48,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:03:49,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:49,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:49,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:49,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:49,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:49,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:49,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:49,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:49,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:49,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:49,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:49,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:49,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:49,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:49,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:49,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:50,761 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:03:52,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:03:54,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:54,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:54,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:54,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:54,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:54,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:54,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:54,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:54,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:54,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:54,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:54,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:54,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:54,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:54,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:54,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:54,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:03:55,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:03:55,216 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:03:56,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:56,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:56,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:56,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:56,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:56,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:56,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:56,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:56,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:56,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:56,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:56,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:56,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:56,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:56,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:56,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:57,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:57,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:57,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:57,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:57,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:57,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:57,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:57,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:57,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:57,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:57,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:57,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:57,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:57,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:57,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:57,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:58,764 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:03:59,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:59,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:59,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:59,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:59,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:59,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:59,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:59,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:59,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:59,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:59,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:59,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:59,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:59,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:59,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:03:59,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:00,765 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:04:02,766 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:04:02,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:02,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:02,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:02,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:02,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:02,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:02,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:02,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:02,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:02,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:02,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:02,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:02,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:02,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:02,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:02,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:04,767 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:04:05,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:05,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:05,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:05,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:05,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:05,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:05,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:05,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:05,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:05,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:05,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:05,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:05,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:05,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:05,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:05,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:06,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:04:08,769 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:04:09,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:09,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:09,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:09,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:09,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:09,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:09,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:09,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:09,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:09,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:09,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:09,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:09,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:09,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:09,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:09,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:09,317 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:04:10,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:04:10,606 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:04:10,770 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:04:12,771 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:04:14,772 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:04:15,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:15,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:15,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:15,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:15,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:15,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:15,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:15,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:15,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:15,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:15,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:15,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:15,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:15,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:15,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:15,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:16,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:04:17,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:17,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:17,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:17,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:17,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:17,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:17,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:17,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:17,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:17,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:17,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:17,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:17,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:17,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:17,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:17,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:18,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:04:20,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:20,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:20,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:20,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:20,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:20,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:20,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:20,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:20,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:20,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:20,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:20,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:20,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:20,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:20,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:20,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:20,775 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:04:20,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:20,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:20,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:20,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:20,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:20,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:20,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:20,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:20,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:20,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:20,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:20,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:20,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:20,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:20,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:20,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:22,776 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:04:23,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:23,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:23,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:23,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:23,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:23,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:23,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:24,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:24,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:24,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:24,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:24,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:24,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:24,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:24,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:24,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:24,776 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:04:26,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:04:26,218 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:04:26,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:26,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:26,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:26,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:26,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:26,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:26,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:26,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:26,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:26,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:26,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:26,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:26,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:26,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:26,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:26,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:26,777 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:04:28,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:28,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:28,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:28,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:28,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:28,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:28,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:28,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:28,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:28,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:28,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:28,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:28,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:28,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:28,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:28,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:28,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:04:29,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:29,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:29,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:29,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:29,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:29,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:29,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:29,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:29,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:29,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:29,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:29,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:29,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:29,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:29,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:29,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:29,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:29,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:29,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:29,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:29,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:29,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:29,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:29,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:29,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:29,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:29,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:29,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:29,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:29,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:29,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:29,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:30,779 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:04:32,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:32,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:32,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:32,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:32,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:32,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:32,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:32,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:32,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:32,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:32,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:32,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:32,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:32,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:32,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:32,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:32,779 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:04:33,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:33,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:34,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:34,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:34,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:34,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:34,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:34,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:34,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:34,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:34,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:34,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:34,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:34,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:34,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:34,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:34,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:34,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:34,780 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:04:35,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:35,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:35,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:35,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:35,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:35,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:35,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:35,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:35,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:35,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:35,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:35,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:35,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:35,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:35,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:35,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:36,781 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:04:37,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:37,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:37,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:37,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:37,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:37,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:37,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:37,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:37,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:37,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:37,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:37,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:37,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:37,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:37,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:37,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:38,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:38,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:38,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:38,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:38,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:38,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:38,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:38,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:38,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:38,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:38,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:38,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:38,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:38,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:38,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:38,148 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:38,781 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:04:39,390 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:04:40,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:40,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:40,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:40,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:40,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:40,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:40,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:40,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:40,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:40,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:40,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:40,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:40,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:40,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:40,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:40,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:40,782 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:04:41,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:04:41,446 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:04:42,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:04:43,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:43,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:43,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:43,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:43,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:43,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:43,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:43,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:43,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:43,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:43,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:43,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:43,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:43,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:43,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:43,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:43,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:43,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:43,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:43,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:43,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:43,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:43,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:43,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:43,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:43,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:43,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:43,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:43,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:43,425 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 10:04:43,649 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 10:04:43,715 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 10:04:43,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 10:04:44,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:04:45,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:04:52,787 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:04:55,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:55,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:55,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:55,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:55,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:55,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:55,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:55,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:55,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:55,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:55,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:55,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:55,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:55,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:55,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:55,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:56,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:56,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:56,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:56,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:56,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:56,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:56,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:56,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:56,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:56,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:56,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:56,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:56,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:56,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:56,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:56,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:04:56,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:04:56,675 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:04:58,789 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:05:02,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:02,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:02,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:02,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:02,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:02,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:02,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:02,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:02,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:02,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:02,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:02,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:02,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:02,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:02,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:02,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:03,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:03,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:03,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:03,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:03,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:03,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:03,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:03,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:03,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:03,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:03,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:03,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:03,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:03,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:03,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:03,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:03,791 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:05:07,792 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:05:08,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:08,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:08,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:08,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:08,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:08,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:08,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:08,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:08,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:08,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:08,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:08,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:08,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:08,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:08,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:08,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:08,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:08,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:08,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:08,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:08,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:08,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:08,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:08,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:08,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:08,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:08,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:08,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:08,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:08,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:08,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:08,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:09,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:09,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:09,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:09,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:09,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:09,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:09,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:09,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:09,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:09,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:09,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:09,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:09,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:09,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:09,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:09,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:09,781 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:05:11,794 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:05:12,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:05:12,024 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:05:15,795 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:05:18,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:18,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:18,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:18,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:18,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:18,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:18,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:18,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:18,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:18,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:18,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:18,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:18,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:18,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:18,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:18,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:19,797 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:05:20,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:20,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:20,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:20,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:20,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:20,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:20,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:20,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:20,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:20,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:20,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:20,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:20,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:20,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:20,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:20,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:23,799 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:05:25,800 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:05:27,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:05:27,255 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:05:29,801 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:05:29,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:29,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:29,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:29,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:29,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:29,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:29,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:29,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:29,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:29,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:29,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:29,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:29,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:29,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:29,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:29,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:30,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:30,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:30,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:30,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:30,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:30,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:30,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:30,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:30,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:30,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:30,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:30,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:30,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:30,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:30,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:30,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:30,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:30,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:30,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:30,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:30,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:30,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:30,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:30,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:30,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:30,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:30,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:30,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:30,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:30,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:30,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:30,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:31,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:31,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:31,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:31,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:31,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:31,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:31,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:31,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:31,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:31,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:31,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:31,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:31,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:31,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:31,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:31,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:32,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:32,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:32,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:32,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:32,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:32,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:32,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:32,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:32,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:32,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:32,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:32,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:32,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:32,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:32,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:32,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:33,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:05:34,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:34,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:34,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:34,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:34,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:34,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:34,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:34,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:34,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:34,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:34,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:34,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:34,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:34,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:34,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:34,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:35,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:05:36,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:36,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:36,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:36,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:36,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:36,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:36,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:36,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:36,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:36,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:36,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:36,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:36,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:36,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:36,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:36,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:39,805 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:05:39,862 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:05:41,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:05:42,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:42,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:42,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:42,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:42,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:42,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:42,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:42,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:42,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:42,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:42,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:42,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:42,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:42,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:42,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:42,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:42,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:05:42,631 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:05:43,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:05:44,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:44,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:44,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:44,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:44,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:44,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:44,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:44,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:44,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:44,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:44,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:44,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:44,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:44,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:44,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:44,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:45,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:45,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:45,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:45,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:45,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:45,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:45,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:45,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:45,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:45,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:45,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:45,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:45,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:45,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:45,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:45,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:47,808 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:05:49,809 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:05:50,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:50,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:50,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:50,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:50,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:50,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:50,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:50,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:50,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:50,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:50,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:50,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:50,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:50,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:50,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:50,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:51,809 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:05:53,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:53,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:53,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:53,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:53,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:53,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:53,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:53,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:53,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:53,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:53,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:53,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:53,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:53,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:53,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:53,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:54,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:54,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:54,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:54,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:54,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:54,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:54,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:54,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:54,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:54,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:54,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:54,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:54,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:54,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:54,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:54,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:55,811 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:05:57,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:05:58,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:05:58,022 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:05:59,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:59,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:59,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:59,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:59,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:59,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:59,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:59,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:59,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:59,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:59,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:59,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:59,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:59,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:59,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:59,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:05:59,813 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:06:01,814 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:06:03,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:03,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:03,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:03,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:03,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:03,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:03,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:03,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:03,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:03,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:03,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:03,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:03,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:03,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:03,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:03,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:03,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:06:04,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:04,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:04,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:04,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:04,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:04,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:04,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:04,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:04,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:04,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:04,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:04,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:04,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:04,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:04,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:04,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:04,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:04,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:04,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:04,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:04,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:04,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:04,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:04,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:04,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:04,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:04,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:04,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:04,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:04,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:04,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:04,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:05,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:06:06,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:06,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:06,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:06,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:06,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:06,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:06,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:06,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:06,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:06,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:06,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:06,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:06,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:06,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:06,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:06,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:09,817 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:06:09,945 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:06:10,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:10,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:10,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:10,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:10,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:10,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:10,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:10,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:10,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:10,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:10,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:10,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:10,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:10,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:10,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:10,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:11,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:06:12,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:12,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:12,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:12,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:12,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:12,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:12,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:12,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:12,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:12,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:12,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:12,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:12,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:12,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:12,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:12,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:13,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:06:15,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:06:15,117 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:06:15,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:06:16,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:16,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:16,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:16,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:16,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:16,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:16,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:16,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:16,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:16,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:16,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:16,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:16,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:16,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:16,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:16,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:17,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:06:19,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:06:19,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:19,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:19,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:19,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:19,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:19,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:19,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:19,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:19,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:19,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:19,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:19,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:19,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:19,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:19,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:19,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:20,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:20,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:20,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:20,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:20,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:20,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:20,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:20,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:20,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:20,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:20,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:20,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:20,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:20,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:20,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:20,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:21,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:06:23,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:06:25,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:06:26,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:26,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:26,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:26,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:26,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:26,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:26,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:26,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:26,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:26,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:26,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:26,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:26,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:26,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:26,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:26,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:27,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:06:28,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:28,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:28,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:28,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:28,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:28,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:28,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:28,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:28,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:28,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:28,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:28,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:28,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:28,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:28,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:28,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:29,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:06:30,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:06:30,432 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:06:30,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:30,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:30,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:30,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:30,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:30,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:30,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:30,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:30,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:30,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:30,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:30,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:30,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:30,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:30,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:30,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:31,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:31,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:31,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:31,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:31,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:31,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:31,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:31,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:31,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:31,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:31,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:31,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:31,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:31,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:31,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:31,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:31,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:31,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:31,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:31,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:31,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:31,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:31,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:31,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:31,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:31,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:31,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:31,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:31,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:31,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:31,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:31,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:31,826 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:06:32,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:32,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:32,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:32,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:32,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:32,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:32,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:32,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:32,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:32,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:32,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:32,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:32,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:32,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:32,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:32,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:33,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:06:34,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:34,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:34,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:34,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:34,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:34,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:34,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:34,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:34,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:34,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:34,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:34,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:34,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:34,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:34,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:34,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:35,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:06:36,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:36,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:36,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:36,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:36,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:36,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:36,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:36,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:36,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:36,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:36,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:36,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:36,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:36,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:36,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:36,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:37,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:37,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:37,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:37,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:37,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:37,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:37,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:37,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:37,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:37,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:37,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:37,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:37,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:37,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:37,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:37,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:37,829 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:06:37,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:37,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:37,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:37,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:37,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:37,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:37,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:37,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:37,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:37,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:37,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:37,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:37,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:37,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:37,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:37,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:38,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:38,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:38,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:38,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:38,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:38,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:38,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:38,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:38,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:38,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:38,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:38,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:38,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:38,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:38,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:38,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:38,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:38,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:38,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:38,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:38,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:38,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:38,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:38,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:38,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:38,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:38,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:38,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:38,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:38,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:38,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:38,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:39,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:06:40,025 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:06:40,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:40,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:40,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:40,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:40,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:40,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:40,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:40,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:40,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:40,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:40,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:40,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:40,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:40,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:40,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:40,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:41,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:41,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:41,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:41,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:41,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:41,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:41,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:41,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:41,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:41,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:41,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:41,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:41,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:41,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:41,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:41,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:41,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:06:43,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:43,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:43,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:43,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:43,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:43,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:43,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:43,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:43,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:43,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:43,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:43,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:43,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:43,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:43,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:43,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:43,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:06:44,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:44,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:44,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:44,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:44,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:44,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:44,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:44,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:44,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:44,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:44,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:44,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:06:45,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:06:45,861 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:06:46,833 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:06:56,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:07:01,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:07:01,137 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:07:02,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:07:03,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:03,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:03,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:03,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:03,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:03,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:03,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:03,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:03,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:03,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:03,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:03,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:03,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:03,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:03,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:03,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:04,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:07:05,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:05,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:05,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:05,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:05,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:05,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:05,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:05,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:05,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:05,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:05,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:05,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:05,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:05,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:05,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:05,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:08,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:07:09,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:09,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:09,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:09,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:09,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:09,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:09,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:09,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:09,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:09,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:09,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:09,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:09,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:09,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:09,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:09,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:10,181 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:07:11,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:11,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:11,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:11,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:11,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:11,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:11,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:11,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:11,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:11,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:11,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:11,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:11,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:11,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:11,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:11,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:12,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:07:16,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:07:16,495 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:07:16,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:07:17,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:17,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:17,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:17,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:17,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:17,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:17,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:17,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:17,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:17,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:17,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:17,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:17,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:17,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:17,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:17,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:18,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:18,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:18,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:18,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:18,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:18,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:18,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:18,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:18,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:18,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:18,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:18,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:18,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:18,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:18,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:18,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:19,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:19,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:19,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:19,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:19,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:19,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:19,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:19,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:19,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:19,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:19,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:19,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:19,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:19,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:19,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:19,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:20,846 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:07:21,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:21,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:21,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:21,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:21,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:21,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:21,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:21,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:21,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:21,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:21,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:21,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:21,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:21,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:21,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:21,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:24,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:07:27,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:27,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:27,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:27,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:27,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:27,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:27,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:27,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:27,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:27,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:27,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:27,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:27,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:27,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:27,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:27,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:28,849 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:07:29,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:29,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:29,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:29,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:29,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:29,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:29,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:29,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:29,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:29,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:29,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:29,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:29,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:29,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:29,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:29,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:30,850 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:07:31,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:07:31,791 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:07:34,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:07:36,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:07:37,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:37,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:37,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:37,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:37,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:37,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:37,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:37,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:37,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:37,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:37,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:37,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:37,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:37,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:37,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:37,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:38,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:38,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:38,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:38,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:38,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:38,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:38,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:38,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:38,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:38,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:38,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:38,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:38,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:38,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:38,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:38,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:39,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:39,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:39,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:39,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:39,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:39,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:39,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:39,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:39,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:39,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:39,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:39,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:39,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:39,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:39,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:39,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:40,288 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:07:40,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:40,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:40,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:40,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:40,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:40,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:40,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:40,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:40,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:40,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:40,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:40,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:40,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:40,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:40,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:40,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:40,854 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:07:41,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:41,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:41,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:41,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:41,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:41,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:41,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:41,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:41,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:41,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:41,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:41,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:41,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:41,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:41,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:41,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:41,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:41,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:41,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:41,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:41,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:41,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:41,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:41,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:41,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:41,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:41,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:41,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:41,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:41,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:41,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:41,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:42,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:07:46,856 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:07:47,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:07:47,020 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:07:48,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:48,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:48,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:48,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:48,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:48,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:48,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:48,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:48,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:48,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:48,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:48,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:48,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:48,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:48,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:48,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:48,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:07:50,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:07:52,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:52,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:52,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:52,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:52,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:52,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:52,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:52,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:52,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:52,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:52,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:52,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:52,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:52,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:52,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:52,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:53,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:53,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:53,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:53,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:53,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:53,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:53,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:53,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:53,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:53,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:53,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:53,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:53,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:53,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:53,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:53,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:54,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:54,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:54,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:54,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:54,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:54,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:54,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:54,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:54,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:54,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:54,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:54,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:54,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:54,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:54,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:54,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:54,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:07:56,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:07:58,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:07:59,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:59,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:59,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:59,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:59,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:59,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:59,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:59,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:59,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:59,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:59,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:59,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:59,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:59,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:59,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:59,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:59,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:59,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:59,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:59,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:59,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:59,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:59,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:59,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:59,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:59,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:59,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:59,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:59,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:59,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:59,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:07:59,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:00,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:08:02,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:08:02,247 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:08:04,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:04,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:04,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:04,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:04,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:04,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:04,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:04,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:04,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:04,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:04,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:04,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:04,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:04,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:04,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:04,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:04,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:08:05,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:05,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:05,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:05,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:05,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:05,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:05,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:05,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:05,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:05,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:05,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:05,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:05,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:05,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:05,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:05,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:06,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:08:08,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:08,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:08,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:08,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:08,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:08,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:08,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:08,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:08,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:08,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:08,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:08,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:08,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:08,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:08,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:08,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:08,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:08:10,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:10,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:10,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:10,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:10,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:10,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:10,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:10,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:10,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:10,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:10,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:10,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:10,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:10,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:10,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:10,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:10,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:10,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:10,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:10,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:10,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:10,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:10,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:10,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:10,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:10,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:10,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:10,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:10,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:10,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:10,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:10,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:10,362 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:08:10,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:08:12,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:12,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:12,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:12,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:12,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:12,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:12,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:12,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:12,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:12,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:12,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:12,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:12,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:12,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:12,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:12,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:13,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:08:14,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:14,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:14,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:14,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:14,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:14,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:14,458 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:14,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:14,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:14,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:14,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:14,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:14,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:14,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:14,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:14,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:15,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:08:17,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:08:17,479 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:08:17,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:08:18,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:18,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:18,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:18,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:18,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:18,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:18,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:18,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:18,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:18,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:18,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:18,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:18,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:18,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:18,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:18,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:19,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:08:21,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:08:22,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:22,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:22,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:22,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:22,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:22,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:22,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:22,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:22,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:22,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:22,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:22,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:22,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:22,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:22,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:22,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:23,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:08:25,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:08:27,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:27,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:27,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:27,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:27,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:27,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:27,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:27,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:27,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:27,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:27,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:27,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:27,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:27,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:27,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:27,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:27,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:08:27,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:27,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:27,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:27,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:27,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:27,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:27,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:27,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:27,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:27,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:27,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:27,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:27,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:27,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:27,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:27,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:29,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:08:31,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:08:31,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:31,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:31,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:31,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:31,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:31,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:31,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:31,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:31,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:31,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:31,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:31,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:31,928 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:31,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:31,929 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:31,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:32,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:08:32,704 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:08:33,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:33,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:33,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:33,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:33,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:33,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:33,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:33,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:33,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:33,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:33,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:33,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:33,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:33,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:33,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:33,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:33,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:08:34,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:34,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:34,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:34,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:34,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:34,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:34,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:34,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:34,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:34,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:34,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:34,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:34,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:34,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:34,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:34,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:35,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:08:36,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:36,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:36,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:36,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:36,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:36,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:36,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:36,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:36,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:36,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:36,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:36,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:36,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:36,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:36,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:36,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:36,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:36,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:36,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:36,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:36,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:36,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:36,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:36,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:36,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:36,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:36,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:36,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:36,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:36,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:36,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:36,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:37,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:37,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:37,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:37,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:37,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:37,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:37,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:37,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:37,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:37,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:37,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:37,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:37,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:37,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:37,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:37,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:37,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:08:38,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:38,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:38,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:38,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:38,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:38,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:38,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:38,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:38,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:38,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:38,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:38,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:38,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:38,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:38,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:38,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:39,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:08:40,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:40,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:40,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:40,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:40,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:40,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:40,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:40,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:40,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:40,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:40,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:40,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:40,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:40,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:40,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:40,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:40,430 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:08:41,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:08:41,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:41,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:41,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:41,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:41,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:41,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:41,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:41,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:41,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:41,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:41,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:41,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:41,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:41,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:41,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:41,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:42,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:42,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:42,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:42,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:42,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:42,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:42,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:42,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:42,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:42,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:42,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:42,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:42,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:42,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:42,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:42,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:42,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:42,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:42,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:42,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:43,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:43,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:43,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:43,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:43,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:43,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:43,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:43,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:43,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:43,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:43,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:43,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:43,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:08:43,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:43,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:43,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:43,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:43,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:43,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:43,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:43,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:43,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:43,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:43,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:43,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:43,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:43,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:43,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:43,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:45,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:45,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:45,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:45,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:45,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:45,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:45,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:45,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:45,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:45,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:45,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:45,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:45,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:45,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:45,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:45,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:45,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:08:46,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:46,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:46,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:46,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:46,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:46,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:46,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:46,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:46,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:46,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:46,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:46,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:46,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:46,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:46,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:46,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:46,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:46,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:46,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:46,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:46,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:46,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:46,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:46,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:46,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:46,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:46,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:46,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:46,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:08:46,465 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 10:08:46,651 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 10:08:46,745 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 10:08:46,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 10:08:47,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:08:48,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:08:48,106 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:08:48,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:08:49,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:08:51,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:08:53,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:08:55,882 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:08:57,883 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:08:59,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:09:01,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:09:03,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:09:03,335 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:09:03,885 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:09:05,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:09:07,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:09:09,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:09:10,894 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:09:11,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:09:13,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:09:15,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:09:17,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:09:18,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:09:18,570 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:09:19,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:09:21,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:09:23,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:09:25,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:09:27,894 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:09:29,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:09:31,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:09:33,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:09:33,802 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:09:33,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:09:35,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:09:37,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:09:40,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:09:40,986 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:09:42,900 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:09:44,901 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:09:46,902 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:09:48,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:09:49,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:09:49,026 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:09:50,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:09:52,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:09:54,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:09:56,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:09:58,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:10:00,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:10:02,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:10:04,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:10:04,249 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:10:04,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:10:06,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:10:08,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:10:10,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:10:11,052 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:10:12,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:10:14,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:10:16,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:10:18,916 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:10:19,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:10:19,481 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:10:20,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:10:22,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:10:24,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:10:26,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:10:28,921 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:10:30,922 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:10:32,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:10:34,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:10:34,888 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:10:34,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:10:36,925 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:10:38,925 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:10:40,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:10:41,148 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:10:42,927 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:10:44,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:10:46,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:10:48,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:10:50,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:10:50,121 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:10:50,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:10:52,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:10:54,932 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:10:57,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:10:59,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:11:01,935 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:11:03,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:11:05,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:11:05,565 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:11:05,937 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:11:07,938 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:11:09,939 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:11:11,269 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:11:11,940 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:11:13,941 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:11:15,942 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:11:17,942 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:11:19,943 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:11:20,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:11:20,882 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:11:21,944 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:11:23,945 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:11:25,946 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:11:27,947 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:11:29,948 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:11:31,949 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:11:33,950 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:11:35,951 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:11:36,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:11:36,104 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:11:37,952 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:11:39,953 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:11:41,344 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:11:41,953 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:11:43,954 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:11:45,955 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:11:47,956 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:11:49,957 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:11:51,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:11:51,466 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:11:51,958 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:11:53,959 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:11:55,960 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:11:57,961 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:11:59,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:12:01,963 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:12:03,964 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:12:05,965 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:12:06,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:12:06,732 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:12:07,966 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:12:09,966 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:12:11,418 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:12:11,967 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:12:13,968 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:12:15,969 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:12:17,970 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:12:19,971 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:12:21,972 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:12:21,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:12:21,995 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:12:23,973 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:12:25,974 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:12:27,975 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:12:29,976 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:12:31,977 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:12:33,978 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:12:35,979 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:12:37,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:12:37,223 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:12:37,980 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:12:39,981 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:12:41,491 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:12:41,981 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:12:43,982 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:12:45,983 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:12:47,984 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:12:49,985 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:12:51,985 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:12:52,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:12:52,567 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:12:53,986 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:12:55,987 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:12:58,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:13:00,989 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:13:02,990 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:13:04,990 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:13:06,991 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:13:07,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:13:07,798 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:13:08,992 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:13:10,992 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:13:11,565 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:13:12,993 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:13:14,994 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:13:16,995 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:13:18,995 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:13:20,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:13:22,997 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:13:23,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:13:23,125 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:13:24,997 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:13:26,998 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:13:28,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:13:31,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:13:33,001 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:13:35,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:13:37,003 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:13:38,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:13:38,392 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:13:39,004 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:13:41,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:13:41,638 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:13:43,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:13:45,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:13:47,007 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:13:49,008 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:13:51,009 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:13:53,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:13:53,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:13:53,706 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:13:55,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:13:57,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:13:59,012 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:14:01,013 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:14:03,014 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:14:05,015 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:14:07,015 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:14:08,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:14:08,939 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:14:09,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:14:11,017 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:14:11,712 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:14:13,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:14:15,019 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:14:18,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:14:20,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:14:22,021 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:14:24,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:14:24,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:14:24,161 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:14:26,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:14:28,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:14:30,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:14:32,025 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:14:34,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:14:36,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:14:38,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:14:39,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:14:39,410 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:14:40,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:14:41,786 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:14:42,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:14:44,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:14:46,031 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:14:48,032 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:14:50,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:14:52,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:14:54,034 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:14:54,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:14:54,720 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:14:56,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:14:58,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:15:00,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:15:02,038 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:15:04,039 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:15:06,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:15:08,041 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:15:09,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:15:09,944 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:15:10,042 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:15:11,857 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:15:12,042 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:15:14,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:15:16,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:15:18,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:15:20,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:15:22,047 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:15:24,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:15:25,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:15:25,247 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:15:27,049 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:15:29,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:15:31,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:15:33,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:15:35,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:15:37,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:15:39,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:15:40,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:15:40,480 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:15:41,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:15:41,930 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:15:43,056 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:15:45,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:15:47,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:15:49,059 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:15:51,059 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:15:53,060 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:15:55,061 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:15:55,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:15:55,807 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:15:57,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:15:59,063 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:16:01,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:16:03,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:16:05,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:16:07,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:16:09,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:16:11,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:16:11,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:16:11,166 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:16:12,009 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:16:13,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:16:15,071 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:16:17,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:16:19,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:16:21,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:16:23,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:16:25,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:16:26,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:16:26,389 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:16:27,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:16:29,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:16:31,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:16:33,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:16:35,081 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:16:37,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:16:39,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:16:41,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:16:41,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:16:41,698 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:16:42,081 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:16:44,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:16:46,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:16:48,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:16:50,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:16:52,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:16:54,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:16:56,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:16:56,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:16:56,921 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:16:58,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:17:00,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:17:02,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:17:04,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:17:06,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:17:08,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:17:10,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:17:12,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:17:12,140 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:17:12,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:17:12,142 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:17:14,097 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:17:16,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:17:18,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:17:20,099 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:17:22,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:17:24,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:17:26,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:17:27,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:17:27,524 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:17:28,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:17:30,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:17:32,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:17:34,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:17:36,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:17:38,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:17:40,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:17:42,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:17:42,210 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:17:42,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:17:42,749 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:17:44,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:17:46,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:17:48,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:17:50,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:17:52,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:17:54,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:17:56,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:17:58,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:17:58,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:17:58,178 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:18:00,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:18:03,117 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:18:05,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:18:07,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:18:09,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:18:11,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:18:12,326 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:18:13,121 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:18:13,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:18:13,440 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:18:15,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:18:17,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:18:19,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:18:21,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:18:23,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:18:25,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:18:27,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:18:28,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:18:28,669 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:18:29,128 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:18:31,128 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:18:33,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:18:35,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:18:37,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:18:39,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:18:41,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:18:42,465 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:18:43,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:18:43,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:18:43,900 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:18:45,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:18:47,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:18:49,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:18:51,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:18:53,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:18:55,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:18:57,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:18:59,140 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:18:59,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:18:59,182 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:19:01,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:19:03,142 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:19:05,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:19:07,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:19:09,145 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:19:11,146 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:19:12,578 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:19:13,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:19:14,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:19:14,409 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:19:15,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:19:17,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:19:19,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:19:21,150 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:19:23,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:19:25,152 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:19:27,152 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:19:29,153 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:19:29,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:19:29,716 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:19:32,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:19:34,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:19:36,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:19:38,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:19:40,157 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:19:42,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:19:42,675 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:19:44,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:19:45,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:19:45,039 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:19:46,159 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:19:48,160 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:19:50,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:19:52,162 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:19:54,162 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:19:56,163 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:19:58,164 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:20:00,165 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:20:00,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:20:00,267 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:20:02,165 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:20:04,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:20:06,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:20:08,168 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:20:10,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:20:12,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:20:12,748 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:20:14,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:20:15,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:20:15,746 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:20:16,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:20:18,172 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:20:20,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:20:22,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:20:24,175 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:20:26,176 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:20:28,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:20:30,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:20:30,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:20:30,976 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:20:32,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:20:34,179 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:20:36,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:20:38,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:20:40,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:20:42,182 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:20:42,841 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:20:44,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:20:46,184 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:20:46,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:20:46,252 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:20:48,185 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:20:50,185 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:20:52,186 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:20:54,187 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:20:56,188 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:20:58,188 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:21:00,189 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:21:01,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:21:01,492 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:21:02,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:21:04,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:21:06,191 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:21:08,192 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:21:10,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:21:12,194 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:21:13,069 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:21:14,195 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:21:16,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:21:16,854 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:21:17,196 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:21:19,197 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:21:21,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:21:23,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:21:25,199 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:21:27,200 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:21:29,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:21:31,202 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:21:32,114 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:21:32,114 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:21:33,203 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:21:35,203 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:21:37,204 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:21:39,205 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:21:41,206 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:21:43,207 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:21:43,224 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:21:45,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:21:47,209 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:21:47,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:21:47,504 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:21:49,210 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:21:51,210 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:21:53,211 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:21:55,212 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:21:57,213 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:21:59,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:22:01,215 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:22:02,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:22:02,795 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:22:03,216 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:22:05,216 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:22:07,217 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:22:09,218 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:22:11,219 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:22:13,220 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:22:13,347 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:22:15,220 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:22:17,221 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:22:18,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:22:18,022 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:22:19,222 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:22:21,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:22:23,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:22:25,224 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:22:27,225 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:22:29,226 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:22:31,227 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:22:33,227 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:22:33,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:22:33,445 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:22:35,228 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:22:37,229 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:22:39,229 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:22:41,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:22:43,231 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:22:43,421 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:22:46,232 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:22:48,233 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:22:48,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:22:48,792 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:22:50,233 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:22:52,234 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:22:54,235 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:22:56,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:22:58,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:23:00,237 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:23:02,238 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:23:04,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:23:04,170 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:23:04,239 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:23:06,239 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:23:08,240 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:23:10,241 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:23:12,242 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:23:13,493 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:23:14,242 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:23:16,243 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:23:18,244 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:23:19,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:23:19,415 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:23:20,245 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:23:22,245 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:23:24,246 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:23:26,247 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:23:28,247 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:23:30,248 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:23:32,249 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:23:34,250 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:23:34,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:23:34,862 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:23:36,250 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:23:38,251 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:23:40,252 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:23:42,253 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:23:43,573 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:23:44,254 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:23:46,255 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:23:48,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:23:50,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:23:50,160 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:23:50,257 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:23:52,257 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:23:54,258 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:23:56,259 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:23:58,260 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:24:00,261 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:24:02,261 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:24:04,262 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:24:05,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:24:05,407 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:24:06,263 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:24:08,264 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:24:10,264 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:24:12,265 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:24:13,649 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:24:14,266 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:24:16,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:24:18,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:24:20,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:24:20,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:24:20,786 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:24:22,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:24:24,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:24:26,270 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:24:28,271 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:24:30,272 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:24:33,273 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:24:35,274 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:24:36,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:24:36,201 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:24:37,274 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:24:39,275 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:24:41,276 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:24:43,277 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:24:43,754 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:24:45,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:24:47,279 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:24:49,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:24:51,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:24:51,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:24:51,720 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:24:53,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:24:55,283 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:24:57,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:24:59,285 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:25:01,286 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:25:03,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:25:05,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:25:07,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:25:07,042 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:25:07,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:25:09,290 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:25:11,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:25:13,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:25:13,890 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:25:15,292 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:25:17,293 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:25:19,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:25:21,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:25:22,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:25:22,448 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:25:23,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:25:25,296 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:25:27,297 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:25:29,298 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:25:31,298 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:25:33,299 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:25:35,300 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:25:37,301 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:25:37,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:25:37,688 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:25:39,301 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:25:41,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:25:43,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:25:44,004 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:25:45,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:25:47,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:25:49,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:25:52,306 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:25:53,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:25:53,013 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:25:54,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:25:56,308 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:25:58,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:26:00,310 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:26:02,310 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:26:04,311 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:26:06,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:26:08,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:26:08,238 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:26:08,313 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:26:10,314 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:26:12,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:26:14,131 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:26:14,316 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:26:16,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:26:18,318 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:26:20,318 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:26:22,319 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:26:23,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:26:23,497 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:26:24,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:26:26,321 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:26:28,322 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:26:30,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:26:32,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:26:34,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:26:36,326 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:26:38,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:26:38,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:26:38,784 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:26:40,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:26:42,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:26:44,211 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:26:44,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:26:46,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:26:48,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:26:50,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:26:52,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:26:54,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:26:54,008 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:26:54,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:26:56,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:26:58,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:27:00,335 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:27:02,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:27:04,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:27:06,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:27:09,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:27:09,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:27:09,569 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:27:11,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:27:13,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:27:14,336 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:27:15,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:27:17,342 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:27:19,342 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:27:21,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:27:23,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:27:24,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:27:24,806 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:27:25,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:27:27,346 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:27:29,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:27:31,348 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:27:33,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:27:35,350 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:27:37,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:27:39,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:27:40,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:27:40,175 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:27:41,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:27:43,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:27:44,438 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:27:45,354 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:27:47,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:27:49,356 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:27:51,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:27:53,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:27:55,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:27:55,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:27:55,405 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:27:57,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:27:59,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:28:01,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:28:03,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:28:05,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:28:08,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:28:10,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:28:10,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:28:10,779 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:28:12,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:28:14,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:28:14,564 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:28:16,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:28:18,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:28:20,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:28:22,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:28:24,371 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:28:26,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:28:26,168 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:28:26,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:28:28,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:28:30,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:28:32,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:28:34,376 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:28:36,377 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:28:38,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:28:40,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:28:41,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:28:41,391 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:28:42,379 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:28:44,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:28:44,648 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:28:46,381 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:28:48,382 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:28:50,382 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:28:52,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:28:54,384 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:28:56,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:28:56,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:28:56,727 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:28:58,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:29:00,386 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:29:02,387 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:29:04,388 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:29:06,388 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:29:08,389 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:29:10,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:29:12,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:29:12,015 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:29:12,391 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:29:14,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:29:14,724 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:29:16,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:29:18,393 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:29:20,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:29:22,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:29:25,396 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:29:27,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:29:27,267 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:29:27,396 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:29:29,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:29:31,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:29:33,399 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:29:35,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:29:37,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:29:39,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:29:41,402 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:29:42,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:29:42,494 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:29:43,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:29:44,800 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:29:45,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:29:47,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:29:49,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:29:51,406 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:29:53,407 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:29:55,408 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:29:57,409 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:29:57,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:29:57,794 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:29:59,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:30:01,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:30:03,411 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:30:05,412 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:30:07,413 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:30:09,414 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:30:11,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:30:13,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:30:13,141 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:30:13,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:30:14,893 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:30:15,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:30:17,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:30:19,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:30:21,419 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:30:23,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:30:25,421 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:30:27,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:30:28,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:30:28,370 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:30:29,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:30:31,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:30:33,425 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:30:35,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:30:37,427 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:30:39,428 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:30:41,428 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:30:43,429 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:30:43,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:30:43,694 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:30:44,997 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:30:45,430 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:30:47,431 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:30:49,432 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:30:51,433 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:30:53,434 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:30:55,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:30:57,436 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:30:59,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:30:59,058 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:30:59,437 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:31:01,437 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:31:03,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:31:06,440 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:31:08,441 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:31:10,441 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:31:12,442 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:31:14,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:31:14,324 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:31:14,443 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:31:15,099 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:31:16,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:31:18,445 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:31:20,446 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:31:22,447 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:31:24,448 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:31:26,449 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:31:28,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:31:29,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:31:29,661 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:31:30,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:31:32,451 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:31:34,452 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:31:36,452 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:31:38,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:31:40,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:31:42,455 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:31:44,456 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:31:44,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:31:44,944 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:31:45,184 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:31:46,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:31:48,458 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:31:50,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:31:52,460 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:31:54,460 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:31:56,461 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:31:58,462 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:32:00,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:32:00,210 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:32:00,463 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:32:02,464 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:32:04,465 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:32:06,466 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:32:08,467 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:32:10,468 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:32:12,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:32:14,470 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:32:15,300 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:32:15,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:32:15,438 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:32:16,470 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:32:18,471 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:32:20,472 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:32:22,473 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:32:24,474 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:32:27,475 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:32:29,476 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:32:30,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:32:30,659 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:32:31,477 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:32:33,478 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:32:35,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:32:37,480 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:32:39,481 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:32:41,482 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:32:43,483 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:32:45,422 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:32:45,484 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:32:45,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:32:45,914 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:32:47,485 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:32:49,486 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:32:51,487 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:32:53,488 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:32:55,489 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:32:57,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:32:59,491 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:33:01,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:33:01,272 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:33:01,491 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:33:03,492 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:33:05,493 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:33:07,494 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:33:09,495 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:33:11,496 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:33:13,497 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:33:15,497 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:33:15,521 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:33:16,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:33:16,548 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:33:17,498 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:33:19,499 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:33:21,499 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:33:23,500 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:33:25,501 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:33:27,502 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:33:29,503 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:33:31,504 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:33:32,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:33:32,874 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:33:33,505 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:33:35,506 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:33:37,506 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:33:39,507 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:33:41,508 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:33:43,509 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:33:45,510 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:33:45,579 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:33:47,511 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:33:48,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:33:48,092 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:33:49,511 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:33:51,512 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:33:53,513 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:33:55,513 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:33:58,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:34:00,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:34:02,516 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:34:03,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:34:03,338 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:34:04,517 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:34:06,518 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:34:08,519 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:34:10,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:34:12,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:34:14,521 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:34:15,654 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:34:16,522 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:34:18,523 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:34:18,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:34:18,567 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:34:20,524 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:34:22,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:34:24,526 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:34:26,527 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:34:28,528 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:34:30,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:34:32,530 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:34:33,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:34:33,807 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:34:34,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:34:36,532 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:34:38,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:34:40,534 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:34:42,535 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:34:44,536 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:34:45,744 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:34:46,537 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:34:48,537 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:34:49,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:34:49,030 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:34:50,538 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:34:52,539 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:34:54,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:34:56,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:34:58,541 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:35:00,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:35:02,543 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:35:04,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:35:04,254 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:35:04,543 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:35:06,544 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:35:08,545 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:35:10,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:35:12,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:35:14,547 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:35:15,826 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:35:16,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:35:18,549 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:35:19,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:35:19,470 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:35:20,550 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:35:22,551 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:35:24,552 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:35:26,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:35:28,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:35:30,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:35:32,555 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:35:34,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:35:34,826 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:35:35,556 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:35:37,557 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:35:39,558 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:35:41,559 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:35:43,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:35:45,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:35:45,943 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:35:47,561 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:35:49,562 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:35:50,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:35:50,119 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:35:51,563 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:35:53,564 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:35:55,564 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:35:57,565 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:35:59,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:36:01,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:36:03,567 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:36:05,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:36:05,472 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:36:05,568 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:36:07,568 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:36:09,569 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:36:11,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:36:13,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:36:15,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:36:16,014 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:36:17,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:36:19,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:36:20,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:36:20,827 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:36:21,574 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:36:23,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:36:25,576 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:36:27,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:36:29,578 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:36:31,579 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:36:33,580 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:36:35,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:36:36,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:36:36,953 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:36:37,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:36:39,583 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:36:41,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:36:43,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:36:45,585 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:36:46,089 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:36:47,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:36:49,587 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:36:51,588 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:36:52,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:36:52,366 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:36:54,590 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:36:56,591 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:36:58,592 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:37:00,592 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:37:02,593 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:37:04,594 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:37:06,595 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:37:07,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:37:07,667 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:37:08,596 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:37:10,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:37:12,598 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:37:14,599 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:37:16,165 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:37:16,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:37:18,601 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:37:20,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:37:22,603 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:37:22,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:37:22,971 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:37:24,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:37:26,605 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:37:28,606 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:37:30,607 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:37:32,608 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:37:34,609 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:37:36,610 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:37:38,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:37:38,205 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:37:38,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:37:40,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:37:42,613 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:37:44,614 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:37:46,242 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:37:46,615 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:37:48,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:37:50,617 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:37:52,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:37:53,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:37:53,546 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:37:54,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:37:56,619 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:37:58,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:38:00,621 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:38:02,622 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:38:04,623 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:38:06,624 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:38:08,624 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:38:08,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:38:08,773 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:38:10,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:38:12,626 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:38:14,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:38:16,320 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:38:16,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:38:18,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:38:20,629 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:38:22,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:38:24,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:38:24,226 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:38:24,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:38:26,631 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:38:28,632 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:38:30,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:38:32,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:38:34,634 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:38:36,635 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:38:38,636 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:38:39,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:38:39,529 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:38:40,636 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:38:42,637 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:38:44,638 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:38:46,391 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:38:47,639 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:38:49,639 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:38:51,640 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:38:53,641 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:38:54,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:38:54,861 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:38:55,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:38:57,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:38:59,643 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:39:01,644 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:39:03,645 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:39:05,646 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:39:07,646 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:39:09,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:39:10,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:39:10,323 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:39:11,648 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:39:13,649 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:39:15,649 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:39:16,465 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:39:17,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:39:19,651 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:39:21,651 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:39:23,652 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:39:25,653 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:39:25,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:39:25,817 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:39:27,653 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:39:29,654 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:39:31,655 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:39:33,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:39:35,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:39:37,657 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:39:39,658 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:39:41,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:39:41,042 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:39:41,659 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:39:43,660 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:39:45,661 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:39:46,535 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:39:47,661 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:39:49,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:39:51,663 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:39:53,664 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:39:55,665 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:39:56,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:39:56,269 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:39:57,666 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:39:59,667 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:40:02,668 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:40:04,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:40:06,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:40:08,670 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:40:10,671 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:40:11,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:40:11,511 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:40:12,671 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:40:14,672 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:40:16,610 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:40:16,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:40:18,674 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:40:20,674 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:40:22,675 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:40:24,676 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:40:26,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:40:26,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:40:26,724 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:40:28,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:40:30,678 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:40:32,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:40:34,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:40:36,680 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:40:38,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:40:40,682 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:40:41,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:40:41,942 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:40:42,682 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:40:44,683 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:40:46,684 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:40:46,685 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:40:48,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:40:50,687 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:40:52,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:40:54,689 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:40:56,690 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:40:57,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:40:57,166 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:40:58,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:41:00,692 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:41:02,692 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:41:04,693 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:41:06,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:41:08,695 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:41:11,697 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:41:12,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:41:12,509 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:41:13,698 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:41:15,699 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:41:16,757 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:41:17,699 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:41:19,700 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:41:21,701 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:41:23,702 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:41:25,703 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:41:27,704 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:41:27,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:41:27,795 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:41:29,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:41:31,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:41:33,706 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:41:35,707 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:41:37,708 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:41:39,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:41:41,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:41:43,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:41:43,070 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:41:43,710 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:41:45,711 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:41:46,832 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:41:47,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:41:49,713 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:41:51,713 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:41:53,714 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:41:55,715 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:41:57,716 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:41:58,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:41:58,296 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:41:59,717 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:42:01,718 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:42:03,719 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:42:05,720 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:42:07,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:42:09,722 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:42:11,723 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:42:13,723 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:42:13,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:42:13,807 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:42:15,724 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:42:16,906 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:42:17,725 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:42:19,726 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:42:21,727 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:42:23,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:42:25,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:42:27,729 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:42:29,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:42:29,134 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:42:30,730 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:42:32,731 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:42:34,732 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:42:36,732 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:42:38,733 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:42:40,734 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:42:42,735 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:42:44,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:42:44,372 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:42:44,736 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:42:46,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:42:46,982 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:42:48,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:42:50,738 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:42:52,739 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:42:54,740 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:42:56,741 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:42:58,742 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:42:59,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:42:59,612 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:43:00,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:43:02,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:43:04,744 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:43:06,745 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:43:08,746 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:43:10,747 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:43:12,748 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:43:14,748 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:43:14,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:43:14,866 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:43:16,749 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:43:17,054 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:43:18,750 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:43:20,751 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:43:22,752 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:43:24,752 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:43:26,753 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:43:28,754 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:43:30,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:43:30,280 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:43:30,755 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:43:32,756 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:43:34,757 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:43:36,758 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:43:38,758 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:43:40,759 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:43:42,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:43:45,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:43:45,602 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:43:45,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:43:47,130 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:43:47,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:43:49,763 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:43:51,764 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:43:53,765 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:43:55,766 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:43:57,767 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:43:59,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:44:00,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:44:00,844 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:44:01,769 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:44:03,770 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:44:05,771 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:44:07,772 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:44:09,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:44:11,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:44:13,775 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:44:15,776 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:44:16,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:44:16,121 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:44:17,205 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:44:17,777 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:44:19,777 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:44:21,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:44:23,780 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:44:25,780 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:44:27,781 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:44:29,782 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:44:31,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:44:31,346 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:44:31,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:44:33,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:44:35,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:44:37,785 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:44:39,786 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:44:41,787 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:44:43,787 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:44:45,788 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:44:46,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:44:46,647 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:44:47,281 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:44:47,789 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:44:49,789 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:44:51,790 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:44:53,791 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:44:55,791 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:44:57,792 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:44:59,793 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:45:01,793 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:45:01,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:45:01,978 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:45:03,794 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:45:05,795 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:45:07,796 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:45:09,797 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:45:11,798 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:45:14,799 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:45:16,800 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:45:17,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:45:17,304 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:45:17,532 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:45:18,801 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:45:20,802 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:45:22,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:45:24,804 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:45:26,805 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:45:28,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:45:30,807 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:45:32,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:45:32,534 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:45:32,808 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:45:34,809 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:45:36,810 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:45:38,811 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:45:40,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:45:42,813 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:45:44,814 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:45:46,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:45:47,433 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:45:47,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:45:47,919 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:45:48,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:45:50,816 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:45:52,817 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:45:54,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:45:56,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:45:58,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:46:00,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:46:02,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:46:03,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:46:03,145 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:46:04,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:46:06,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:46:08,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:46:10,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:46:12,826 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:46:14,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:46:16,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:46:17,516 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:46:18,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:46:18,481 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:46:18,829 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:46:20,829 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:46:22,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:46:24,831 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:46:26,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:46:29,834 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:46:31,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:46:33,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:46:33,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:46:33,934 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:46:35,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:46:37,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:46:39,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:46:41,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:46:43,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:46:45,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:46:47,590 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:46:47,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:46:49,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:46:49,242 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:46:49,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:46:51,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:46:53,846 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:46:55,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:46:57,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:46:59,849 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:47:01,849 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:47:03,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:47:04,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:47:04,472 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:47:05,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:47:07,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:47:09,854 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:47:11,856 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:47:13,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:47:15,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:47:17,649 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:47:17,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:47:19,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:47:19,773 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:47:19,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:47:21,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:47:23,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:47:25,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:47:27,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:47:29,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:47:31,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:47:33,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:47:35,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:47:35,589 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:47:35,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:47:37,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:47:39,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:47:41,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:47:43,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:47:45,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:47:47,725 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:47:47,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:47:49,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:47:50,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:47:50,853 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:47:51,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:47:54,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:47:56,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:47:58,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:48:00,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:48:02,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:48:04,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:48:06,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:48:06,209 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:48:06,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:48:08,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:48:10,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:48:12,882 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:48:14,883 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:48:16,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:48:17,808 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:48:18,885 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:48:20,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:48:21,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:48:21,603 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:48:22,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:48:24,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:48:26,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:48:28,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:48:30,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:48:32,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:48:34,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:48:36,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:48:36,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:48:36,933 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:48:38,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:48:40,894 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:48:42,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:48:44,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:48:46,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:48:47,883 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:48:48,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:48:50,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:48:52,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:48:55,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:48:55,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:48:55,977 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:48:57,900 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:48:59,901 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:49:01,902 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:49:03,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:49:05,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:49:07,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:49:09,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:49:11,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:49:11,322 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:49:11,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:49:13,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:49:15,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:49:17,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:49:17,956 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:49:19,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:49:21,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:49:23,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:49:25,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:49:26,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:49:26,602 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:49:27,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:49:29,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:49:31,916 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:49:33,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:49:35,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:49:37,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:49:39,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:49:41,921 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:49:42,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:49:42,229 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:49:43,922 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:49:45,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:49:47,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:49:48,022 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:49:49,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:49:51,925 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:49:53,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:49:55,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:49:57,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:49:57,457 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:49:57,927 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:49:59,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:50:01,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:50:03,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:50:05,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:50:07,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:50:09,932 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:50:11,932 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:50:12,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:50:12,683 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:50:14,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:50:16,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:50:18,144 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:50:18,935 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:50:20,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:50:22,937 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:50:24,939 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:50:26,939 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:50:27,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:50:27,993 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:50:28,940 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:50:30,941 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:50:32,942 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:50:34,943 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:50:36,944 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:50:38,945 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:50:40,946 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:50:42,946 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:50:43,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:50:43,219 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:50:44,947 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:50:46,948 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:50:48,169 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:50:48,949 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:50:50,950 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:50:52,951 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:50:54,952 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:50:56,953 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:50:58,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:50:58,555 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:50:58,954 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:51:00,954 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:51:02,955 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:51:04,956 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:51:06,957 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:51:08,960 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:51:10,961 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:51:12,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:51:13,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:51:13,853 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:51:14,963 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:51:16,964 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:51:18,244 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:51:18,965 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:51:20,966 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:51:22,967 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:51:24,968 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:51:26,969 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:51:28,970 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:51:29,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:51:29,109 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:51:30,971 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:51:32,972 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:51:34,972 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:51:36,973 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:51:38,974 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:51:40,975 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:51:42,976 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:51:44,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:51:44,334 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:51:44,977 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:51:46,978 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:51:48,319 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:51:48,979 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:51:50,979 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:51:52,980 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:51:54,981 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:51:56,982 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:51:58,983 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:51:59,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:51:59,562 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:52:00,984 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:52:02,985 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:52:04,986 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:52:06,987 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:52:08,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:52:10,989 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:52:12,990 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:52:14,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:52:14,786 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:52:14,990 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:52:16,991 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:52:18,393 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:52:18,992 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:52:20,993 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:52:22,994 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:52:24,995 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:52:26,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:52:28,997 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:52:30,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:52:30,178 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:52:30,998 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:52:32,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:52:35,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:52:37,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:52:39,001 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:52:41,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:52:43,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:52:45,003 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:52:45,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:52:45,486 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:52:48,004 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:52:48,455 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:52:50,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:52:52,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:52:54,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:52:56,007 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:52:58,008 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:53:00,009 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:53:00,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:53:00,776 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:53:02,009 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:53:04,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:53:06,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:53:08,012 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:53:16,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:53:16,005 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:53:18,522 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:53:31,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:53:31,251 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:53:46,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:53:46,521 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:53:48,601 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:54:01,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:54:01,794 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:54:07,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:54:07,087 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 10:54:07,138 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 10:54:07,216 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 10:54:08,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 10:54:08,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:54:09,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:54:10,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:54:16,038 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:54:17,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:54:17,077 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:54:18,687 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:54:32,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:54:32,321 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:54:38,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:54:47,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:54:47,549 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:54:48,770 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:55:02,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:55:02,774 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:55:18,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:55:18,003 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:55:18,848 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:55:33,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:55:33,231 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:55:48,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:55:48,459 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:55:48,932 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:56:03,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:56:03,694 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:56:18,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:56:18,921 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:56:19,149 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:56:34,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:56:34,152 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:56:49,088 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:56:49,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:56:49,367 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:57:04,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:57:04,592 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:57:19,165 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:57:19,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:57:19,821 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:57:35,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:57:35,052 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:57:49,242 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:57:50,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:57:50,279 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:58:05,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:58:05,504 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:58:19,321 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:58:20,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:58:20,868 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:58:29,146 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:58:30,146 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:58:32,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:58:36,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:58:36,097 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:58:41,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:58:41,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:58:41,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:58:41,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:58:41,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:58:41,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:58:41,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:58:41,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:58:41,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:58:41,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:58:41,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:58:41,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:58:41,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:58:41,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:58:41,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:58:41,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:58:45,153 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:58:49,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:58:49,394 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:58:51,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:58:51,372 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:58:55,157 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:58:56,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:58:56,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:58:56,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:58:56,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:58:56,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:58:56,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:58:56,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:58:56,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:58:56,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:58:56,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:58:56,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:58:56,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:58:56,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:58:56,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:58:56,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:58:56,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:58:59,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:59:02,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:02,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:02,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:02,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:02,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:02,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:02,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:02,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:02,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:02,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:02,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:02,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:02,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:02,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:02,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:02,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:03,160 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:59:03,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:03,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:03,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:03,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:03,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:03,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:03,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:03,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:03,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:03,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:03,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:03,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:03,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:03,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:03,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:03,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:06,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:59:06,606 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:59:07,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:59:09,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:09,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:09,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:09,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:09,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:09,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:09,162 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:59:09,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:09,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:09,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:09,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:09,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:09,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:09,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:09,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:09,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:09,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:12,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:12,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:12,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:12,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:12,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:12,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:12,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:12,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:12,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:12,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:12,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:12,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:12,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:12,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:12,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:12,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:12,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:12,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:12,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:12,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:12,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:12,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:12,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:12,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:12,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:12,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:12,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:12,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:12,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:12,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:12,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:12,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:13,164 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:59:15,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:15,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:15,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:15,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:15,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:15,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:15,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:15,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:15,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:15,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:15,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:15,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:15,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:15,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:15,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:15,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:17,165 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:59:17,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:17,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:17,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:17,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:17,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:17,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:17,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:17,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:17,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:17,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:17,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:17,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:17,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:17,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:17,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:17,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:19,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:59:19,461 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:59:21,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:59:21,823 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:59:23,168 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:59:25,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:59:26,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:26,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:26,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:26,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:26,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:26,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:26,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:26,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:26,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:26,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:26,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:26,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:26,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:26,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:26,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:26,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:27,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:27,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:27,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:27,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:27,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:27,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:27,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:27,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:27,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:27,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:27,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:27,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:27,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:27,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:27,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:27,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:29,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:59:30,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:30,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:30,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:30,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:30,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:30,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:30,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:30,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:30,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:30,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:30,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:30,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:30,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:30,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:30,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:30,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:30,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:31,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:31,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:31,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:31,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:31,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:31,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:31,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:31,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:31,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:31,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:31,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:31,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:31,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:31,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:31,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:31,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:59:33,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:59:33,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:33,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:33,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:33,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:33,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:33,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:33,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:33,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:33,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:33,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:33,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:33,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:33,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:33,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:33,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:33,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:33,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:33,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:33,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:33,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:33,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:33,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:33,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:33,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:33,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:33,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:33,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:33,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:33,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:33,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:33,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:33,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:36,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:36,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:36,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:36,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:36,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:36,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:36,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:36,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:36,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:36,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:36,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:36,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:36,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:36,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:36,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:36,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:37,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:59:37,049 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:59:37,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:59:37,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:37,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:37,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:37,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:37,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:37,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:37,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:37,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:37,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:37,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:37,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:37,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:37,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:37,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:37,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:37,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:38,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:38,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:38,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:38,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:38,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:38,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:38,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:38,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:38,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:38,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:38,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:38,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:38,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:38,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:38,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:38,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:39,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:59:40,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:40,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:40,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:40,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:40,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:40,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:40,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:40,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:40,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:41,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:41,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:41,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:41,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:41,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:41,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:41,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:41,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:59:43,175 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:59:43,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:43,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:43,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:43,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:43,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:43,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:43,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:43,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:43,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:43,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:43,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:43,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:43,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:43,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:43,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:43,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:45,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:45,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:45,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:45,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:45,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:45,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:45,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:45,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:45,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:45,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:45,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:45,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:45,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:45,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:45,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:45,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:47,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:59:49,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:59:49,532 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 10:59:51,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:59:52,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 10:59:52,342 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 10:59:52,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:52,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:52,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:52,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:52,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:52,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:52,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:52,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:52,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:52,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:52,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:52,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:52,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:52,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:52,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:52,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:53,179 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:59:55,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 10:59:55,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:55,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:55,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:55,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:55,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:55,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:55,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:55,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:55,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:55,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:55,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:55,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:55,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:55,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:55,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:55,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:56,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:56,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:56,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:56,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:56,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:56,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:56,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:56,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:56,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:56,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:56,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:56,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:56,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:56,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:56,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:56,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:57,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:57,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:57,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:57,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:57,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:57,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:57,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:57,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:57,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:57,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:57,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:57,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:57,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:57,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:57,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:57,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:58,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:58,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:58,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:58,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:58,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:58,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:58,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:58,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:58,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:58,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:58,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:58,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:58,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:58,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:58,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:58,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 10:59:59,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:00:00,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:00,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:00,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:00,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:00,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:00,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:00,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:00,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:00,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:00,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:00,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:00,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:00,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:00,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:00,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:00,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:01,182 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:00:02,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:02,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:02,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:02,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:02,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:02,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:02,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:02,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:02,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:02,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:02,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:02,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:02,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:02,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:02,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:02,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:03,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:00:03,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:03,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:03,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:03,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:03,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:03,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:03,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:03,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:03,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:03,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:03,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:03,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:03,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:03,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:03,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:03,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:04,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:04,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:04,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:04,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:04,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:04,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:04,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:04,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:04,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:04,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:04,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:04,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:04,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:04,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:04,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:04,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:05,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:00:07,184 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:00:07,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:00:07,566 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:00:09,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:09,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:09,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:09,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:09,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:09,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:09,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:09,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:09,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:09,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:09,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:09,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:09,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:09,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:09,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:09,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:10,185 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:00:12,186 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:00:14,187 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:00:15,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:15,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:15,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:15,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:15,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:15,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:15,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:15,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:15,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:15,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:15,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:15,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:15,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:15,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:15,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:15,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:16,188 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:00:16,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:16,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:16,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:16,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:16,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:16,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:16,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:16,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:16,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:16,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:16,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:16,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:16,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:16,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:16,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:16,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:18,189 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:00:19,599 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:00:20,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:00:20,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:20,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:22,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:00:22,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:22,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:22,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:22,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:22,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:22,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:22,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:22,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:22,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:22,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:22,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:22,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:22,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:22,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:22,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:22,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:22,866 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:00:22,866 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:00:24,191 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:00:24,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:24,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:24,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:24,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:24,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:24,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:24,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:24,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:24,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:24,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:24,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:24,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:24,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:24,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:24,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:24,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:25,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:25,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:25,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:25,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:25,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:25,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:25,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:25,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:25,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:25,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:25,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:25,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:25,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:25,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:25,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:25,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:25,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:25,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:25,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:25,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:25,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:25,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:25,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:25,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:25,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:25,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:25,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:25,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:25,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:25,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:25,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:25,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:26,192 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:00:27,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:27,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:27,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:27,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:27,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:27,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:27,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:27,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:27,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:27,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:27,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:27,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:27,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:27,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:27,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:27,667 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:28,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:00:29,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:29,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:29,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:29,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:29,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:29,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:29,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:29,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:29,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:29,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:29,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:29,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:29,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:29,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:29,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:29,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:29,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:29,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:29,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:29,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:29,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:29,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:29,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:29,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:29,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:29,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:29,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:29,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:29,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:29,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:29,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:29,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:30,194 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:00:32,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,195 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:00:32,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:32,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:33,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:33,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:33,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:33,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:33,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:33,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:33,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:33,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:34,196 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:00:38,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:00:38,141 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:00:42,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:42,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:42,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:42,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:42,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:42,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:42,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:42,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:42,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:42,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:42,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:42,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:42,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:42,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:42,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:42,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:46,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:00:49,669 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:00:50,203 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:00:52,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:52,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:52,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:52,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:52,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:52,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:52,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:52,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:52,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:52,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:52,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:52,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:52,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:52,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:52,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:52,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:53,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:00:53,555 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:00:54,205 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:00:55,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:55,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:55,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:55,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:55,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:55,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:55,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:55,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:55,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:55,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:55,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:55,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:55,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:55,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:55,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:00:55,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:00,207 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:01:02,207 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:01:04,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:04,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:04,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:04,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:04,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:04,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:04,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:04,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:04,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:04,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:04,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:04,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:04,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:04,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:04,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:04,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:06,209 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:01:08,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:08,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:08,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:08,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:08,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:08,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:08,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:08,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:08,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:08,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:08,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:08,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:08,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:08,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:08,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:08,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:08,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:08,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:08,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:08,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:08,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:08,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:08,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:08,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:08,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:08,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:08,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:08,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:08,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:08,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:08,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:08,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:08,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:01:08,994 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:01:10,211 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:01:14,212 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:01:18,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:01:19,738 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:01:19,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:19,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:19,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:19,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:19,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:19,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:19,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:19,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:19,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:19,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:19,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:19,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:19,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:19,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:19,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:19,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:20,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:20,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:20,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:20,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:20,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:20,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:20,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:20,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:20,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:20,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:20,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:20,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:20,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:20,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:20,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:20,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:20,215 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:01:21,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:21,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:21,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:21,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:21,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:21,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:21,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:21,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:21,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:21,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:21,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:21,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:21,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:21,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:21,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:21,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:23,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:23,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:23,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:23,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:23,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:23,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:23,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:23,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:23,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:23,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:23,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:23,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:23,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:23,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:23,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:23,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:24,216 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:01:24,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:01:24,330 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:01:26,217 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:01:27,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:27,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:27,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:27,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:27,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:27,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:27,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:27,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:27,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:27,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:27,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:27,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:27,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:27,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:27,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:27,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:30,219 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:01:30,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:30,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:30,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:30,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:30,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:30,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:30,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:30,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:30,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:30,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:30,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:30,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:30,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:30,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:30,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:30,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:30,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:30,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:30,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:30,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:30,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:30,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:30,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:30,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:30,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:30,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:30,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:30,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:30,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:30,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:30,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:30,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:32,219 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:01:34,220 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:01:35,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:35,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:35,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:35,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:35,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:35,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:35,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:35,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:35,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:35,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:35,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:35,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:35,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:35,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:35,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:35,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,222 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:01:38,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:38,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:39,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:01:39,614 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:01:40,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:01:42,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:42,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:42,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:42,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:42,736 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:42,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:42,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:42,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:42,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:42,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:42,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:42,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:42,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:42,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:42,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:42,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:42,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:42,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:42,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:42,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:42,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:42,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:42,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:42,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:42,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:42,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:42,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:42,899 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:42,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:42,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:42,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:42,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:44,224 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:01:45,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:45,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:45,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:45,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:45,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:45,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:45,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:45,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:45,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:45,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:45,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:45,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:45,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:45,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:45,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:45,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:46,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:46,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:46,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:46,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:46,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:46,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:46,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:46,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:46,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:46,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:46,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:46,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:46,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:46,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:46,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:46,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:46,225 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:01:46,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:46,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:46,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:46,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:46,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:46,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:46,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:46,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:46,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:46,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:46,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:46,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:46,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:46,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:46,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:46,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:48,226 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:01:49,811 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:01:49,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:49,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:49,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:49,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:49,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:49,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:49,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:49,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:49,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:49,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:49,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:49,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:49,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:49,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:49,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:49,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:50,227 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:01:52,227 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:01:55,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:01:55,150 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:01:56,229 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:01:56,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:56,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:56,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:56,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:56,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:56,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:56,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:56,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:56,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:56,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:56,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:56,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:56,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:56,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:56,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:56,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:01:58,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:02:00,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:02:01,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:01,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:01,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:01,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:01,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:01,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:01,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:01,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:01,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:01,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:01,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:01,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:01,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:01,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:01,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:01,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:02,231 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:02:02,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:02,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:02,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:02,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:02,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:02,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:02,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:02,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:02,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:02,867 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:02,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:02,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:02,870 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:02,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:02,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:02,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:03,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:03,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:03,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:03,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:03,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:03,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:03,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:03,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:03,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:03,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:03,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:03,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:03,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:03,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:03,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:03,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:03,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:03,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:03,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:03,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:03,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:03,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:03,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:03,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:03,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:03,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:03,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:03,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:03,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:03,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:03,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:03,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:04,232 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:02:04,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:04,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:04,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:04,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:04,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:04,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:04,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:04,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:04,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:04,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:04,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:04,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:04,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:04,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:04,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:04,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:07,233 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:02:07,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:07,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:07,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:07,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:07,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:07,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:07,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:07,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:07,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:07,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:07,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:07,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:07,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:07,701 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:07,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:07,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:09,234 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:02:10,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:02:10,411 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:02:11,234 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:02:11,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:11,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:11,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:11,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:11,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:11,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:11,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:11,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:11,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:11,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:11,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:11,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:11,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:11,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:11,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:11,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:12,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:12,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:12,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:12,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:12,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:12,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:12,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:12,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:12,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:12,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:12,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:12,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:12,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:12,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:12,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:12,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:13,235 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:02:15,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:15,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:15,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:15,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:15,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:15,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:15,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:15,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:15,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:15,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:15,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:15,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:15,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:15,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:15,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:15,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:15,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:02:17,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:02:19,237 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:02:19,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:19,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:19,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:19,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:19,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:19,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:19,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:19,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:19,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:19,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:19,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:19,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:19,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:19,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:19,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:19,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:19,880 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:02:21,238 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:02:23,239 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:02:24,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:24,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:25,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:25,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:25,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:25,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:25,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:25,240 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:02:25,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:25,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:25,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:25,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:25,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:25,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:25,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:25,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:25,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:25,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:25,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:25,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:25,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:25,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:25,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:25,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:25,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:02:25,647 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:02:27,240 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:02:28,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:28,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:28,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:28,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:28,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:28,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:28,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:28,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:28,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:28,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:28,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:28,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:28,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:28,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:28,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:28,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:28,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:28,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:28,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:28,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:28,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:28,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:28,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:28,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:28,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:28,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:28,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:28,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:28,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:28,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:28,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:28,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:29,241 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:02:29,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:29,623 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:29,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:29,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:29,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:29,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:29,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:29,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:29,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:29,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:29,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:29,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:29,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:29,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:29,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:29,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:30,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:30,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:30,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:30,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:30,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:30,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:30,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:30,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:30,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:30,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:30,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:30,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:30,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:30,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:30,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:30,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:31,242 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:02:31,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:31,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:31,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:31,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:31,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:31,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:31,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:31,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:31,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:31,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:31,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:31,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:31,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:31,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:31,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:31,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:31,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:31,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:31,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:31,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:31,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:31,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:31,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:31,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:31,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:31,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:31,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:31,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:31,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:31,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:31,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:31,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:33,243 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:02:34,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:34,782 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 11:02:35,015 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 11:02:35,089 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 11:02:35,243 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 11:02:35,244 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:02:36,244 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:02:37,244 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:02:40,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:02:40,953 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:02:44,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:44,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:44,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:44,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:44,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:44,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:44,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:44,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:44,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:44,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:44,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:44,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:44,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:44,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:44,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:44,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:45,247 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:02:47,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:47,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:47,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:47,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:47,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:47,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:47,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:47,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:47,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:47,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:47,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:47,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:47,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:47,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:47,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:47,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:49,249 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:02:49,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:49,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:49,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:49,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:49,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:49,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:49,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:49,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:49,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:49,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:49,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:49,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:49,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:49,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:49,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:49,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:02:50,024 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:02:55,251 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:02:56,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:02:56,185 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:02:59,252 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:03:00,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:00,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:00,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:00,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:00,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:00,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:00,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:00,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:00,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:00,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:00,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:00,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:00,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:00,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:00,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:00,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:03,254 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:03:05,255 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:03:09,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:03:11,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:03:11,411 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:03:11,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:11,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:11,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:11,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:11,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:11,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:11,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:11,653 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:11,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:11,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:11,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:11,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:11,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:11,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:11,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:11,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:13,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:13,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:13,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:13,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:13,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:13,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:13,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:13,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:13,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:13,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:13,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:13,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:13,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:13,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:13,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:13,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:13,258 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:03:13,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:13,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:13,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:13,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:13,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:13,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:13,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:13,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:13,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:13,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:13,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:13,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:13,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:13,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:13,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:13,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:16,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:16,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:16,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:16,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:16,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:16,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:16,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:16,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:16,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:16,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:16,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:16,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:16,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:16,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:16,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:16,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:17,259 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:03:20,093 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:03:20,261 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:03:20,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:20,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:20,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:20,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:20,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:20,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:20,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:20,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:20,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:20,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:20,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:20,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:20,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:20,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:20,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:20,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:24,262 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:03:24,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:24,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:24,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:24,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:24,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:24,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:24,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:24,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:24,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:24,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:24,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:24,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:24,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:24,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:24,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:24,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:26,263 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:03:26,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:03:26,635 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:03:27,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:27,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:27,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:27,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:27,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:27,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:27,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:27,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:27,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:27,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:27,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:27,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:27,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:27,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:27,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:27,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:27,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:27,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:27,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:27,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:27,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:27,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:27,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:27,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:27,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:27,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:27,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:27,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:27,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:27,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:27,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:27,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:30,265 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:03:31,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:31,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:31,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:31,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:31,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:31,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:31,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:31,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:31,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:31,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:31,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:31,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:31,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:31,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:31,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:31,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:32,266 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:03:35,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:35,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:35,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:35,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:35,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:35,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:35,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:35,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:35,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:35,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:35,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:35,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:35,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:35,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:35,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:35,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:36,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:36,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:36,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:36,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:36,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:36,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:36,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:36,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:36,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:36,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:36,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:36,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:36,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:36,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:36,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:36,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:36,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:03:38,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:03:39,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:39,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:39,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:39,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:39,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:39,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:39,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:39,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:39,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:39,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:39,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:39,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:39,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:39,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:39,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:39,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:40,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:03:41,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:03:41,983 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:03:42,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:42,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:42,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:42,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:42,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:42,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:42,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:42,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:42,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:42,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:42,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:42,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:42,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:42,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:42,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:42,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:44,271 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:03:45,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:45,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:46,272 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:03:48,273 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:03:50,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:50,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:50,166 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:03:50,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:50,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:50,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:50,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:50,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:50,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:50,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:50,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:50,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:50,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:50,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:50,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:50,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:50,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:50,274 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:03:51,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:51,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:51,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:51,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:51,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:51,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:51,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:51,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:51,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:51,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:51,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:51,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:51,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:51,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:51,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:51,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:51,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:51,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:51,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:51,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:51,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:51,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:51,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:51,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:51,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:51,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:51,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:51,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:51,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:51,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:51,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:51,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:54,275 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:03:56,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:56,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:56,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:56,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:56,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:56,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:56,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:56,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:56,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:56,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:56,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:56,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:56,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:56,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:56,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:56,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:56,276 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:03:57,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:03:57,242 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:03:58,276 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:03:59,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:59,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:59,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:59,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:59,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:59,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:59,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:59,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:59,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:59,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:59,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:59,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:59,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:59,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:59,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:03:59,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:00,277 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:04:01,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:01,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:01,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:01,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:01,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:01,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:01,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:01,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:01,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:01,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:01,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:01,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:01,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:01,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:01,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:01,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:02,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:04:04,279 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:04:06,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:04:06,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:06,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:06,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:06,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:06,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:06,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:06,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:06,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:06,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:06,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:06,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:06,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:06,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:06,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:06,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:06,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:06,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:06,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:06,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:06,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:06,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:06,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:06,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:06,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:06,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:06,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:06,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:06,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:06,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:06,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:06,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:06,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:07,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:07,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:07,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:07,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:07,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:07,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:07,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:07,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:07,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:07,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:07,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:07,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:07,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:07,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:07,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:07,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:07,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:07,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:07,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:07,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:07,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:07,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:07,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:07,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:07,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:07,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:07,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:07,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:07,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:07,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:07,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:07,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:08,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:04:09,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:09,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:09,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:09,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:09,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:09,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:09,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:09,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:09,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:09,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:09,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:09,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:09,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:09,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:09,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:09,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:10,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:04:10,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:10,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:10,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:10,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:10,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:10,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:10,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:10,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:10,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:10,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:10,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:10,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:10,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:10,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:10,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:10,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:12,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:04:12,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:04:12,469 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:04:14,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:14,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:14,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:14,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:14,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:14,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:14,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:14,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:14,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:14,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:14,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:14,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:14,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:14,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:14,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:14,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:14,283 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:04:16,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:04:16,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:16,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:16,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:16,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:16,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:16,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:16,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:16,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:16,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:16,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:16,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:16,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:16,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:16,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:16,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:16,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:18,285 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:04:19,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:19,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:19,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:19,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:19,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:19,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:19,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:19,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:19,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:19,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:19,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:19,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:19,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:19,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:19,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:19,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:20,239 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:04:20,286 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:04:22,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:04:24,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:04:25,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:25,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:25,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:25,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:25,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:25,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:25,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:25,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:25,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:25,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:25,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:25,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:26,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:26,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:26,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:26,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:26,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:26,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:26,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:26,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:26,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:26,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:26,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:26,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:26,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:26,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:26,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:26,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:26,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:26,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:26,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:26,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:26,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:04:27,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:04:27,742 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:04:28,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:28,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:28,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:28,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:28,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:28,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:28,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:28,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:28,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:28,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:28,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:28,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:28,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:28,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:28,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:28,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:28,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:04:29,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:29,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:29,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:29,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:29,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:29,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:29,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:29,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:29,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:29,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:29,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:29,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:29,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:29,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:29,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:29,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:30,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:04:30,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:30,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:30,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:30,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:30,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:30,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:30,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:30,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:30,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:30,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:30,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:30,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:30,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:30,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:30,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:30,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:31,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:31,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:31,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:31,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:31,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:31,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:31,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:31,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:31,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:31,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:31,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:31,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:31,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:31,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:31,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:31,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:32,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:32,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:32,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:32,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:32,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:32,155 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:32,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:32,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:32,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:32,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:32,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:32,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:32,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:32,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:32,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:32,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:32,290 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:04:32,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:32,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:32,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:32,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:32,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:32,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:32,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:32,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:32,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:32,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:32,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:32,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:32,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:32,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:32,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:32,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:33,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:33,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:33,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:33,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:33,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:33,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:33,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:33,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:33,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:33,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:33,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:33,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:33,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:33,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:33,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:33,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:34,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:04:34,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:34,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:34,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:34,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:34,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:34,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:34,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:34,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:34,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:34,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:34,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:34,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:34,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:34,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:34,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:34,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:35,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:35,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:35,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:35,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:35,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:35,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:35,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:35,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:35,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:35,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:35,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:35,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:35,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:35,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:35,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:35,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:35,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:35,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:35,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:35,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:35,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:35,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:35,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:35,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:35,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:35,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:35,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:35,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:36,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:04:38,292 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:04:43,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:04:43,158 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:04:44,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:44,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:44,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:44,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:44,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:44,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:44,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:44,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:44,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:44,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:44,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:44,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:44,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:45,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:45,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:45,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:45,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:45,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:45,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:45,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:45,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:45,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:45,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:45,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:45,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:45,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:45,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:45,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:45,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:45,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:45,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:45,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:48,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:04:50,308 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:04:54,298 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:04:55,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:55,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:55,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:55,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:55,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:55,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:55,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:55,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:55,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:55,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:55,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:55,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:55,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:55,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:55,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:55,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:57,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:57,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:57,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:57,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:57,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:57,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:57,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:57,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:57,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:57,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:57,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:57,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:57,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:57,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:57,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:57,734 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:04:58,299 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:04:58,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:04:58,746 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:05:02,301 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:05:04,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:04,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:04,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:04,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:04,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:04,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:04,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:04,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:04,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:04,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:04,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:04,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:04,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:04,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:04,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:04,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:06,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:05:07,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:07,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:07,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:07,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:07,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:07,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:07,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:07,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:07,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:07,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:07,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:07,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:07,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:07,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:07,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:07,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:10,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:05:12,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:05:14,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:05:14,034 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:05:16,306 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:05:20,384 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:05:21,308 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:05:23,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:23,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:23,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:23,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:23,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:23,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:23,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:23,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:23,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:23,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:23,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:23,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:23,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:23,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:23,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:23,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:23,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:05:24,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:24,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:24,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:24,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:24,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:24,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:24,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:24,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:24,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:24,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:24,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:24,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:24,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:24,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:24,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:24,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:26,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:26,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:26,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:26,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:26,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:26,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:26,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:26,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:26,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:26,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:26,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:26,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:26,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:26,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:26,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:26,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:26,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:26,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:26,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:26,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:26,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:26,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:26,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:26,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:26,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:26,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:26,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:26,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:26,269 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:26,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:26,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:26,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:27,311 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:05:29,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:05:29,258 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:05:29,313 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:05:30,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:30,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:30,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:30,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:30,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:30,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:30,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:30,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:30,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:30,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:30,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:30,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:30,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:30,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:30,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:30,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:33,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:33,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:33,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:33,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:33,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:33,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:33,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:33,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:33,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:33,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:33,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:33,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:33,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:33,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:33,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:33,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:33,314 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:05:35,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:05:37,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:37,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:37,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:37,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:37,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:37,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:37,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:37,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:37,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:37,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:37,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:37,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:37,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:37,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:37,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:37,146 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:37,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:37,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:37,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:37,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:37,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:37,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:37,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:37,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:37,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:37,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:37,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:37,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:37,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:37,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:37,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:37,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:37,316 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:05:39,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:39,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:39,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:39,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:39,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:39,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:39,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:39,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:39,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:39,753 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:39,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:39,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:39,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:39,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:39,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:39,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:40,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:40,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:40,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:40,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:40,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:40,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:40,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:40,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:40,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:40,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:40,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:40,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:40,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:40,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:40,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:40,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:41,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:05:43,318 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:05:44,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:05:44,589 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:05:45,319 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:05:46,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:46,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:46,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:46,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:46,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:46,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:47,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:47,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:47,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:47,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:47,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:47,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:47,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:47,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:47,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:47,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:47,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:47,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:47,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:47,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:47,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:47,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:05:47,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:47,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:47,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:47,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:47,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:47,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:47,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:47,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:47,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:47,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:47,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:49,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:49,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:49,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:49,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:49,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:49,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:49,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:49,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:49,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:49,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:49,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:49,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:49,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:49,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:49,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:49,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:50,453 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:05:51,321 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:05:51,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:51,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:51,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:51,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:51,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:51,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:51,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:51,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:51,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:51,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:51,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:52,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:52,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:52,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:52,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:52,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:52,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:52,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:52,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:52,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:52,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:52,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:52,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:52,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:52,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:52,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:52,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:52,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:52,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:52,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:52,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:52,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:53,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:53,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:53,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:53,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:53,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:53,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:53,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:53,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:53,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:53,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:53,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:53,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:53,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:53,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:53,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:53,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:53,322 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:05:55,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:05:56,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:56,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:56,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:56,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:56,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:56,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:56,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:56,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:56,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:56,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:56,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:56,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:56,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:56,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:56,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:56,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:57,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:05:59,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:59,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:59,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:59,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:59,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:59,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:59,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:59,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:59,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:59,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:59,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:59,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:59,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:59,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:59,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:59,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:59,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:05:59,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:59,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:59,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:59,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:59,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:59,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:59,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:59,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:59,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:59,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:59,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:59,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:59,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:59,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:59,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:59,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:05:59,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:05:59,858 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:06:01,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:01,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:01,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:01,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:01,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:01,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:01,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:01,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:01,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:01,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:01,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:01,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:01,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:01,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:01,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:01,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:01,325 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:06:03,326 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:06:05,326 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:06:06,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:06,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:06,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:06,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:06,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:06,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:06,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:06,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:06,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:06,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:06,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:06,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:06,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:06,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:06,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:06,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:06,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:06,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:06,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:06,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:06,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:06,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:06,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:06,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:06,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:06,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:06,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:06,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:06,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:06,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:06,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:06,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:07,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:06:08,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:08,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:08,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:08,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:08,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:08,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:08,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:08,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:08,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:08,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:08,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:08,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:08,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:08,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:08,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:08,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:09,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:06:09,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:09,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:09,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:09,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:09,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:09,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:09,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:09,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:09,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:09,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:09,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:09,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:09,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:09,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:09,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:09,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:09,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:09,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:09,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:09,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:09,914 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:09,915 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:09,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:09,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:09,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:09,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:09,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:09,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:09,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:09,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:09,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:09,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:11,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:06:11,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:11,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:11,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:11,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:11,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:11,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:11,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:11,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:11,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:11,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:11,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:11,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:11,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:11,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:11,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:11,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:13,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:13,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:13,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:13,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:13,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:13,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:13,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:13,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:13,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:13,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:13,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:13,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:13,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:13,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:13,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:13,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:13,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:06:15,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:06:15,152 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:06:15,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:06:16,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:16,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:16,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:16,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:16,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:16,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:16,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:16,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:16,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:16,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:16,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:16,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:16,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:16,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:16,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:16,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:17,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:06:17,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:17,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:17,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:17,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:17,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:17,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:17,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:17,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:17,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:17,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:17,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:17,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:17,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:17,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:17,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:17,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:19,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:19,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:19,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:19,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:19,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:19,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:19,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:19,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:19,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:19,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:19,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:19,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:19,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:19,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:19,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:19,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:19,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:06:19,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:19,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:19,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:19,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:19,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:19,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:19,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:19,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:19,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:19,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:19,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:19,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:19,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:19,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:19,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:19,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:20,524 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:06:21,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:06:23,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:06:25,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:06:26,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:26,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:26,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:26,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:26,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:26,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:26,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:26,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:26,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:26,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:26,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:26,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:26,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:26,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:26,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:26,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:27,335 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:06:27,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:27,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:27,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:27,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:27,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:27,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:27,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:27,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:27,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:27,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:27,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:27,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:27,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:27,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:27,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:27,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:28,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:28,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:28,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:28,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:28,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:28,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:28,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:28,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:28,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:28,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:28,105 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:28,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:28,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:28,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:28,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:28,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:29,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:06:30,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:06:30,380 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:06:30,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:30,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:30,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:30,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:30,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:30,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:30,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:30,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:30,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:30,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:30,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:30,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:30,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:30,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:30,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:30,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,208 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:06:31,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,590 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:31,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:33,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:33,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:33,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:06:33,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:33,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:33,339 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:33,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:33,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:33,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:33,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:33,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:33,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:33,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:33,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:33,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:33,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:33,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:33,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:33,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:33,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:33,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:33,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:33,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:33,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:33,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:33,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:33,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:33,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:33,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:33,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:33,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:33,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:33,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:34,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:34,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:34,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:34,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:34,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:34,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:34,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:34,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:34,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:34,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:34,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:34,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:34,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:34,516 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 11:06:34,741 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 11:06:34,822 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 11:06:35,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 11:06:35,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:06:36,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:06:38,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:38,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:38,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:38,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:38,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:38,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:38,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:38,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:38,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:38,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:38,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:38,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:38,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:38,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:38,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:38,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:45,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:06:45,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:45,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:45,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:45,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:45,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:45,380 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:45,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:45,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:45,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:45,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:45,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:45,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:45,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:45,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:45,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:45,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:45,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:06:45,603 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:06:49,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:06:50,862 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:06:54,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:06:56,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:56,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:56,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:56,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:56,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:56,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:56,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:56,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:56,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:56,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:56,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:56,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:56,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:56,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:56,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:56,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:06:58,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:07:00,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:00,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:00,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:00,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:00,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:00,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:00,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:00,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:00,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:00,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:00,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:00,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:00,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:00,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:00,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:00,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:00,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:07:00,827 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:07:02,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:02,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:02,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:02,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:02,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:02,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:02,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:02,076 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:02,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:02,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:02,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:02,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:02,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:02,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:02,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:02,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:02,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:07:05,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:05,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:05,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:05,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:05,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:05,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:05,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:05,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:05,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:05,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:05,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:05,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:05,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:05,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:05,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:05,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:06,350 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:07:09,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:09,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:09,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:09,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:09,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:09,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:09,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:09,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:09,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:09,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:09,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:09,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:09,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:09,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:09,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:09,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:10,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:07:12,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:07:16,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:16,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:16,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:16,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:16,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:16,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:16,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:16,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:16,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:16,045 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:16,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:16,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:16,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:16,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:16,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:16,050 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:16,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:07:16,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:07:16,388 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:07:20,356 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:07:20,951 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:07:22,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:07:26,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:07:27,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:27,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:27,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:27,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:27,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:27,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:27,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:27,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:27,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:27,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:27,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:27,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:27,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:27,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:27,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:27,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:27,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:27,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:27,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:27,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:27,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:27,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:27,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:27,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:27,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:27,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:27,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:27,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:27,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:27,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:27,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:27,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:28,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:07:30,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:07:31,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:07:31,693 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:07:31,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:31,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:31,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:31,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:31,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:31,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:31,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:31,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:31,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:32,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:32,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:32,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:32,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:32,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:32,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:32,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:33,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:33,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:33,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:33,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:33,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:33,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:33,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:33,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:33,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:33,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:33,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:33,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:33,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:33,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:33,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:33,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:34,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:34,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:34,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:34,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:34,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:34,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:34,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:34,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:34,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:34,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:07:34,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:34,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:34,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:34,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:34,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:34,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:34,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:36,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:07:37,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:37,205 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:37,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:37,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:37,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:37,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:37,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:37,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:37,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:37,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:37,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:37,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:37,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:37,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:37,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:37,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:38,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:07:39,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:39,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:39,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:39,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:39,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:39,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:39,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:39,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:39,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:39,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:39,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:39,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:39,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:39,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:39,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:39,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:40,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:40,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:40,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:40,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:40,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:40,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:41,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:41,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:41,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:41,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:41,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:41,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:41,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:41,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:41,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:41,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:42,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:42,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:42,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:42,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:42,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:42,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:42,203 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:42,204 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:42,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:42,207 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:42,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:42,209 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:42,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:42,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:42,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:42,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:42,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:07:42,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:42,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:42,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:42,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:42,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:42,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:42,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:42,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:42,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:42,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:42,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:42,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:42,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:42,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:42,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:42,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:44,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:07:45,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:45,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:45,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:45,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:45,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:45,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:45,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:45,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:45,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:45,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:45,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:45,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:45,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:45,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:45,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:45,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:45,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:45,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:45,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:45,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:45,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:45,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:45,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:45,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:45,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:45,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:45,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:45,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:45,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:45,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:45,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:45,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:46,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:07:46,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:07:46,922 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:07:48,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:07:48,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:48,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:48,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:48,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:48,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:48,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:48,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:48,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:48,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:48,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:48,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:48,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:48,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:48,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:48,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:48,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:50,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:07:51,068 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:07:51,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:51,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:51,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:51,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:51,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:51,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:51,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:51,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:51,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:51,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:51,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:51,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:51,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:51,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:51,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:51,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:53,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:53,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:53,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:53,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:53,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:53,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:53,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:53,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:53,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:53,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:53,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:53,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:53,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:53,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:53,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:53,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:53,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:53,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:53,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:53,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:53,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:53,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:53,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:53,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:53,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:53,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:53,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:53,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:53,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:53,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:53,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:53,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:54,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:07:56,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:07:57,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:57,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:57,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:57,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:57,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:57,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:57,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:57,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:57,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:57,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:57,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:57,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:57,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:57,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:57,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:57,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:58,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:07:59,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:59,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:59,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:59,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:59,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:59,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:59,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:59,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:59,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:59,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:59,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:59,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:59,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:59,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:59,291 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:07:59,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:00,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:00,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:00,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:00,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:00,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:00,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:00,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:00,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:00,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:00,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:00,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:00,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:00,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:00,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:00,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:00,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:00,371 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:08:02,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:08:02,149 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:08:02,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:08:02,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:02,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:02,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:02,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:02,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:02,507 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:02,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:02,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:02,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:02,511 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:02,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:02,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:02,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:02,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:02,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:02,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:04,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:08:06,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:06,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:06,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:06,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:06,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:06,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:06,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:06,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:06,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:06,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:06,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:06,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:06,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:06,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:06,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:06,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:06,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:08:08,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:08,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:08,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:08,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:08,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:08,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:08,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:08,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:08,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:08,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:08,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:08,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:08,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:08,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:08,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:08,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:08,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:08:09,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:09,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:09,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:09,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:09,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:09,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:09,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:09,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:09,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:09,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:09,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:09,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:09,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:09,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:09,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:09,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:10,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:08:11,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:11,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:11,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:11,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:11,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:11,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:11,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:11,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:11,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:11,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:11,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:11,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:11,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:11,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:11,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:11,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:11,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:11,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:11,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:11,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:11,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:11,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:11,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:11,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:11,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:11,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:11,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:11,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:11,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:11,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:11,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:11,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:12,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:12,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:12,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:12,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:12,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:12,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:12,289 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:12,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:12,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:12,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:12,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:12,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:12,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:12,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:12,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:12,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:12,377 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:08:14,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:08:15,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:15,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:15,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:15,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:15,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:15,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:15,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:15,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:15,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:15,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:15,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:15,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:15,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:15,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:15,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:15,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:16,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:16,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:16,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:16,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:16,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:16,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:16,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:16,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:16,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:16,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:16,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:16,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:16,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:16,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:16,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:16,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:16,379 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:08:17,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:08:17,414 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:08:17,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:17,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:17,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:17,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:17,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:17,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:17,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:17,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:17,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:17,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:17,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:17,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:17,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:17,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:17,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:17,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:18,379 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:08:18,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:18,462 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:18,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:18,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:18,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:18,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:18,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:18,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:18,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:18,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:18,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:18,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:18,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:18,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:18,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:18,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:20,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:08:20,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:20,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:20,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:20,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:20,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:20,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:20,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:20,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:20,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:20,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:20,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:20,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:20,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:20,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:20,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:20,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:21,157 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:08:22,381 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:08:24,381 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:08:26,382 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:08:26,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:26,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:26,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:26,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:26,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:26,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:26,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:26,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:26,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:26,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:26,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:26,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:26,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:26,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:26,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:26,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:27,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:27,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:27,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:27,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:27,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:27,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:27,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:27,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:27,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:27,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:27,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:27,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:27,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:27,333 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:27,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:27,334 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:28,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:08:29,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:29,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:29,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:29,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:29,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:29,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:29,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:29,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:29,570 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:29,571 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:29,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:29,572 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:29,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:29,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:29,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:29,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:29,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:29,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:29,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:29,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:29,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:29,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:29,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:29,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:29,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:29,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:29,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:29,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:29,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:29,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:29,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:29,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:30,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:08:31,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:31,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:31,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:31,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:31,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:31,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:31,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:31,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:31,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:31,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:31,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:31,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:31,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:31,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:31,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:31,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,384 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:08:32,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:08:32,638 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:08:32,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:32,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:34,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:08:42,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:42,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:42,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:42,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:42,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:42,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:42,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:42,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:42,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:42,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:42,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:42,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:42,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:42,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:42,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:42,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:45,388 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:08:45,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:45,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:45,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:45,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:45,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:45,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:45,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:45,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:45,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:45,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:45,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:45,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:45,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:45,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:45,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:45,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:47,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:08:47,865 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:08:51,295 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:08:51,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:08:54,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:54,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:54,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:54,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:54,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:54,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:54,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:54,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:54,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:54,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:54,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:54,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:54,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:54,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:54,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:54,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:55,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:08:56,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:56,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:56,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:56,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:56,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:56,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:56,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:56,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:56,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:56,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:56,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:56,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:56,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:56,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:56,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:56,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:59,393 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:08:59,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:59,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:59,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:59,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:59,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:59,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:59,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:59,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:59,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:59,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:59,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:59,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:59,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:59,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:59,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:08:59,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:03,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:09:03,126 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:09:03,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:09:05,395 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:09:08,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:08,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:08,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:08,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:08,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:08,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:08,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:08,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:08,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:08,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:08,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:08,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:08,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:08,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:08,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:08,923 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:09,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:09,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:09,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:09,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:09,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:09,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:09,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:09,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:09,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:09,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:09,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:09,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:09,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:09,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:09,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:09,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:09,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:09:13,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:09:13,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:13,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:13,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:13,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:13,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:13,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:13,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:13,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:13,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:13,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:13,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:13,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:13,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:13,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:13,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:13,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:15,399 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:09:15,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:15,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:15,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:15,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:15,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:15,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:15,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:15,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:15,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:15,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:15,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:15,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:15,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:15,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:15,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:15,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:18,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:09:18,353 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:09:19,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:09:20,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:20,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:20,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:20,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:20,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:20,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:20,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:20,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:20,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:20,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:20,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:20,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:20,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:20,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:20,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:20,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:21,386 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:09:23,402 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:09:25,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:09:29,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:09:31,406 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:09:31,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:31,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:31,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:31,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:31,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:31,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:31,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:31,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:31,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:31,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:31,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:31,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:31,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:31,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:31,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:31,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:33,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:33,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:33,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:33,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:33,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:33,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:33,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:33,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:33,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:33,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:33,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:33,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:33,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:33,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:33,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:33,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:33,407 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:09:33,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:09:33,723 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:09:34,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:34,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:34,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:34,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:34,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:34,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:34,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:34,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:34,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:34,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:34,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:34,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:34,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:34,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:34,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:34,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:36,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:36,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:36,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:36,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:36,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:36,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:36,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:36,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:36,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:36,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:36,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:36,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:36,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:36,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:36,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:36,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:37,409 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:09:39,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:09:40,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:40,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:40,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:40,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:40,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:40,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:40,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:40,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:40,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:40,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:40,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:40,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:40,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:40,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:40,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:40,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:41,411 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:09:42,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:42,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:42,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:42,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:42,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:42,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:42,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:42,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:42,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:42,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:42,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:42,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:42,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:42,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:42,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:42,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:44,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:44,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:44,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:44,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:44,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:44,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:44,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:44,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:44,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:44,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:44,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:44,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:44,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:44,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:44,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:44,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:45,412 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:09:47,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:47,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:47,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:47,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:47,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:47,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:47,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:47,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:47,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:47,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:47,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:47,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:47,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:47,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:47,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:47,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:47,413 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:09:48,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:48,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:48,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:48,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:48,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:48,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:48,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:48,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:48,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:48,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:48,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:48,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:48,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:48,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:48,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:48,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:48,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:09:48,978 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:09:49,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:09:50,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:50,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:50,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:50,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:50,664 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:50,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:50,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:50,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:50,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:50,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:50,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:50,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:50,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:50,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:50,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:50,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:51,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:09:51,468 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:09:51,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:51,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:51,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:51,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:51,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:51,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:51,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:51,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:51,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:51,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:51,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:51,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:51,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:51,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:51,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:51,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:53,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:09:53,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:53,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:53,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:53,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:53,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:53,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:53,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:53,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:53,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:53,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:53,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:53,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:53,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:53,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:53,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:53,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,267 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,336 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,337 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,363 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:55,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:09:57,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:09:58,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:58,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:58,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:58,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:58,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:58,324 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:58,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:58,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:58,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:58,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:58,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:58,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:58,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:58,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:58,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:58,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:58,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:58,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:58,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:58,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:58,349 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:58,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:58,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:58,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:58,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:58,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:58,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:58,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:58,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:58,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:58,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:58,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:09:59,419 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:10:01,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:10:02,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:02,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:02,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:02,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:02,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:02,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:02,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:02,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:02,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:02,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:02,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:02,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:02,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:02,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:02,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:02,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:03,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:03,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:03,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:03,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:03,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:03,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:03,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:03,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:03,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:03,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:03,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:03,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:03,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:03,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:03,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:03,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:03,421 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:10:04,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:10:04,207 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:10:05,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:10:07,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:07,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:07,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:07,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:07,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:07,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:07,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:07,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:07,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:07,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:07,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:07,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:07,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:07,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:07,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:07,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:07,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:10:09,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:10:09,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:09,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:09,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:09,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:09,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:09,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:09,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:09,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:09,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:09,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:09,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:09,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:09,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:09,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:09,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:09,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:11,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:11,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:11,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:11,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:11,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:11,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:11,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:11,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:11,318 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:11,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:11,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:11,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:11,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:11,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:11,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:11,323 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:11,425 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:10:13,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:10:13,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:13,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:13,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:13,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:13,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:13,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:13,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:13,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:13,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:13,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:13,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:13,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:13,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:13,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:13,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:13,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:14,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:14,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:14,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:14,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:14,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:14,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:14,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:14,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:14,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:14,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:14,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:14,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:14,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:14,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:14,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:14,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:15,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:15,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:15,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:15,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:15,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:15,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:15,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:15,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:15,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:15,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:15,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:15,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:15,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:15,090 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:15,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:15,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:15,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:10:15,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:15,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:15,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:15,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:15,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:15,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:15,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:15,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:15,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:15,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:15,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:15,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:15,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:15,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:15,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:15,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:17,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:17,044 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:17,046 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:17,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:17,047 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:17,048 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:17,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:17,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:17,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:17,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:17,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:17,053 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:17,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:17,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:17,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:17,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:17,428 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:10:17,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:17,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:17,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:17,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:17,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:17,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:17,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:17,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:17,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:17,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:17,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:17,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:17,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:17,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:17,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:17,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:18,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:18,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:18,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:18,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:18,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:18,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:18,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:18,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:18,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:18,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:18,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:18,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:18,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:18,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:18,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:18,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:19,428 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:10:19,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:10:19,433 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:10:19,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:19,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:19,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:19,874 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:19,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:19,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:19,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:19,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:19,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:19,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:19,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:19,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:19,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:19,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:19,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:19,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:21,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:21,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:21,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:21,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:21,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:21,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:21,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:21,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:21,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:21,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:21,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:21,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:21,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:21,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:21,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:21,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:21,429 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:10:21,565 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:10:23,430 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:10:25,431 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:10:27,432 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:10:27,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:27,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:27,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:27,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:27,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:27,553 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:27,554 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:27,555 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:27,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:27,556 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:27,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:27,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:27,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:27,559 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:27,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:27,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:29,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:29,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:29,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:29,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:29,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:29,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:29,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:29,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:29,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:29,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:29,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:29,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:29,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:29,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:29,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:29,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:29,433 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:10:30,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:30,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:30,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:30,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:30,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:30,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:30,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:30,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:30,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:30,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:30,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:30,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:30,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:30,503 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:30,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:30,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:31,434 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:10:31,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:31,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:31,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:31,541 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:31,557 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:31,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:31,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:31,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:31,561 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:31,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:31,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:31,563 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:31,564 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:31,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:31,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:31,566 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:31,567 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:31,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:31,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:31,569 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:31,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:31,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:31,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:31,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:31,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:31,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:31,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:31,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:31,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:31,963 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 11:10:32,190 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 11:10:32,263 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 11:10:32,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 11:10:33,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:10:34,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:10:34,677 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:10:41,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:41,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:41,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:41,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:41,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:41,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:41,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:41,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:41,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:41,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:41,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:41,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:41,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:41,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:41,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:41,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:43,439 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:10:47,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:47,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:47,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:47,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:47,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:47,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:47,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:47,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:47,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:47,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:47,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:47,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:47,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:47,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:47,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:47,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:50,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:10:50,074 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:10:50,442 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:10:51,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:51,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:51,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:51,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:51,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:51,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:51,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:51,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:51,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:51,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:51,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:51,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:51,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:51,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:51,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:51,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:51,714 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:10:54,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:10:55,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:55,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:55,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:55,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:55,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:55,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:55,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:55,504 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:55,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:55,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:55,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:55,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:55,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:55,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:55,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:55,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:57,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:57,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:57,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:57,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:57,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:57,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:57,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:57,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:57,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:57,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:57,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:57,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:57,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:57,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:57,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:57,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:58,446 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:10:59,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:59,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:59,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:59,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:59,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:59,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:59,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:59,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:59,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:59,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:59,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:59,290 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:59,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:59,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:59,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:10:59,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:01,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:01,214 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:01,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:01,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:01,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:01,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:01,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:01,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:01,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:01,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:01,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:01,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:01,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:01,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:01,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:01,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:02,447 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:11:02,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:02,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:02,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:02,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:02,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:02,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:02,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:02,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:03,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:03,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:03,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:03,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:03,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:03,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:03,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:03,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:05,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:11:05,533 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:11:06,449 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:11:08,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:11:09,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:09,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:09,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:09,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:09,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:09,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:09,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:09,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:09,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:09,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:09,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:09,789 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:09,790 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:09,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:09,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:09,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:12,451 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:11:16,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:11:16,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:16,509 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:16,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:16,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:16,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:16,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:16,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:16,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:16,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:16,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:16,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:16,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:16,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:16,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:16,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:16,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:18,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:11:20,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:11:20,879 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:11:21,832 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:11:22,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:22,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:22,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:22,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:22,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:22,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:22,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:22,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:22,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:22,382 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:22,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:22,384 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:22,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:22,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:22,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:22,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:22,456 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:11:22,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:22,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:22,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:22,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:22,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:22,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:22,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:22,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:22,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:22,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:22,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:22,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:22,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:22,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:22,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:22,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:24,456 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:11:27,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:27,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:27,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:27,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:27,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:27,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:27,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:27,074 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:27,077 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:27,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:27,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:27,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:27,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:27,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:27,082 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:27,083 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:28,458 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:11:30,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:11:32,460 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:11:33,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:33,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:33,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:33,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:33,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:33,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:33,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:33,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:33,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:33,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:33,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:33,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:33,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:33,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:33,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:33,767 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:34,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:34,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:34,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:34,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:34,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:34,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:34,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:34,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:34,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:34,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:34,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:34,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:34,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:34,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:34,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:34,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:36,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:11:36,101 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:11:36,461 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:11:38,462 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:11:40,463 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:11:40,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:40,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:40,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:40,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:40,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:40,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:40,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:40,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:40,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:40,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:40,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:40,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:40,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:40,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:40,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:40,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:41,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:41,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:41,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:41,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:41,345 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:41,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:41,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:41,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:41,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:41,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:41,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:41,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:41,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:41,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:41,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:41,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:42,464 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:11:43,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:43,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:43,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:43,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:43,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:43,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:43,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:43,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:43,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:43,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:43,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:43,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:43,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:43,786 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:43,787 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:43,788 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:46,465 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:11:48,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:48,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:48,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:48,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:48,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:48,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:48,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:48,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:48,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:48,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:48,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:48,149 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:48,150 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:48,151 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:48,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:48,152 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:48,466 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:11:50,466 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:11:50,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:50,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:50,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:50,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:50,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:50,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:50,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:50,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:50,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:50,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:50,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:50,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:50,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:50,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:50,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:50,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:51,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:11:51,327 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:11:51,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:51,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:51,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:51,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:51,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:51,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:51,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:51,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:51,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:51,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:51,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:51,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:51,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:51,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:51,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:51,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:51,941 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:11:52,467 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:11:53,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:53,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:53,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:53,980 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:53,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:53,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:53,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:53,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:53,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:53,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:53,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:53,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:53,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:53,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:53,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:53,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:54,468 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:11:55,875 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:55,876 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:55,878 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:55,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:55,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:55,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:55,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:55,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:55,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:55,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:55,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:55,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:55,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:55,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:55,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:55,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:56,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:11:57,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:57,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:57,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:57,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:57,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:57,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:57,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:57,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:57,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:57,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:57,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:57,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:57,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:57,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:57,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:57,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:58,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:58,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:58,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:58,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:58,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:58,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:58,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:58,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:58,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:58,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:58,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:58,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:58,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:58,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:58,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:58,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:58,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:11:58,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:58,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:58,900 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:58,901 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:58,902 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:58,903 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:58,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:58,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:58,907 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:58,908 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:58,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:58,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:58,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:58,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:58,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:58,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:59,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:59,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:59,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:59,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:59,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:59,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:59,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:59,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:59,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:59,260 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:59,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:59,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:59,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:59,263 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:59,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:11:59,264 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:00,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:00,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:00,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:00,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:00,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:00,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:00,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:00,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:00,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:00,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:00,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:00,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:00,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:00,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:00,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:00,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:00,188 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:00,189 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:00,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:00,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:00,192 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:00,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:00,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:00,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:00,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:00,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:00,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:00,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:00,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:00,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:00,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:00,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:00,470 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:12:01,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:01,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:01,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:01,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:01,079 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:01,080 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:01,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:01,081 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:01,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:01,084 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:01,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:01,086 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:01,087 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:01,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:01,088 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:01,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:02,471 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:12:04,471 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:12:06,472 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:12:06,562 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:12:06,562 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:12:06,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:06,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:06,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:06,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:06,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:06,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:06,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:06,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:06,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:06,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:06,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:06,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:06,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:06,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:06,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:06,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:07,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:07,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:07,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:07,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:07,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:07,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:07,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:07,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:07,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:07,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:07,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:07,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:07,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:07,595 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:07,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:07,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:08,473 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:12:10,474 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:12:11,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:11,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:11,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:11,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:11,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:11,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:11,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:11,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:11,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:11,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:11,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:11,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:11,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:11,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:11,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:11,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:12,474 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:12:13,361 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:13,362 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:13,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:13,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:13,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:13,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:13,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:13,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:13,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:13,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:13,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:13,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:13,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:13,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:13,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:13,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:14,475 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:12:14,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:14,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:14,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:14,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:14,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:14,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:14,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:14,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:14,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:14,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:14,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:14,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:14,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:14,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:14,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:14,707 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:15,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:15,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:15,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:15,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:15,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:15,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:15,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:15,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:15,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:15,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:15,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:15,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:15,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:15,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:15,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:15,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:15,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:15,540 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:15,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:15,542 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:15,543 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:15,544 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:15,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:15,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:15,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:15,548 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:15,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:15,549 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:15,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:15,551 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:15,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:15,552 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:16,476 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:12:16,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:16,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:16,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:16,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:16,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:16,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:16,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:16,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:16,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:16,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:16,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:16,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:16,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:16,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:16,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:16,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:16,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:16,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:16,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:16,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:16,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:16,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:16,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:16,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:16,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:16,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:16,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:16,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:16,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:16,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:16,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:16,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:18,477 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:12:20,478 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:12:20,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:20,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:20,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:20,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:20,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:20,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:20,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:20,818 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:20,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:20,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:20,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:20,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:20,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:20,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:20,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:20,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:20,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:20,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:20,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:20,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:20,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:20,843 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:20,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:20,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:20,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:20,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:20,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:20,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:20,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:20,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:20,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:20,851 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:21,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:21,461 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:21,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:21,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:21,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:21,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:21,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:21,467 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:21,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:21,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:21,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:21,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:21,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:21,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:21,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:21,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:21,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:12:21,889 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:12:22,112 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:12:22,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:22,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:22,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:22,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:22,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:22,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:22,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:22,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:22,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:22,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:22,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:22,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:22,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:22,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:22,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:22,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:22,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:12:23,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:23,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:23,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:23,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:23,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:23,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:23,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:23,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:23,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:23,985 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:23,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:23,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:23,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:23,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:23,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:23,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:24,480 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:12:26,481 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:12:28,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:28,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:28,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:28,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:28,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:28,248 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:28,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:28,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:28,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:28,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:28,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:28,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:28,254 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:28,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:28,255 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:28,256 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:28,482 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:12:30,482 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:12:30,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:30,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:30,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:30,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:30,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:30,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:30,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:30,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:30,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:30,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:30,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:30,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:30,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:30,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:30,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:30,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:30,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:30,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:30,833 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:30,834 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:30,981 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:30,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:30,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:30,987 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:30,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:30,988 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:30,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:30,989 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:32,483 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:12:34,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:34,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:34,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:34,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:34,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:34,480 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:34,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:34,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:34,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:34,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:34,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:34,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:34,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:34,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:34,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:34,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:37,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:12:37,114 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:12:40,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:40,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:40,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:40,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:40,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:40,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:40,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:40,622 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:40,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:40,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:40,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:40,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:40,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:40,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:40,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:40,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:44,487 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:12:48,488 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:12:49,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:49,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:49,257 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:49,258 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:49,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:49,259 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:49,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:49,261 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:49,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:49,268 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:49,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:49,271 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:49,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:49,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:49,273 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:49,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:52,094 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:12:52,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:12:52,441 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:12:55,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:12:57,491 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:12:59,020 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:59,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:59,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:59,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:59,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:59,026 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:59,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:59,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:59,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:59,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:59,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:59,035 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:59,036 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:59,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:59,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:59,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:59,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:59,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:59,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:59,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:59,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:59,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:59,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:59,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:59,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:59,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:59,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:59,457 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:59,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:59,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:59,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:12:59,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:01,492 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:13:02,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:02,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:02,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:02,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:02,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:02,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:03,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:03,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:03,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:03,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:03,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:03,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:03,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:03,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:03,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:03,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:05,494 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:13:06,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:06,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:06,346 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:06,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:06,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:06,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:06,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:06,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:06,354 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:06,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:06,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:06,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:06,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:06,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:06,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:06,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:07,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:13:07,922 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:13:08,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:08,270 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:08,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:08,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:08,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:08,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:08,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:08,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:08,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:08,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:08,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:08,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:08,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:08,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:08,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:08,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:09,496 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:13:11,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:11,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:11,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:11,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:11,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:11,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:11,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:11,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:11,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:11,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:11,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:11,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:11,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:11,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:11,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:11,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:11,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:11,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:11,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:11,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:11,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:11,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:11,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:11,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:11,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:11,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:11,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:11,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:11,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:11,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:11,482 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:11,483 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:13,497 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:13:15,498 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:13:19,500 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:13:20,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:20,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:20,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:20,505 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:20,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:20,506 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:20,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:20,508 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:20,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:20,512 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:20,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:20,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:20,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:20,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:20,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:20,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:21,500 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:13:22,180 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:13:23,154 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:13:23,154 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:13:25,502 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:13:26,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:26,338 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:26,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:26,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:26,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:26,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:26,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:26,344 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:26,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:26,348 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:26,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:26,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:26,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:26,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:26,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:26,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:27,503 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:13:28,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:28,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:28,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:28,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:28,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:28,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:28,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:28,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:28,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:28,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:28,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:28,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:28,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:28,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:28,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:28,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:29,504 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:13:30,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:30,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:30,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:30,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:30,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:30,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:30,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:30,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:30,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:30,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:30,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:30,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:30,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:30,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:30,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:30,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:33,505 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:13:34,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:34,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:34,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:34,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:34,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:34,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:34,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:34,394 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:34,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:34,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:34,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:34,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:34,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:34,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:34,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:34,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:35,506 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:13:36,794 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:36,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:36,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:36,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:36,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:36,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:36,800 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:36,801 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:36,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:36,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:36,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:36,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:36,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:36,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:36,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:36,809 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:37,507 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:13:38,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:38,113 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:38,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:38,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:38,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:38,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:38,118 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:38,119 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:38,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:38,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:38,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:38,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:38,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:38,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:38,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:38,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:38,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:13:38,379 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:13:39,508 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:13:43,510 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:13:45,511 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:13:47,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:47,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:47,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:47,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:47,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:47,404 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:47,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:47,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:47,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:47,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:47,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:47,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:47,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:47,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:47,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:47,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:47,512 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:13:48,949 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:48,950 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:48,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:48,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:48,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:48,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:48,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:48,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:48,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:48,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:48,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:48,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:48,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:48,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:48,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:48,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:49,512 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:13:50,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:50,027 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:50,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:50,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:50,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:50,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:50,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:50,034 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:50,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:50,037 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:50,039 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:50,040 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:50,041 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:50,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:50,042 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:50,043 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:50,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:50,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:50,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:50,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:50,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:50,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:50,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:50,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:50,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:50,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:50,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:50,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:50,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:50,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:50,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:50,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:51,513 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:13:52,246 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:13:53,514 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:13:53,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:13:53,774 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:13:54,274 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:54,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:54,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:54,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:54,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:54,279 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:54,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:54,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:54,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:54,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:54,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:54,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:54,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:54,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:54,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:54,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:55,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:13:57,516 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:13:57,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:57,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:57,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:57,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:57,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:57,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:57,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:57,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:57,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:57,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:57,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:57,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:57,643 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:57,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:57,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:57,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:59,516 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:13:59,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:59,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:59,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:59,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:59,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:59,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:59,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:59,621 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:59,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:59,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:59,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:59,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:59,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:59,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:59,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:13:59,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:00,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:00,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:00,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:00,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:00,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:00,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:00,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:00,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:00,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:00,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:00,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:00,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:00,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:00,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:00,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:00,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:01,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:01,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:01,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:01,517 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:01,517 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:14:01,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:01,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:01,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:01,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:01,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:01,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:01,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:01,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:01,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:01,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:01,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:01,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:01,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:01,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:01,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:01,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:01,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:01,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:01,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:01,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:01,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:01,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:01,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:01,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:01,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:01,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:01,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:01,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,460 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,464 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,466 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,473 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,573 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,576 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,577 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,583 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,592 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:02,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:03,518 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:14:05,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:05,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:05,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:05,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:05,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:05,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:05,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:05,173 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:05,175 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:05,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:05,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:05,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:05,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:05,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:05,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:05,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:05,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:05,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:05,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:05,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:05,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:05,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:05,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:05,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:05,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:05,419 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:05,420 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:05,421 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:05,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:05,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:05,423 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:05,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:05,519 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:14:07,519 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:14:08,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:08,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:08,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:08,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:08,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:08,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:08,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:08,762 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:08,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:08,765 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:08,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:08,766 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:08,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:08,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:08,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:08,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:09,112 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:14:09,113 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:14:09,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:14:11,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:11,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:11,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:11,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:11,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:11,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:11,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:11,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:11,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:11,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:11,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:11,143 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:11,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:11,144 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:11,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:11,145 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:11,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:14:13,521 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:14:14,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:14,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:14,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:14,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:14,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:14,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:14,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:14,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:14,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:14,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:14,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:14,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:14,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:14,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:14,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:14,417 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:15,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:15,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:15,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:15,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:15,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:15,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:15,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:15,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:15,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:15,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:15,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:15,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:15,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:15,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:15,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:15,225 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:15,522 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:14:15,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:15,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:15,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:15,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:15,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:15,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:15,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:15,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:15,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:15,702 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:15,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:15,703 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:15,704 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:15,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:15,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:15,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:17,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:17,052 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:17,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:17,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:17,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:17,055 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:17,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:17,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:17,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:17,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:17,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:17,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:17,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:17,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:17,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:17,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:17,523 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:14:18,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:18,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:18,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:18,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:18,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:18,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:18,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:18,300 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:18,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:18,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:18,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:18,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:18,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:18,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:18,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:18,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:19,091 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:19,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:19,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:19,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:19,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:19,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:19,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:19,097 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:19,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:19,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:19,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:19,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:19,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:19,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:19,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:19,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:19,524 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:14:20,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:20,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:20,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:20,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:20,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:20,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:20,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:20,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:20,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:20,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:20,895 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:20,896 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:20,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:20,897 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:20,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:20,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:21,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:14:22,326 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:14:23,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:23,366 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:23,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:23,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:23,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:23,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:23,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:23,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:23,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:23,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:23,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:23,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:23,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:23,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:23,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:23,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:23,526 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:14:24,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:24,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:24,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:24,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:24,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:24,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:24,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:24,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:24,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:24,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:24,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:24,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:24,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:24,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:24,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:24,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:24,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:14:24,361 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:14:25,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,156 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,159 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,527 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:14:25,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:25,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:27,528 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:14:28,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:28,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:28,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:28,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:28,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:28,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:28,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:28,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:28,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:28,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:28,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:28,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:28,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:28,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:28,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:28,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:29,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:14:30,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:30,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:30,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:30,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:30,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:30,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:30,301 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:30,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:30,302 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:30,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:30,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:30,304 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:30,305 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:30,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:30,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:30,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:30,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:30,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:30,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:30,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:30,335 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:30,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:30,340 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:30,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:30,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:30,342 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:30,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:30,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:30,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:30,598 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 11:14:30,813 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 11:14:30,877 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 11:14:31,608 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 11:14:31,608 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:14:32,608 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:14:39,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:14:39,589 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:14:41,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:14:48,613 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:14:49,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:49,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:49,695 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:49,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:49,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:49,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:49,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:49,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:49,705 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:49,706 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:49,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:49,708 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:49,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:49,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:49,711 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:49,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:49,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:49,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:49,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:49,769 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:49,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:49,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:49,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:49,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:49,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:49,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:49,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:49,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:49,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:49,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:49,784 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:49,785 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:14:52,488 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:14:52,615 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:14:54,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:14:54,815 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:14:56,617 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:15:00,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:00,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:00,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:00,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:00,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:00,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:00,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:00,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:00,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:00,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:00,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:00,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:00,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:00,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:00,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:00,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:00,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:00,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:00,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:00,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:00,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:00,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:00,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:15:00,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:00,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:00,624 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:00,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:00,626 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:00,627 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:00,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:00,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:00,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:00,630 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:04,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:15:08,622 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:15:09,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:09,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:09,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:09,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:09,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:09,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:09,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:09,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:09,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:09,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:09,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:09,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:09,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:09,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:09,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:09,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:09,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:09,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:09,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:09,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:09,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:09,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:09,528 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:09,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:09,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:09,533 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:09,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:09,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:09,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:09,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:09,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:09,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:10,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:15:10,329 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:15:11,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:11,381 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:11,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:11,385 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:11,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:11,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:11,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:11,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:11,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:11,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:11,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:11,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:11,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:11,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:11,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:11,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:12,623 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:15:12,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:12,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:12,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:12,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:12,846 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:12,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:12,848 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:12,849 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:12,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:12,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:12,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:12,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:12,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:12,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:12,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:12,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:16,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:16,223 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:16,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:16,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:16,227 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:16,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:16,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:16,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:16,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:16,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:16,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:16,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:16,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:16,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:16,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:16,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:16,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:15:17,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:17,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:17,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:17,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:17,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:17,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:17,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:17,842 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:17,853 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:17,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:17,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:17,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:17,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:17,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:17,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:17,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:18,626 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:15:22,574 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:15:22,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:15:24,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:15:25,560 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:15:25,560 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:15:27,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:27,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:27,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:27,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:27,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:27,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:27,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:27,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:27,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:27,137 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:27,138 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:27,139 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:27,140 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:27,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:27,141 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:27,142 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:28,629 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:15:30,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:15:32,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:32,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:32,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:32,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:32,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:32,830 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:32,831 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:32,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:32,835 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:32,836 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:32,837 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:32,838 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:32,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:32,839 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:32,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:32,841 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:34,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:34,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:34,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:34,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:34,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:34,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:34,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:34,222 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:34,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:34,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:34,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:34,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:34,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:34,230 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:34,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:34,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:34,632 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:15:36,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:15:38,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:15:39,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:39,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:39,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:39,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:39,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:39,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:39,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:39,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:39,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:39,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:39,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:39,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:39,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:39,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:39,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:39,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:39,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:39,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:39,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:39,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:39,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:39,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:39,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:39,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:39,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:39,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:39,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:39,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:39,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:39,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:39,760 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:39,761 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:40,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:15:40,783 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:15:41,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:41,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:41,021 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:41,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:41,022 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:41,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:41,024 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:41,025 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:41,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:41,028 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:41,029 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:41,030 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:41,031 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:41,032 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:41,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:41,033 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:42,635 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:15:44,636 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:15:46,057 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:46,058 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:46,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:46,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:46,062 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:46,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:46,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:46,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:46,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:46,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:46,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:46,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:46,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:46,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:46,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:46,073 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:46,637 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:15:48,638 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:15:50,639 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:15:51,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:51,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:51,660 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:51,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:51,661 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:51,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:51,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:51,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:51,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:51,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:51,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:51,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:51,669 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:51,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:51,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:51,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:52,698 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:15:54,640 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:15:56,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:15:56,005 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:15:56,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:56,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:56,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:56,491 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:56,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:56,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:56,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:56,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:56,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:56,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:56,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:56,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:56,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:56,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:56,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:56,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:56,641 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:15:57,386 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:57,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:57,389 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:57,390 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:57,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:57,391 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:57,392 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:57,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:57,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:57,395 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:57,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:57,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:57,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:57,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:57,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:57,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:15:58,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:16:00,643 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:16:01,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:01,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:01,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:01,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:01,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:01,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:01,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:01,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:01,610 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:01,611 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:01,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:01,612 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:01,613 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:01,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:01,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:01,615 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:02,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:02,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:02,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:02,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:02,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:02,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:02,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:02,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:02,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:02,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:02,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:02,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:02,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:02,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:02,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:02,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:02,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:02,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:02,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:02,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:02,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:02,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:02,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:02,525 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:02,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:02,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:02,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:02,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:02,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:02,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:02,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:02,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:02,643 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:16:03,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:03,510 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:03,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:03,513 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:03,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:03,514 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:03,515 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:03,516 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:03,518 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:03,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:03,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:03,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:03,521 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:03,522 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:03,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:03,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:04,644 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:16:05,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:05,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:05,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:05,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:05,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:05,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:05,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:05,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:05,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:05,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:05,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:05,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:05,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:05,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:05,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:05,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:05,574 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:05,575 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:05,578 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:05,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:05,579 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:05,580 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:05,581 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:05,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:05,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:05,584 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:05,585 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:05,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:05,587 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:05,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:05,588 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:05,589 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:06,645 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:16:07,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,347 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,350 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,351 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,352 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,353 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,355 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,356 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,359 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,405 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,407 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,412 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,414 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,415 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,416 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,465 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,469 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,470 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,471 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,472 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,474 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,475 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,476 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,477 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,478 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:07,479 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:08,646 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:16:09,628 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:09,629 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:09,631 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:09,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:09,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:09,633 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:09,634 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:09,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:09,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:09,637 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:09,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:09,638 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:09,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:09,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:09,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:09,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:09,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:09,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:09,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:09,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:09,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:09,651 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:09,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:09,652 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:09,654 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:09,655 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:09,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:09,656 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:09,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:09,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:09,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:09,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:10,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:16:10,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:10,768 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:10,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:10,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:10,772 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:10,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:10,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:10,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:10,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:10,777 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:10,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:10,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:10,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:10,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:10,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:10,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:11,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:16:11,231 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:16:12,648 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:16:14,649 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:16:15,966 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:15,967 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:15,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:15,969 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:15,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:15,970 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:15,971 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:15,972 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:15,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:15,974 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:15,975 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:15,976 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:15,977 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:15,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:15,978 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:15,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:16,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:16:18,651 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:16:18,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:18,747 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:18,749 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:18,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:18,750 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:18,751 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:18,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:18,752 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:18,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:18,755 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:18,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:18,756 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:18,757 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:18,758 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:18,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:18,759 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:18,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:18,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:18,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:18,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:18,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:18,886 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:18,887 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:18,888 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:18,889 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:18,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:18,891 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:18,892 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:18,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:18,893 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:18,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:18,894 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:19,484 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:19,485 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:19,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:19,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:19,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:19,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:19,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:19,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:19,492 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:19,493 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:19,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:19,494 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:19,495 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:19,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:19,496 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:19,497 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:20,652 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:16:20,997 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:20,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:21,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:21,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:21,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:21,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:21,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:21,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:21,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:21,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:21,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:21,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:21,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:21,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:21,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:21,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:22,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:22,229 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:22,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:22,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:22,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:22,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:22,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:22,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:22,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:22,237 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:22,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:22,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:22,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:22,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:22,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:22,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:22,652 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:16:22,785 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:16:24,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:24,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:24,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:24,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:24,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:24,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:24,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:24,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:24,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:24,012 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:24,013 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:24,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:24,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:24,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:24,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:24,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:24,653 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:16:24,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:24,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:24,717 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:24,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:24,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:24,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:24,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:24,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:24,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:24,723 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:24,724 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:24,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:24,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:24,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:24,727 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:24,728 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:26,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:26,422 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:26,424 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:26,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:26,425 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:26,426 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:26,427 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:26,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:26,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:26,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:26,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:26,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:26,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:26,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:26,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:26,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:26,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:26,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:26,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:26,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:26,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:26,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:26,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:26,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:26,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:26,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:26,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:26,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:26,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:26,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:26,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:26,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:26,468 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:16:26,468 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:16:26,654 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:16:28,655 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:16:29,364 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,368 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,369 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,429 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,432 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,438 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,770 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,771 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,773 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,775 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,778 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,779 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,780 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,781 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,782 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,783 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,817 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,819 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,820 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,821 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,822 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,824 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,825 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,826 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,827 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,828 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:29,829 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:30,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:16:31,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:31,803 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:31,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:31,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:31,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:31,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:31,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:31,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:31,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:31,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:31,811 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:31,812 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:31,813 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:31,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:31,814 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:31,815 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:32,498 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:32,499 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:32,500 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:32,501 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:32,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:32,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:32,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:32,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:32,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:32,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:32,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:32,650 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:32,657 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:16:34,657 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:16:41,733 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:16:41,733 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:16:42,660 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:16:46,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:16:50,664 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:16:51,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:51,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:51,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:51,868 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:51,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:51,869 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:51,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:51,871 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:51,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:51,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:51,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:51,880 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:51,881 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:51,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:51,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:51,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:52,925 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:16:55,666 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:16:56,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:16:56,965 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:16:58,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:58,904 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:58,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:58,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:58,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:58,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:58,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:58,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:58,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:58,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:58,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:58,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:58,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:58,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:58,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:58,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:16:59,668 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:17:00,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:00,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:00,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:00,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:00,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:00,607 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:00,608 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:00,609 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:00,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:00,614 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:00,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:00,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:00,617 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:00,618 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:00,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:00,619 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:03,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:17:04,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:04,658 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:04,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:04,662 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:04,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:04,663 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:04,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:04,665 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:04,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:04,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:04,671 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:04,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:04,673 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:04,674 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:04,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:04,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:06,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:06,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:06,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:06,285 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:06,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:06,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:06,287 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:06,288 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:06,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:06,293 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:06,294 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:06,295 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:06,296 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:06,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:06,297 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:06,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:07,672 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:17:09,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:17:10,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:10,906 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:10,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:10,909 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:10,910 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:10,911 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:10,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:10,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:10,916 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:10,917 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:10,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:10,919 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:10,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:10,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:10,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:10,922 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:10,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:10,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:10,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:10,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:10,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:10,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:10,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:10,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:10,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:10,942 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:10,943 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:10,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:10,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:10,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:10,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:10,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:12,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:17:12,187 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:17:12,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:12,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:12,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:12,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:12,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:12,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:12,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:12,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:12,326 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:12,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:12,328 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:12,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:12,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:12,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:12,331 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:12,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:13,675 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:17:15,676 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:17:16,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:16,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:16,944 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:16,945 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:16,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:16,946 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:16,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:16,948 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:16,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:16,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:16,954 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:16,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:16,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:16,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:16,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:16,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:16,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:16,979 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:16,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:16,983 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:16,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:16,984 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:16,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:16,986 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:16,990 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:16,991 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:16,992 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:16,993 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:16,994 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:16,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:16,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:16,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:19,678 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:17:23,054 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:17:23,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:17:25,680 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:17:27,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:27,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:27,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:27,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:27,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:27,233 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:27,234 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:27,235 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:27,238 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:27,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:27,240 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:27,241 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:27,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:27,243 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:27,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:27,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:27,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:17:27,446 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:17:27,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:17:31,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:31,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:31,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:31,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:31,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:31,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:31,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:31,124 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:31,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:31,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:31,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:31,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:31,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:31,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:31,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:31,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:31,683 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:17:33,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:17:33,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:33,792 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:33,795 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:33,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:33,796 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:33,797 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:33,798 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:33,799 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:33,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:33,802 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:33,804 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:33,805 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:33,806 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:33,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:33,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:33,808 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:35,685 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:17:37,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:17:38,920 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:38,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:38,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:38,924 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:38,925 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:38,926 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:38,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:38,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:38,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:38,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:38,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:38,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:38,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:38,934 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:38,935 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:38,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:40,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:40,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:40,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:40,319 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:40,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:40,320 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:40,321 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:40,322 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:40,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:40,325 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:40,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:40,327 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:40,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:40,329 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:40,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:40,330 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:41,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:17:42,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:17:42,710 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:17:42,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:42,840 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:42,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:42,844 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:42,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:42,845 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:42,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:42,847 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:42,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:42,850 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:42,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:42,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:42,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:42,854 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:42,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:42,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:43,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:17:43,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:43,726 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:43,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:43,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:43,730 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:43,731 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:43,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:43,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:43,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:43,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:43,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:43,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:43,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:43,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:43,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:43,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:45,689 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:17:47,690 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:17:49,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:17:50,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:50,397 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:50,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:50,400 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:50,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:50,402 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:50,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:50,403 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:50,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:50,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:50,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:50,408 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:50,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:50,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:50,410 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:50,411 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:50,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:50,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:50,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:50,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:50,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:50,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:50,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:50,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:50,688 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:50,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:50,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:50,696 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:50,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:50,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:50,697 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:50,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:51,692 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:17:53,135 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:17:53,693 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:17:57,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:57,157 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:57,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:57,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:57,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:57,162 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:57,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:57,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:57,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:57,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:57,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:57,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:57,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:57,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:57,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:57,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:57,695 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:17:57,941 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:17:57,941 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:17:58,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:58,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:58,008 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:58,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:58,009 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:58,010 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:58,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:58,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:58,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:58,014 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:58,015 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:58,016 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:58,017 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:58,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:58,018 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:58,019 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:17:59,695 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:18:01,696 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:18:02,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,104 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,106 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,108 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,109 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,110 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,117 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,120 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,121 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,129 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,206 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,211 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,212 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,213 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,217 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,218 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,219 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,220 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,930 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,931 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,932 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,933 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,936 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,937 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,938 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,939 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:02,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:03,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:03,089 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:03,092 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:03,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:03,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:03,094 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:03,095 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:03,096 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:03,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:03,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:03,099 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:03,100 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:03,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:03,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:03,102 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:03,103 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:03,697 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:18:05,698 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:18:06,635 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:06,636 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:06,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:06,639 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:06,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:06,640 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:06,641 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:06,642 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:06,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:06,644 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:06,645 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:06,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:06,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:06,647 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:06,648 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:06,649 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:06,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:06,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:06,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:06,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:06,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:06,685 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:06,686 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:06,687 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:06,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:06,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:06,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:06,691 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:06,692 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:06,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:06,693 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:06,694 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:07,699 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:18:08,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:08,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:08,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:08,434 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:08,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:08,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:08,436 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:08,437 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:08,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:08,440 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:08,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:08,441 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:08,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:08,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:08,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:08,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:09,700 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:18:10,709 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:10,710 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:10,712 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:10,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:10,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:10,714 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:10,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:10,716 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:10,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:10,718 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:10,719 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:10,720 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:10,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:10,721 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:10,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:10,722 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:11,701 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:18:12,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:12,526 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:12,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:12,529 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:12,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:12,530 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:12,531 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:12,532 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:12,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:12,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:12,535 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:12,536 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:12,537 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:12,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:12,538 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:12,539 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:12,952 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:12,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:12,955 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:12,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:12,956 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:12,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:12,958 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:12,959 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:12,960 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:12,961 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:12,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:12,962 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:12,963 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:12,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:12,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:12,965 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:13,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:13,122 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:13,125 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:13,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:13,126 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:13,127 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:13,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:13,128 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:13,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:13,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:13,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:13,132 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:13,133 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:13,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:13,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:13,135 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:13,176 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:18:13,176 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:18:13,701 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:18:13,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:13,852 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:13,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:13,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:13,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:13,856 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:13,857 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:13,858 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:13,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:13,860 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:13,861 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:13,862 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:13,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:13,863 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:13,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:13,864 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:16,703 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:18:18,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:18,174 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:18,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:18,177 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:18,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:18,178 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:18,179 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:18,180 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:18,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:18,182 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:18,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:18,183 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:18,184 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:18,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:18,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:18,186 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:18,704 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:18:19,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:19,303 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:19,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:19,306 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:19,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:19,307 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:19,308 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:19,309 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:19,310 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:19,311 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:19,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:19,312 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:19,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:19,314 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:19,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:19,315 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:19,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:19,367 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:19,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:19,370 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:19,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:19,371 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:19,372 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:19,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:19,374 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:19,375 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:19,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:19,376 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:19,377 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:19,378 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:19,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:19,379 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:20,704 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:18:21,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:21,272 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:21,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:21,275 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:21,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:21,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:21,277 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:21,278 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:21,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:21,280 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:21,281 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:21,282 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:21,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:21,283 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:21,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:21,284 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:22,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:18:22,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:22,995 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:22,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:22,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:22,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:22,999 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:23,000 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:23,001 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:23,002 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:23,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:23,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:23,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:23,005 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:23,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:23,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:23,007 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:23,210 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:18:23,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:23,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:23,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:23,442 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:23,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:23,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:23,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:23,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:23,446 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:23,447 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:23,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:23,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:23,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:23,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:23,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:23,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:24,060 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:24,061 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:24,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:24,063 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:24,064 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:24,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:24,065 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:24,066 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:24,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:24,068 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:24,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:24,069 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:24,070 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:24,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:24,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:24,072 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:24,706 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:18:26,160 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:26,161 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:26,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:26,163 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:26,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:26,164 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:26,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:26,166 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:26,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:26,167 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:26,168 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:26,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:26,170 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:26,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:26,171 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:26,172 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:26,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:26,594 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:26,596 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:26,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:26,597 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:26,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:26,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:26,599 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:26,600 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:26,601 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:26,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:26,602 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:26,603 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:26,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:26,604 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:26,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:26,707 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:18:27,190 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,191 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,193 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,194 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,195 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,197 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,198 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,199 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,200 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,201 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,202 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,242 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,245 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,246 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,247 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,249 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,250 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,251 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,253 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,672 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,675 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,676 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,677 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,678 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,679 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,680 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,681 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,683 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,684 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,735 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,738 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,740 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,741 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,742 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,743 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:27,746 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:28,519 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:18:28,519 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:18:28,708 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:18:29,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:29,357 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:29,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:29,358 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:29,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:29,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:29,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:29,448 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:29,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:29,449 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:29,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:29,450 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:29,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:29,452 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:29,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:29,453 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:29,454 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:29,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:29,455 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:29,456 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:29,481 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:29,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:29,486 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:29,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:29,488 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:29,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:29,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:29,490 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:29,668 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 11:18:29,752 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 11:18:29,952 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 11:18:30,033 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 11:18:30,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 11:18:30,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:18:32,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:18:34,775 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:18:36,776 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:18:38,777 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:18:40,777 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:18:42,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:18:43,745 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:18:43,746 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:18:44,779 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:18:46,780 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:18:48,781 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:18:50,782 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:18:52,782 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:18:53,313 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:18:54,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:18:56,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:18:58,785 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:18:58,973 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:18:58,973 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:19:00,785 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:19:02,786 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:19:04,787 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:19:06,788 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:19:08,788 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:19:10,789 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:19:12,790 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:19:14,262 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:19:14,262 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:19:14,790 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:19:16,791 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:19:18,792 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:19:20,793 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:19:22,794 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:19:23,386 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:19:24,795 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:19:26,796 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:19:28,797 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:19:29,586 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:19:29,587 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:19:30,798 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:19:32,798 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:19:34,800 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:19:36,800 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:19:38,801 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:19:40,802 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:19:42,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:19:44,804 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:19:44,810 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:19:44,810 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:19:46,805 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:19:48,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:19:50,807 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:19:52,808 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:19:53,463 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:19:55,809 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:19:57,810 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:19:59,811 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:20:00,085 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:20:00,085 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:20:01,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:20:03,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:20:05,813 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:20:07,814 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:20:09,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:20:11,816 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:20:13,817 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:20:15,313 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:20:15,313 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:20:15,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:20:17,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:20:19,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:20:21,821 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:20:23,538 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:20:23,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:20:25,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:20:27,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:20:29,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:20:30,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:20:30,625 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:20:31,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:20:33,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:20:35,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:20:37,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:20:39,829 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:20:41,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:20:43,831 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:20:45,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:20:45,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:20:45,971 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:20:47,833 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:20:49,833 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:20:51,834 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:20:53,613 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:20:53,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:20:55,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:20:57,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:20:59,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:21:01,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:21:01,388 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:21:01,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:21:03,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:21:06,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:21:08,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:21:10,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:21:12,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:21:14,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:21:16,725 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:21:16,726 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:21:16,845 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:21:18,846 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:21:20,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:21:22,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:21:23,680 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:21:24,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:21:26,849 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:21:28,850 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:21:30,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:21:31,951 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:21:31,951 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:21:32,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:21:34,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:21:36,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:21:38,854 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:21:40,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:21:42,856 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:21:44,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:21:46,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:21:47,187 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:21:47,188 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:21:48,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:21:50,859 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:21:52,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:21:53,749 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:21:54,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:21:56,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:21:58,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:22:00,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:22:02,547 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:22:02,547 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:22:02,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:22:04,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:22:06,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:22:08,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:22:10,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:22:12,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:22:14,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:22:16,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:22:17,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:22:17,791 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:22:18,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:22:20,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:22:22,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:22:23,829 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:22:24,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:22:26,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:22:28,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:22:30,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:22:32,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:22:33,056 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:22:33,057 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:22:34,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:22:37,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:22:39,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:22:41,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:22:43,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:22:45,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:22:47,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:22:48,430 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:22:48,430 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:22:49,882 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:22:51,883 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:22:53,884 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:22:53,906 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:22:55,885 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:22:57,886 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:22:59,887 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:23:01,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:23:03,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:23:03,657 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:23:03,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:23:05,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:23:07,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:23:09,892 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:23:11,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:23:13,894 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:23:15,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:23:17,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:23:18,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:23:18,883 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:23:19,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:23:21,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:23:23,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:23:23,981 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:23:25,900 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:23:27,901 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:23:29,902 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:23:31,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:23:33,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:23:34,185 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:23:34,186 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:23:35,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:23:37,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:23:39,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:23:41,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:23:43,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:23:45,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:23:47,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:23:49,439 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:23:49,440 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:23:49,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:23:51,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:23:53,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:23:54,059 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:23:55,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:23:57,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:23:59,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:24:01,916 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:24:03,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:24:04,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:24:04,737 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:24:05,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:24:07,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:24:09,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:24:11,921 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:24:13,922 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:24:15,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:24:17,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:24:19,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:24:20,054 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:24:20,054 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:24:21,925 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:24:23,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:24:24,134 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:24:25,927 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:24:27,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:24:29,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:24:32,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:24:34,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:24:35,343 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:24:35,343 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:24:36,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:24:38,932 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:24:40,932 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:24:42,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:24:44,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:24:46,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:24:48,935 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:24:50,568 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:24:50,568 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:24:50,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:24:52,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:24:54,212 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:24:54,938 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:24:56,939 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:24:58,940 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:25:00,940 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:25:02,941 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:25:04,942 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:25:05,927 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:25:05,927 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:25:06,943 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:25:08,944 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:25:10,945 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:25:12,945 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:25:14,946 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:25:16,947 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:25:18,948 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:25:20,949 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:25:21,153 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:25:21,153 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:25:22,949 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:25:24,287 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:25:24,950 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:25:26,951 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:25:28,952 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:25:30,953 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:25:32,954 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:25:34,955 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:25:36,956 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:25:37,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:25:37,626 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:25:38,957 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:25:40,957 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:25:42,958 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:25:44,959 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:25:47,961 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:25:49,962 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:25:51,963 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:25:52,913 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:25:52,913 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:25:53,964 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:25:54,361 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:25:55,964 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:25:57,965 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:25:59,966 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:26:01,967 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:26:03,968 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:26:05,969 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:26:07,970 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:26:08,134 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:26:08,134 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:26:09,971 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:26:11,972 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:26:13,973 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:26:15,974 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:26:17,975 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:26:19,976 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:26:21,977 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:26:23,401 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:26:23,401 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:26:23,978 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:26:24,436 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:26:25,979 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:26:27,980 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:26:29,981 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:26:31,981 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:26:33,982 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:26:35,983 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:26:37,984 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:26:38,625 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:26:38,625 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:26:39,985 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:26:41,986 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:26:43,987 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:26:45,988 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:26:47,989 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:26:49,990 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:26:51,991 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:26:54,078 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:26:54,078 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:26:54,511 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:26:54,992 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:26:56,993 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:26:58,994 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:27:00,995 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:27:02,996 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:27:04,997 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:27:06,999 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:27:09,000 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:27:09,428 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:27:09,428 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:27:11,001 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:27:13,001 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:27:15,002 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:27:17,003 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:27:19,004 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:27:21,005 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:27:23,006 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:27:24,586 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:27:24,807 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:27:24,807 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:27:25,007 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:27:27,008 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:27:29,009 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:27:31,010 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:27:33,011 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:27:35,012 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:27:37,013 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:27:39,015 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:27:40,130 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:27:40,130 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:27:41,016 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:27:43,017 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:27:45,018 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:27:47,019 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:27:49,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:27:51,020 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:27:53,021 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:27:54,661 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:27:55,022 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:27:55,413 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:27:55,413 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:27:57,023 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:27:59,024 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:28:01,025 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:28:03,026 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:28:05,027 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:28:07,028 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:28:09,029 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:28:10,739 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:28:10,739 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:28:11,030 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:28:13,031 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:28:15,032 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:28:17,033 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:28:19,034 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:28:21,035 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:28:23,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:28:24,730 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:28:25,036 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:28:25,968 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:28:25,968 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:28:27,037 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:28:29,038 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:28:31,039 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:28:33,040 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:28:35,041 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:28:37,042 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:28:40,043 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:28:41,216 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:28:41,216 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:28:42,044 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:28:44,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:28:46,045 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:28:48,046 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:28:50,047 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:28:52,048 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:28:54,049 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:28:54,805 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:28:56,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:28:56,443 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:28:56,443 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:28:58,050 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:29:00,051 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:29:02,052 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:29:04,053 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:29:06,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:29:08,054 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:29:10,055 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:29:11,670 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:29:11,670 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:29:12,056 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:29:14,057 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:29:16,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:29:18,058 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:29:20,059 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:29:22,060 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:29:24,061 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:29:24,881 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:29:26,061 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:29:27,298 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:29:27,298 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:29:28,062 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:29:30,063 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:29:32,064 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:29:34,065 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:29:36,066 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:29:38,067 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:29:40,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:29:42,068 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:29:42,700 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:29:42,700 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:29:44,069 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:29:46,070 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:29:48,071 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:29:50,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:29:52,072 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:29:54,073 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:29:54,951 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:29:56,074 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:29:58,011 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:29:58,011 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:29:58,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:30:00,075 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:30:02,076 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:30:05,077 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:30:07,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:30:09,078 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:30:11,079 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:30:13,080 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:30:13,239 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:30:13,239 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:30:15,081 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:30:17,081 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:30:19,082 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:30:21,083 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:30:23,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:30:25,025 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:30:25,084 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:30:27,085 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:30:28,558 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:30:28,559 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:30:29,086 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:30:31,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:30:33,087 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:30:35,088 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:30:37,089 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:30:39,090 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:30:41,091 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:30:43,092 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:30:43,793 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:30:43,793 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:30:45,093 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:30:47,094 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:30:49,095 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:30:51,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:30:53,096 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:30:55,098 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:30:55,098 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:30:57,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:30:59,075 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:30:59,075 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:30:59,100 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:31:01,101 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:31:03,102 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:31:05,103 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:31:07,104 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:31:09,105 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:31:11,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:31:13,106 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:31:14,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:31:14,317 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:31:15,107 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:31:17,108 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:31:19,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:31:21,109 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:31:23,110 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:31:25,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:31:25,168 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:31:27,111 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:31:29,112 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:31:29,763 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:31:29,763 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:31:31,113 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:31:33,114 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:31:35,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:31:37,115 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:31:39,116 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:31:42,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:31:44,118 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:31:45,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:31:45,165 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:31:46,119 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:31:48,120 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:31:50,121 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:31:52,122 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:31:54,123 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:31:55,241 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:31:56,124 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:31:58,125 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:32:00,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:32:00,398 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:32:00,398 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:32:02,126 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:32:04,127 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:32:06,128 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:32:08,129 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:32:10,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:32:12,130 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:32:14,131 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:32:15,715 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:32:15,715 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:32:16,132 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:32:18,133 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:32:20,134 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:32:22,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:32:24,135 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:32:25,307 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:32:26,136 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:32:28,137 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:32:30,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:32:30,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:32:30,948 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:32:32,138 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:32:34,139 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:32:36,140 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:32:38,140 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:32:40,141 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:32:42,142 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:32:44,142 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:32:46,143 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:32:46,221 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:32:46,222 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:32:48,144 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:32:50,145 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:32:52,145 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:32:54,146 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:32:55,387 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:32:56,147 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:32:58,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:33:00,148 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:33:01,444 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:33:01,444 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:33:02,149 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:33:04,150 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:33:07,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:33:09,151 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:33:11,152 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:33:13,153 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:33:15,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:33:16,872 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:33:16,873 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:33:17,154 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:33:19,155 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:33:21,156 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:33:23,157 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:33:25,158 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:33:25,461 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:33:27,159 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:33:29,160 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:33:31,161 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:33:32,265 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:33:32,266 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:33:33,162 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:33:35,163 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:33:37,164 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:33:39,165 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:33:41,166 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:33:43,167 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:33:45,168 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:33:47,169 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:33:47,489 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:33:47,490 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:33:49,170 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:33:51,171 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:33:53,172 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:33:55,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:33:55,537 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:33:57,173 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:33:59,174 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:34:01,175 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:34:02,744 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:34:02,744 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:34:03,176 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:34:05,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:34:07,177 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:34:09,178 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:34:11,179 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:34:13,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:34:15,180 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:34:17,181 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:34:18,115 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:34:18,115 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:34:19,182 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:34:22,183 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:34:24,184 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:34:25,611 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:34:26,184 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:34:28,185 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:34:30,186 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:34:32,187 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:34:33,435 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:34:33,436 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:34:34,188 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:34:36,189 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:34:38,190 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:34:40,191 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:34:42,191 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:34:44,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:34:46,193 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:34:48,194 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:34:48,748 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:34:48,748 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:34:50,195 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:34:52,196 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:34:54,197 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:34:55,686 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:34:56,198 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:34:58,199 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:35:00,200 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:35:02,201 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:35:04,003 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:35:04,003 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:35:04,202 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:35:06,203 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:35:08,204 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:35:10,205 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:35:12,206 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:35:14,207 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:35:16,208 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:35:18,209 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:35:19,232 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:35:19,232 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:35:20,210 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:35:22,211 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:35:24,212 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:35:25,762 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:35:27,213 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:35:29,214 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:35:31,215 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:35:33,215 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:35:34,591 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:35:34,592 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:35:35,216 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:35:37,217 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:35:39,218 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:35:41,219 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:35:43,220 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:35:45,221 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:35:47,222 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:35:49,223 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:35:49,816 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:35:49,816 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:35:51,224 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:35:53,225 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:35:55,225 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:35:55,838 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:35:57,226 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:35:59,227 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:36:01,228 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:36:03,229 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:36:05,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:36:05,116 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:36:05,230 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:36:07,231 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:36:09,232 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:36:11,233 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:36:13,234 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:36:15,235 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:36:17,236 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:36:19,237 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:36:20,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:36:20,406 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:36:21,237 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:36:23,238 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:36:25,239 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:36:25,912 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:36:27,240 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:36:29,241 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:36:31,242 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:36:33,243 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:36:35,244 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:36:35,737 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:36:35,737 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:36:37,245 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:36:39,246 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:36:41,247 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:36:43,248 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:36:45,249 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:36:47,249 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:36:49,250 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:36:51,004 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:36:51,004 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:36:51,251 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:36:53,252 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:36:55,253 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:36:55,987 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:36:57,254 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:36:59,255 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:37:01,256 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:37:04,257 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:37:06,228 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:37:06,228 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:37:06,258 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:37:08,259 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:37:10,259 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:37:12,260 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:37:14,261 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:37:16,262 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:37:18,263 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:37:20,264 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:37:21,732 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:37:21,732 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:37:22,265 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:37:24,266 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:37:26,061 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:37:26,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:37:28,267 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:37:30,268 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:37:32,269 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:37:34,270 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:37:36,271 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:37:36,996 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:37:36,996 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:37:38,272 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:37:40,273 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:37:42,273 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:37:44,275 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:37:46,275 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:37:48,276 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:37:50,277 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:37:52,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:37:52,388 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:37:52,389 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:37:54,278 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:37:56,137 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:37:56,279 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:37:58,280 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:38:01,281 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:38:03,282 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:38:05,283 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:38:07,284 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:38:07,616 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:38:07,617 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:38:09,285 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:38:11,285 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:38:13,286 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:38:15,287 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:38:17,288 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:38:19,289 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:38:21,290 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:38:22,832 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:38:22,832 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:38:23,290 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:38:25,291 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:38:26,212 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:38:27,292 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:38:29,293 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:38:31,294 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:38:33,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:38:35,295 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:38:37,296 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:38:38,244 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:38:38,244 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:38:39,297 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:38:41,298 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:38:43,299 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:38:45,300 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:38:47,301 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:38:49,302 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:38:51,303 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:38:53,304 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:38:53,527 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:38:53,527 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:38:55,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:38:56,289 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:38:57,305 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:38:59,306 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:39:01,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:39:03,307 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:39:05,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:39:07,309 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:39:08,754 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:39:08,755 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:39:09,310 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:39:11,311 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:39:13,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:39:15,312 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:39:17,313 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:39:19,314 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:39:21,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:39:23,315 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:39:24,023 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:39:24,023 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:39:25,316 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:39:26,365 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:39:27,317 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:39:29,318 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:39:31,319 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:39:33,320 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:39:35,321 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:39:37,322 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:39:39,286 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:39:39,286 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:39:39,323 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:39:41,324 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:39:44,326 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:39:46,327 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:39:48,328 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:39:50,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:39:52,329 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:39:54,330 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:39:54,550 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:39:54,550 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:39:56,331 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:39:56,442 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:39:58,332 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:40:00,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:40:02,333 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:40:04,334 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:40:06,335 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:40:08,336 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:40:09,776 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:40:09,776 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:40:10,337 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:40:12,338 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:40:14,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:40:16,339 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:40:18,340 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:40:20,341 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:40:22,342 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:40:24,343 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:40:24,998 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:40:24,999 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:40:26,344 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:40:26,519 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:40:28,345 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:40:30,346 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:40:32,347 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:40:34,348 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:40:36,349 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:40:38,350 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:40:40,224 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:40:40,225 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:40:40,351 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:40:42,352 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:40:44,353 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:40:46,354 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:40:48,355 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:40:50,356 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:40:52,357 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:40:54,358 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:40:55,451 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:40:55,451 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:40:56,359 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:40:56,593 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:40:58,360 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:41:00,361 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:41:02,362 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:41:04,363 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:41:06,364 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:41:08,365 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:41:10,366 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:41:10,690 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:41:10,691 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:41:12,367 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:41:14,368 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:41:16,369 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:41:18,370 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:41:20,371 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:41:22,371 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:41:24,372 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:41:25,964 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:41:25,965 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:41:26,373 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:41:26,666 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:41:28,374 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:41:30,375 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:41:32,376 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:41:34,377 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:41:36,378 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:41:38,379 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:41:40,380 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:41:41,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:41:41,215 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:41:43,381 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:41:45,382 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:41:47,383 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:41:49,384 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:41:51,385 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:41:53,386 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:41:55,387 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:41:56,524 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:41:56,524 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:41:56,751 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:41:57,388 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:41:59,389 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:42:01,390 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:42:03,391 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:42:05,392 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:42:07,393 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:42:09,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:42:11,394 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:42:11,883 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:42:11,884 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:42:13,395 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:42:15,396 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:42:17,397 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:42:19,398 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:42:21,399 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:42:23,400 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:42:25,401 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:42:26,816 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:42:27,147 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:42:27,148 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:42:27,402 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:42:29,402 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:42:31,403 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:42:33,404 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:42:35,405 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:42:37,406 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:42:39,407 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:42:42,383 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:42:42,383 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:42:42,409 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:42:44,410 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:42:46,411 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:42:48,412 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:42:50,413 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:42:52,414 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:42:54,415 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:42:56,416 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:42:56,891 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:42:57,698 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:42:57,698 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:42:58,417 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:43:00,418 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:43:02,419 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:43:04,420 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:43:06,421 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:43:08,422 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:43:10,423 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:43:12,424 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:43:13,299 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:43:13,299 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:43:14,425 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:43:16,426 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:43:18,427 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:43:20,428 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:43:22,429 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:43:24,430 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:43:26,431 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:43:26,968 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:43:28,432 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:43:28,606 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:43:28,607 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:43:30,433 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:43:32,434 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:43:34,435 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:43:36,436 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:43:38,436 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:43:40,437 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:43:42,438 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:43:43,940 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:43:43,940 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:43:45,440 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:43:47,440 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:43:49,441 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:43:51,442 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:43:53,443 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:43:55,444 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:43:57,045 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:43:57,445 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:43:59,252 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:43:59,253 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:43:59,446 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:44:01,447 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:44:03,448 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:44:05,449 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:44:07,449 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:44:09,450 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:44:11,451 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:44:13,452 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:44:14,502 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:44:14,503 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:44:15,453 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:44:17,454 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:44:19,455 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:44:21,456 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:44:23,457 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:44:25,458 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:44:27,122 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:44:27,458 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:44:29,459 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:44:29,855 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:44:29,856 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:44:31,460 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:44:33,461 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:44:35,462 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:44:37,463 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:44:39,464 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:44:41,465 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:44:43,466 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:44:45,123 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:44:45,124 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:44:45,467 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:44:47,468 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:44:49,468 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:44:51,469 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:44:53,470 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:44:55,471 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:44:57,195 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:44:57,472 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:44:59,473 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:45:00,431 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:45:00,432 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:45:01,474 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:45:03,475 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:45:05,476 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:45:07,477 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:45:09,478 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:45:11,479 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:45:13,480 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:45:15,481 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:45:15,657 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:45:15,657 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:45:18,482 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:45:20,483 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:45:22,484 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:45:24,485 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:45:26,486 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:45:27,268 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:45:28,487 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:45:30,488 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:45:30,879 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:45:30,879 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:45:32,489 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:45:34,490 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:45:36,491 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:45:38,491 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:45:40,492 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:45:42,493 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:45:44,494 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:45:46,292 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:45:46,292 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:45:46,495 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:45:48,495 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:45:50,496 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:45:52,497 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:45:54,498 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:45:56,499 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:45:57,346 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:45:58,499 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:46:00,500 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:46:01,520 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:46:01,520 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:46:02,501 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:46:04,502 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:46:06,502 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:46:08,503 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:46:10,504 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:46:12,504 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:46:14,505 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:46:16,506 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:46:16,877 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:46:16,878 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:46:18,507 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:46:20,508 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:46:22,508 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:46:24,509 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:46:26,510 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:46:27,420 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:46:28,511 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:46:30,512 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:46:32,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:46:32,093 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:46:32,513 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:46:34,514 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:46:37,515 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:46:39,516 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:46:41,517 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:46:43,518 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:46:45,519 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:46:47,445 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:46:47,445 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:46:47,520 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:46:49,521 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:46:51,522 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:46:53,523 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:46:55,523 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:46:57,494 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:46:57,524 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:46:59,525 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:47:01,526 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:47:02,666 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:47:02,666 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:47:03,527 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:47:05,528 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:47:07,529 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:47:09,530 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:47:11,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:47:13,531 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:47:15,532 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:47:17,533 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:47:18,006 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:47:18,006 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:47:19,534 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:47:21,535 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:47:23,536 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:47:25,537 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:47:27,538 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:47:27,564 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:47:29,539 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:47:31,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:47:33,231 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:47:33,231 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:47:33,540 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:47:35,541 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:47:37,542 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:47:39,543 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:47:41,544 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:47:43,544 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:47:45,545 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:47:47,546 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:47:48,459 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:47:48,459 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:47:50,547 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:47:52,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:47:54,548 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:47:56,549 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:47:57,639 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:47:58,550 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:48:00,551 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:48:02,551 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:48:03,884 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:48:03,884 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:48:04,552 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:48:06,553 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:48:08,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:48:10,554 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:48:12,555 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:48:14,556 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:48:16,557 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:48:18,558 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:48:19,210 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:48:19,210 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:48:20,558 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:48:22,559 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:48:24,560 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:48:26,561 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:48:27,719 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:48:28,562 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:48:30,562 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:48:32,563 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:48:34,546 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:48:34,546 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:48:34,563 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:48:36,564 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:48:38,565 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:48:40,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:48:42,566 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:48:44,567 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:48:46,568 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:48:48,568 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:48:49,873 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:48:49,874 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:48:50,569 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:48:52,569 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:48:54,570 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:48:56,571 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:48:57,795 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:48:59,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:49:01,572 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:49:03,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:49:05,098 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:49:05,098 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:49:05,573 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:49:07,574 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:49:09,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:49:11,575 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:49:13,576 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:49:15,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:49:17,577 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:49:19,578 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:49:20,396 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:49:20,397 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:49:21,579 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:49:23,580 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:49:25,581 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:49:27,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:49:27,870 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:49:29,582 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:49:31,583 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:49:33,584 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:49:35,585 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:49:35,764 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:49:35,765 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:49:37,586 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:49:39,587 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:49:41,587 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:49:43,588 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:49:45,589 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:49:47,590 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:49:49,591 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:49:51,049 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:49:51,049 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:49:51,592 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:49:53,593 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:49:55,594 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:49:57,595 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:49:57,945 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:49:59,595 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:50:01,596 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:50:03,597 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:50:05,598 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:50:06,418 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:50:06,418 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:50:07,599 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:50:09,599 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:50:11,600 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:50:13,601 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:50:16,602 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:50:18,603 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:50:20,603 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:50:21,646 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:50:21,646 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:50:22,604 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:50:24,605 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:50:26,606 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:50:28,020 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:50:28,606 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:50:30,607 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:50:32,608 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:50:34,609 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:50:36,609 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:50:36,898 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:50:36,899 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:50:38,610 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:50:40,611 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:50:42,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:50:44,612 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:50:46,613 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:50:48,614 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:50:50,614 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:50:52,116 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:50:52,117 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:50:52,615 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:50:54,616 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:50:56,617 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:50:58,096 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:50:58,618 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:51:00,619 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:51:02,619 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:51:04,620 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:51:06,621 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:51:07,373 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:51:07,373 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:51:08,622 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:51:10,623 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:51:12,624 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:51:14,625 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:51:16,626 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:51:18,627 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:51:20,628 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:51:22,605 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:51:22,606 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:51:22,629 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:51:24,630 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:51:26,631 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:51:28,170 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:51:28,632 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:51:30,632 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:51:32,633 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:51:34,634 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:51:36,635 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:51:37,912 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:51:37,912 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:51:38,636 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:51:41,637 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:51:43,638 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:51:45,639 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:51:47,640 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:51:49,641 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:51:51,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:51:53,136 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:51:53,136 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:51:53,642 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:51:55,643 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:51:57,644 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:51:58,244 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:51:59,645 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:52:01,646 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:52:03,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:52:05,647 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:52:07,648 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:52:08,360 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:52:08,360 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:52:09,649 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:52:11,649 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:52:13,650 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:52:15,651 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:52:17,651 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:52:19,652 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:52:21,653 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:52:23,654 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:52:23,699 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:52:23,699 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:52:25,655 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:52:27,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:52:28,318 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:52:29,656 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:52:31,657 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:52:33,658 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:52:35,659 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:52:37,660 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:52:38,921 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:52:38,921 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:52:39,661 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:52:41,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:52:43,662 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:52:45,663 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:52:47,664 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:52:49,664 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:52:52,665 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:52:54,169 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:52:54,169 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:52:54,666 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:52:56,667 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:52:58,393 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:52:58,668 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:53:00,669 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:53:02,670 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:53:04,670 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:53:06,671 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:53:08,672 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:53:09,487 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:53:09,487 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:53:10,673 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:53:12,674 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:53:14,675 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:53:16,676 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:53:18,677 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:53:20,678 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:53:22,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:53:24,679 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:53:24,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:53:24,713 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:53:26,680 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:53:28,468 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:53:28,681 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:53:30,682 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:53:32,683 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:53:34,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:53:36,684 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:53:38,685 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:53:40,093 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:53:40,093 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:53:40,686 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:53:42,687 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:53:44,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:53:46,688 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:53:48,689 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:53:50,690 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:53:52,691 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:53:54,692 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:53:55,316 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:53:55,316 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:53:56,693 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:53:58,544 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:53:58,694 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:54:00,695 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:54:02,696 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:54:04,697 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:54:06,697 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:54:08,698 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:54:10,598 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:54:10,599 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:54:10,699 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:54:12,700 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:54:14,701 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:54:16,702 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:54:19,704 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:54:21,705 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:54:23,706 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:54:25,707 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:54:25,890 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:54:25,890 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:54:27,707 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:54:28,621 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:54:29,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:54:31,709 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:54:33,710 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:54:35,711 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:54:37,712 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:54:39,713 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:54:41,165 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:54:41,165 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:54:41,714 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:54:43,715 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:54:45,716 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:54:47,717 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:54:49,718 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:54:51,719 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:54:53,720 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:54:55,721 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:54:57,722 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:54:58,697 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:54:59,071 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:54:59,072 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:54:59,722 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:55:01,723 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:55:03,724 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:55:05,725 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:55:07,726 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:55:09,727 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:55:11,728 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:55:13,729 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:55:14,317 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:55:14,318 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:55:15,730 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:55:17,731 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:55:19,732 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:55:21,733 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:55:23,734 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:55:25,735 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:55:27,736 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:55:28,772 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:55:29,737 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:55:31,158 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:55:31,159 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:55:31,738 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:55:33,739 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:55:35,740 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:55:37,740 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:55:39,741 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:55:41,742 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:55:43,743 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:55:45,744 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:55:46,399 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:55:46,400 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:55:47,744 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:55:49,745 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:55:51,746 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:55:53,746 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:55:55,748 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:55:58,749 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:55:58,848 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:56:00,749 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:56:01,632 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:56:01,632 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:56:02,750 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:56:04,751 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:56:06,751 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:56:08,752 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:56:10,753 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:56:12,754 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:56:14,755 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:56:16,756 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:56:16,865 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:56:16,865 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:56:18,756 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:56:20,757 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:56:22,758 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:56:24,759 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:56:26,760 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:56:28,761 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:56:28,923 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:56:30,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:56:32,236 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:56:32,236 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:56:32,762 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:56:34,763 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:56:36,764 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:56:38,765 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:56:40,766 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:56:42,767 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:56:44,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:56:46,768 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:56:48,769 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:56:49,918 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:56:49,925 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:56:50,770 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:56:52,771 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:56:54,772 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:56:56,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:56:58,773 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:56:58,996 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:57:00,774 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:57:02,775 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:57:04,776 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:57:05,226 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:57:05,227 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:57:06,777 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:57:09,777 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:57:11,778 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:57:13,779 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:57:15,780 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:57:17,781 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:57:19,781 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:57:20,545 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:57:20,546 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:57:21,782 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:57:23,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:57:25,783 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:57:27,784 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:57:29,076 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:57:29,785 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:57:31,785 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:57:33,786 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:57:35,774 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:57:35,774 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:57:35,787 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:57:37,788 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:57:39,789 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:57:41,790 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:57:43,790 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:57:45,791 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:57:47,792 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:57:49,793 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:57:51,038 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:57:51,038 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:57:51,794 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:57:53,795 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:57:55,796 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:57:57,797 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:57:59,147 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:57:59,798 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:58:01,799 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:58:03,800 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:58:05,801 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:58:06,266 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:58:06,266 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:58:07,801 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:58:09,802 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:58:11,803 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:58:13,804 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:58:15,805 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:58:17,806 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:58:19,807 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:58:21,523 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:58:21,524 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:58:21,808 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:58:23,809 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:58:25,810 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:58:27,811 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:58:29,222 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:58:29,811 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:58:31,812 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:58:33,813 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:58:36,815 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:58:36,905 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:58:36,906 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:58:38,816 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:58:40,817 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:58:42,818 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:58:44,819 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:58:46,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:58:48,820 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:58:50,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:58:52,131 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:58:52,131 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:58:52,822 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:58:54,823 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:58:56,824 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:58:58,825 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:58:59,298 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:59:00,826 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:59:02,827 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:59:04,828 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:59:06,829 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:59:07,387 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:59:07,388 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:59:08,830 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:59:10,831 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:59:12,832 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:59:14,833 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:59:16,834 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:59:18,834 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:59:20,835 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:59:22,682 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:59:22,683 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:59:22,836 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:59:24,837 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:59:26,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:59:28,838 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:59:29,373 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:59:30,839 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:59:32,840 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:59:34,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:59:36,841 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:59:37,957 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:59:37,957 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:59:38,842 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:59:40,843 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:59:42,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:59:44,844 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:59:47,846 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:59:49,847 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:59:51,848 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:59:53,181 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 11:59:53,182 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 11:59:53,849 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:59:55,850 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:59:57,851 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 11:59:59,448 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 11:59:59,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:00:01,852 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:00:03,853 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:00:05,854 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:00:07,855 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:00:08,534 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 12:00:08,535 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 12:00:09,856 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:00:11,857 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:00:13,858 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:00:15,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:00:17,860 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:00:19,861 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:00:21,862 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:00:23,823 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 12:00:23,824 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 12:00:23,863 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:00:25,864 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:00:27,865 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:00:29,521 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 12:00:29,866 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:00:31,867 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:00:33,868 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:00:35,869 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:00:37,870 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:00:39,051 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 12:00:39,051 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 12:00:39,871 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:00:41,872 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:00:43,873 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:00:45,874 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:00:47,875 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:00:49,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:00:51,876 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:00:53,877 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:00:54,406 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 12:00:54,407 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 12:00:55,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:00:57,878 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:00:59,595 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 12:00:59,879 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:01:01,880 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:01:03,881 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:01:05,888 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:01:07,889 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:01:09,713 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 12:01:09,714 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 12:01:09,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:01:11,890 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:01:13,891 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:01:16,893 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:01:18,894 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:01:20,895 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:01:22,896 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:01:24,897 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:01:24,982 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 12:01:24,982 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 12:01:26,898 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:01:28,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:01:29,672 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 12:01:30,899 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:01:32,900 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:01:34,901 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:01:36,902 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:01:38,903 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:01:40,276 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 12:01:40,276 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 12:01:40,904 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:01:42,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:01:44,905 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:01:46,906 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:01:48,907 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:01:50,908 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:01:52,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:01:54,909 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:01:55,582 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 12:01:55,582 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 12:01:56,910 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:01:58,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:01:59,746 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 12:02:00,911 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:02:02,912 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:02:04,913 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:02:06,914 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:02:08,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:02:10,915 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:02:12,916 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:02:13,067 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 12:02:13,067 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 12:02:14,917 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:02:16,918 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:02:18,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:02:20,919 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:02:22,920 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:02:24,921 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:02:26,922 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:02:28,393 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 12:02:28,394 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 12:02:28,923 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:02:29,824 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 12:02:30,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:02:32,924 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:02:34,925 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:02:36,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:02:38,926 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:02:40,927 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:02:42,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:02:43,620 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 12:02:43,621 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 12:02:44,928 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:02:46,929 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:02:48,930 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:02:50,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:02:52,931 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:02:54,932 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:02:56,932 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:02:58,882 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 12:02:58,883 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 12:02:59,898 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 12:02:59,933 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:03:01,934 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:03:03,935 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:03:05,935 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:03:07,936 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:03:09,937 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:03:14,107 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 12:03:14,107 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 12:03:29,409 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 12:03:29,409 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 12:03:29,974 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 12:03:44,689 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 12:03:44,689 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 12:03:59,947 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 12:03:59,947 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 12:04:00,171 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 12:04:10,332 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: partial_history 2022-05-24 12:04:10,338 DEBUG SenderThread:1049978 [sender.py:send():232] send: history 2022-05-24 12:04:10,391 DEBUG SenderThread:1049978 [sender.py:send():232] send: summary 2022-05-24 12:04:10,464 INFO SenderThread:1049978 [sender.py:_save_file():946] saving file wandb-summary.json with policy end 2022-05-24 12:04:10,961 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/wandb-summary.json 2022-05-24 12:04:11,961 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:04:15,196 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 12:04:15,198 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 12:04:19,965 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:04:30,134 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 12:04:30,463 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 12:04:30,463 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 12:04:41,975 INFO Thread-7 :1049978 [dir_watcher.py:_on_file_modified():226] file/dir modified: /mnt/lv_ai_1_dante/ml/models/wav2vec2-1b-npsc-nst-bokmaal/wandb/run-20220523_115145-3dybzmyz/files/output.log 2022-05-24 12:04:45,729 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 12:04:45,729 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 12:05:00,211 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 12:05:00,953 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 12:05:00,954 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 12:05:16,215 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 12:05:16,215 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 12:05:30,290 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 12:05:31,433 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 12:05:31,433 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 12:05:46,659 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 12:05:46,659 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 12:06:00,368 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 12:06:01,885 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 12:06:01,886 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 12:06:17,111 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 12:06:17,111 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 12:06:30,443 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 12:06:32,365 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 12:06:32,366 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 12:06:47,593 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 12:06:47,594 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 12:07:00,519 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 12:07:02,859 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 12:07:02,860 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 12:07:18,101 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 12:07:18,102 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 12:07:30,595 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 12:07:33,341 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 12:07:33,342 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 12:07:48,565 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 12:07:48,565 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 12:08:00,674 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats 2022-05-24 12:08:03,791 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 12:08:03,794 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 12:08:19,059 DEBUG HandlerThread:1049978 [handler.py:handle_request():141] handle_request: stop_status 2022-05-24 12:08:19,059 DEBUG SenderThread:1049978 [sender.py:send_request():246] send_request: stop_status 2022-05-24 12:08:30,754 DEBUG SenderThread:1049978 [sender.py:send():232] send: stats